Recently, considerable attention has been directed to identifying features of high quality out-of-school (OST) programs. Research suggests that involvement in OST programs leads to a variety of positive youth development outcomes. While considerable research addresses outcomes, relatively little attends to aspects of program implementation. The purpose of this study was to examine program quality by assessing three point-of-service (POS) features – the learning environment, content, and youth engagement—from two perspectives (adult observer and youth participants) at Adventure Central, an OST program in Dayton, Ohio.
An approach combining document review and both observations and surveys provides a deeper understanding of the youth perspective and what staff actually do to create a conducive learning environment and deliver content and how these features might facilitate youth engagement. Two instruments were used to collect data, a 16-item observation tool and a 54-item Program Activity Survey. Both observation and youth survey instruments used a 4-point response scale ranging from “not true” to “very true.”
Trained adults conducted observations of sixteen 1-hour activity sessions over the course of four weeks. Two individuals observed each session, compared ratings, and came to consensus on a score for each item. Youth completed the Program Activity Survey after each observation (n=226).
This study examined specific POS features that have been shown to lead to positive outcomes for youth who participate in OST programs. It highlighted the importance of assessing POS features and the value of obtaining multiple perspectives within program quality assessments. Some findings were consistent with past research while others contrast with past findings at Adventure Central, illustrating the importance assessing a variety of aspects in OST programming. The results from this study can specifically help improve programming at Adventure Central. Staff training and technical assistance in specific areas would be beneficial. This information can also assist in moving the field of OST programming forward through theory, research, and practice.