Journal of Behavioral Education

Behavioral researchers have developed a sophisticated methodology to evaluate behavioral change which is dependent upon accurate measurement of behavior. Direct observation of behavior has traditionally been the mainstay of behavioral measurement. Consequently, researchers must attend to the psychometric properties, such as interobserver agreement, of observational measures to ensure reliable and valid measurement. Of the many indices of interobserver agreement, percentage of agreement is the most popular. Its use persists despite repeated admonitions and empirical evidence indicating that it is not the most psychometrically sound statistic to determine interobserver agreement due to its inability to take chance into account. Cohen's (1960) kappa has long been proposed as the more psychometrically sound statistic for assessing interobserver agreement. Kappa is described and computational methods are presented.

Behavior intervention plans (BIPs) are intended to help educators systematically support students with behavioral problems at school. Previous research confirms that the effectiveness of a BIP depends on the degree to which the plan is technically adequate and implemented with integrity. What remains unclear from the literature is how professional experience and environmental variables impact technical adequacy, treatment integrity, and student outcomes. The purpose of this study was to explore these relationships using data collected from a survey of members’ experiences with the BIP implementation team. The researchers collected BIPs from local school districts and then surveyed members of the implementation team regarding their professional qualifications, training, involvement in the BIP development process, treatment integrity, and perceived impact on student outcomes. Results from two multiple regression models predicting treatment integrity and student outcomes suggest that practitioners’ perceptions of BIP quality significantly predicted treatment integrity. Additionally, training, BIP quality, and treatment integrity significantly predicted student outcomes. These findings suggest that practitioners’ perceptions of BIP quality may play an important role in predicting treatment integrity but improving student outcomes requires technical adequacy and targeted professional development.

The study evaluated the convergent validity of the PEAK-E-PA and two common assessments of language development used in educational and clinical settings: the ABLLS-R and the TOLD-I:4. The PEAK-E-PA provides a measure of a participant’s ability to derive arbitrary stimulus relations, and may therefore provide a more complex analysis of language functioning than traditional behavior analytic language assessments. The results of the present study support a strong, significant relationship between the PEAK-E-PA and the ABLLS-R (r = 0.73, p < 0.01), but the obtained coefficient falls within the lower range of prior psychometric evaluations of behavioral language assessments. The results suggest a stronger relationship between the PEAK-E-PA the TOLD-I:4 (r = 0.94, p < 0.01), supporting the use of the PEAK-E-PA with individuals with autism who have progressed beyond the elementary verbal operant skills assessed for in traditional behavioral assessments.

Preschool and kindergarten teachers expect children to sit appropriately and attend to the teacher during group instruction. However, children may engage in high rates of inappropriate responses that distract other students from learning opportunities. In addition, children often receive intermittent teacher attention for inappropriate responses, which might result in a lack of discrimination for when attention is or is not available. The purpose of the current study was to assess the efficacy of a multiple schedule plus rules indicative of the availability of attention for hand raises during circle time in typical preschool classrooms. Results showed that the rates of hand raises increased or maintained in the reinforcement component and decreased in the extinction component of the multiple schedule in all three classrooms. Results suggest that a multiple schedule plus rules indicative of the availability of attention from a classroom teacher can be used by preschool teachers in typical classrooms to maintain hand raise responses at appropriate levels.

Despite their recent popularity in schools, there is minimal consensus in the educational literature regarding the use of mobile devices for reading intervention. The word box intervention (Joseph Read Teach 52:348–356, 1998) has been consistently associated with improvements in student decoding performance. This early efficacy study examined an iPad-supported approach to the word box intervention. The participants were three students from the same first grade classroom, all of whom lacked basic decoding skills and two of which were English language learners. The research question was evaluated with a multielement single-case experimental design that compared the standard materials to an equivalent iPad application. Results did not reveal a clear pattern on measures of decoding across the participants. Time on-task was high for both conditions for all three participants. Results indicated a need for future study of mobile-supported reading interventions in similar contexts.

Facilitated communication (FC), or the provision of graduated assistance by staff in the selection of keys on a communication device by people with developmental disabilities, has become a widely used training technique. Although widespread anecdotal accounts of substantial training benefits and unanticipated communicative competence have been reported, controlled experimental and single subject studies have disclosed little evidence of unexpected competencies. We review research on FC, identify cognitive factors that may stimulate acceptance of this as a training method, and suggest procedures to be employed in individual validation situations when critical communications occur.

An alternating treatments design was used to assess the effects of a constant time delay (CTD) procedure and a cover-copy-compare (CCC) procedure on three students’ acquisition, subsequent maintenance, and adaptation (i.e., application) of acquired spelling words to reading passages. Students were randomly presented two trials of word lists from their respective curriculum under each condition once daily. Results suggest that both procedures were effective for helping students efficiently acquire spelling words, but the CCC condition resulted in more words learned for all participants, although less pronounced when instructional time was considered. However, the CTD procedure resulted in substantially higher levels of maintenance for Jeremy and Leon, with no significant difference between the two procedures for the Anthony. Adaptation of acquired spelling words to reading was about equal under both conditions for Anthony and Leon, while Jeremy showed higher levels of performance in the CTD procedure. Discussion focuses on discrepant results, matching instructional procedures to specific learning concerns, and directions for future research.