Measuring the implementation fidelity of the American Development Model
Conference Year
January 2019
Abstract
Critics of youth sports in the United States have lamented a system that creates issues of access and could be detrimental to the physical and mental health of its young participants (Project Play, 2015; Rosenwald, 2016; Sabo & Veliz, 2008, Jayanthi et al., 2012). In response to these concerns, USA Hockey, using Long Term Athlete Development Theory as a key theoretical framework, created the American Development Model to improve the delivery of youth hockey in the United States (ADMkids.com). While USA Hockey has invested greatly in bringing ADM to scale across its constituents, little evidence exists as to the extent to which the model is being implemented in its member organizations. Fidelity of implementation of a prescribed treatment or curriculum is tied to better outcomes (Durlak & Dupre, 2008; Mowbray, 2003). This study leverages key concepts of program evaluation theory and survey development to produce a valid and reliable survey instrument that can be used to assess the implementation fidelity of ADM at the 12U age group across the nation.
The results of the survey produce psychometric properties indicating good reliability and validity of the instrument including face and content validity, internal reliability, and factor analysis. Further validating the survey, the final ADM scale demonstrated statistically significant positive associations with two subscales of the Athlete Engagement Questionnaire, an important finding connecting the delivery model to key outcomes. Implications of the overall implementation fidelity of the model based on survey research provide insightful information regarding further curriculum development and implementation practices as well as opportunities for further research on the model’s impact on outcomes for youth hockey players.
Primary Faculty Mentor Name
Kieran Killeen
Status
Graduate
Student College
College of Education and Social Services
Program/Major
Educational Leadership and Policy Studies
Primary Research Category
Social Sciences
Measuring the implementation fidelity of the American Development Model
Critics of youth sports in the United States have lamented a system that creates issues of access and could be detrimental to the physical and mental health of its young participants (Project Play, 2015; Rosenwald, 2016; Sabo & Veliz, 2008, Jayanthi et al., 2012). In response to these concerns, USA Hockey, using Long Term Athlete Development Theory as a key theoretical framework, created the American Development Model to improve the delivery of youth hockey in the United States (ADMkids.com). While USA Hockey has invested greatly in bringing ADM to scale across its constituents, little evidence exists as to the extent to which the model is being implemented in its member organizations. Fidelity of implementation of a prescribed treatment or curriculum is tied to better outcomes (Durlak & Dupre, 2008; Mowbray, 2003). This study leverages key concepts of program evaluation theory and survey development to produce a valid and reliable survey instrument that can be used to assess the implementation fidelity of ADM at the 12U age group across the nation.
The results of the survey produce psychometric properties indicating good reliability and validity of the instrument including face and content validity, internal reliability, and factor analysis. Further validating the survey, the final ADM scale demonstrated statistically significant positive associations with two subscales of the Athlete Engagement Questionnaire, an important finding connecting the delivery model to key outcomes. Implications of the overall implementation fidelity of the model based on survey research provide insightful information regarding further curriculum development and implementation practices as well as opportunities for further research on the model’s impact on outcomes for youth hockey players.