Measuring the implementation fidelity of the American Development Model

Presenter's Name(s)

Leon LifschutzFollow

Conference Year

January 2019

Abstract

Critics of youth sports in the United States have lamented a system that creates issues of access and could be detrimental to the physical and mental health of its young participants (Project Play, 2015; Rosenwald, 2016; Sabo & Veliz, 2008, Jayanthi et al., 2012). In response to these concerns, USA Hockey, using Long Term Athlete Development Theory as a key theoretical framework, created the American Development Model to improve the delivery of youth hockey in the United States (ADMkids.com). While USA Hockey has invested greatly in bringing ADM to scale across its constituents, little evidence exists as to the extent to which the model is being implemented in its member organizations. Fidelity of implementation of a prescribed treatment or curriculum is tied to better outcomes (Durlak & Dupre, 2008; Mowbray, 2003). This study leverages key concepts of program evaluation theory and survey development to produce a valid and reliable survey instrument that can be used to assess the implementation fidelity of ADM at the 12U age group across the nation.

The results of the survey produce psychometric properties indicating good reliability and validity of the instrument including face and content validity, internal reliability, and factor analysis. Further validating the survey, the final ADM scale demonstrated statistically significant positive associations with two subscales of the Athlete Engagement Questionnaire, an important finding connecting the delivery model to key outcomes. Implications of the overall implementation fidelity of the model based on survey research provide insightful information regarding further curriculum development and implementation practices as well as opportunities for further research on the model’s impact on outcomes for youth hockey players.

Primary Faculty Mentor Name

Kieran Killeen

Status

Graduate

Student College

College of Education and Social Services

Program/Major

Educational Leadership and Policy Studies

Primary Research Category

Social Sciences

Abstract only.

Share

COinS
 

Measuring the implementation fidelity of the American Development Model

Critics of youth sports in the United States have lamented a system that creates issues of access and could be detrimental to the physical and mental health of its young participants (Project Play, 2015; Rosenwald, 2016; Sabo & Veliz, 2008, Jayanthi et al., 2012). In response to these concerns, USA Hockey, using Long Term Athlete Development Theory as a key theoretical framework, created the American Development Model to improve the delivery of youth hockey in the United States (ADMkids.com). While USA Hockey has invested greatly in bringing ADM to scale across its constituents, little evidence exists as to the extent to which the model is being implemented in its member organizations. Fidelity of implementation of a prescribed treatment or curriculum is tied to better outcomes (Durlak & Dupre, 2008; Mowbray, 2003). This study leverages key concepts of program evaluation theory and survey development to produce a valid and reliable survey instrument that can be used to assess the implementation fidelity of ADM at the 12U age group across the nation.

The results of the survey produce psychometric properties indicating good reliability and validity of the instrument including face and content validity, internal reliability, and factor analysis. Further validating the survey, the final ADM scale demonstrated statistically significant positive associations with two subscales of the Athlete Engagement Questionnaire, an important finding connecting the delivery model to key outcomes. Implications of the overall implementation fidelity of the model based on survey research provide insightful information regarding further curriculum development and implementation practices as well as opportunities for further research on the model’s impact on outcomes for youth hockey players.