Job Requirements
Remote
Secret Polygraph not specified
Career Level not specified
Salary not specified
Join Premium to unlock estimated salaries 
Job Description
Summary:
Yorktown Systems Group, Inc. (YSG) is seeking a highly qualified Research Analyst to provide comprehensive Warfighter Training Support Services at the United States Air Force Academy (USAFA). The purpose of this position is to support the planning, development, execution, management, and evaluation of military training for approximately 4,200 cadets annually during both the academic year and summer training programs. This position will assist the USAFA in delivering a coherent, progressive, and operationally relevant 47-month cumulative military training continuum aligned with Department of the Air Force (DAF) readiness objectives, Joint Force expectations, and USAFA cadet development outcomes.
Specific duties may include, but are not limited to:
• Convert execution findings into future planning inputs
• Aggregate and analyze performance data across events, cohorts, and training cycles within the Moodle/TUTOR VSP to identify trends, systemic strengths, and recurring performance gaps.
• Collaborate with USAFA stakeholders, instructional designers, and evaluation team members to support data collection activities, evaluation requirements, and performance measurement efforts.
• Collect, document, and organize observations, rubric results, AAR inputs, instructor feedback, participant performance data, and lessons learned from training events.
• Collectively execute all program evaluation activities across the WTIS framework.
• Apply Kirkpatrick’s four-level training evaluation model within a repeatable process that integrates assessment tool development, disciplined data capture, structured AAR consolidation, and performance analysis within the required environment and tools.
• Define and maintain the data structure and workflows required to capture, store, and export evaluation data in a manner that supports consistent analysis.
• Conducts analytical review of existing and available Program of Instruction (POI), courseware, lesson materials, exercise scenarios, training schedules, TLOs, ELOs, primary tasks and objectives, evaluation criteria, recurring training events, historical planning products, and after-action inputs.
• Analyze assessment data and evaluation findings to support dashboard reporting, program assessments, trend analysis, and recommendations for continuous improvement.
• Assist with the development and administration of surveys, questionnaires, focus groups, interviews, and other data collection instruments.
• Collect, clean, validate, and manage quantitative and qualitative data from multiple sources.
• Conduct statistical analyses and qualitative assessments to identify trends, effectiveness measures, and performance gaps.
• Support development of evaluation plans, logic models, measures of effectiveness (MOEs), and measures of performance (MOPs).
• Prepare reports, dashboards, data visualizations, and briefing materials for USAFA leadership and stakeholders.
• Conduct literature reviews, background research, and document analysis to support evaluation efforts.
• Assist in consolidating and analyzing AAR results, rubric scores, and participant feedback.
Required Qualifications:
• Bachelor degree in Program Evaluation, Education, Statistics, Social Science, Research Methods, Organizational Development, or a related field.
• (Preferred) Training/certification in evaluation methodologies (e.g. ROI institute, Kirkpatrick).
• Experience supporting assessment frameworks, AAR methodology, rubric development, data analysis, trend reporting, and presentation of findings to stakeholders.
• Experience evaluating programs/projects; creation of evaluation plans and logic models; developing data collection tools and procedures; facilitating data collection; conducting statistical analysis of data; writing evaluation reports and providing statistical analysis of programs of similar scale and duration.
• Possess an in-depth and current understanding of program evaluation including the four major categories of standards (propriety, utility, feasibility, and accuracy) when conducting a program evaluation.
• Ability to evaluate the implementation and effectiveness of key initiatives and programs through the use of quantitative and qualitative research methods, and to provide results that inform policymakers and stakeholders' decisions regarding program viability and improvement.
• Ability to collect, organize, analyze, and interpret quantitative and qualitative data from multiple sources.
• Possess an in-depth and current understanding of research and evaluation methods and techniques.
• Experience evaluating military training, leadership development, education, human performance, organizational effectiveness, or related programs is highly desired.
Clearance: Must be able to obtain a SECRET security clearance.
Location: Colorado Springs, CO
Travel: Some travel will be required
Yorktown Systems Group, Inc. (YSG) is seeking a highly qualified Research Analyst to provide comprehensive Warfighter Training Support Services at the United States Air Force Academy (USAFA). The purpose of this position is to support the planning, development, execution, management, and evaluation of military training for approximately 4,200 cadets annually during both the academic year and summer training programs. This position will assist the USAFA in delivering a coherent, progressive, and operationally relevant 47-month cumulative military training continuum aligned with Department of the Air Force (DAF) readiness objectives, Joint Force expectations, and USAFA cadet development outcomes.
Specific duties may include, but are not limited to:
• Convert execution findings into future planning inputs
• Aggregate and analyze performance data across events, cohorts, and training cycles within the Moodle/TUTOR VSP to identify trends, systemic strengths, and recurring performance gaps.
• Collaborate with USAFA stakeholders, instructional designers, and evaluation team members to support data collection activities, evaluation requirements, and performance measurement efforts.
• Collect, document, and organize observations, rubric results, AAR inputs, instructor feedback, participant performance data, and lessons learned from training events.
• Collectively execute all program evaluation activities across the WTIS framework.
• Apply Kirkpatrick’s four-level training evaluation model within a repeatable process that integrates assessment tool development, disciplined data capture, structured AAR consolidation, and performance analysis within the required environment and tools.
• Define and maintain the data structure and workflows required to capture, store, and export evaluation data in a manner that supports consistent analysis.
• Conducts analytical review of existing and available Program of Instruction (POI), courseware, lesson materials, exercise scenarios, training schedules, TLOs, ELOs, primary tasks and objectives, evaluation criteria, recurring training events, historical planning products, and after-action inputs.
• Analyze assessment data and evaluation findings to support dashboard reporting, program assessments, trend analysis, and recommendations for continuous improvement.
• Assist with the development and administration of surveys, questionnaires, focus groups, interviews, and other data collection instruments.
• Collect, clean, validate, and manage quantitative and qualitative data from multiple sources.
• Conduct statistical analyses and qualitative assessments to identify trends, effectiveness measures, and performance gaps.
• Support development of evaluation plans, logic models, measures of effectiveness (MOEs), and measures of performance (MOPs).
• Prepare reports, dashboards, data visualizations, and briefing materials for USAFA leadership and stakeholders.
• Conduct literature reviews, background research, and document analysis to support evaluation efforts.
• Assist in consolidating and analyzing AAR results, rubric scores, and participant feedback.
Required Qualifications:
• Bachelor degree in Program Evaluation, Education, Statistics, Social Science, Research Methods, Organizational Development, or a related field.
• (Preferred) Training/certification in evaluation methodologies (e.g. ROI institute, Kirkpatrick).
• Experience supporting assessment frameworks, AAR methodology, rubric development, data analysis, trend reporting, and presentation of findings to stakeholders.
• Experience evaluating programs/projects; creation of evaluation plans and logic models; developing data collection tools and procedures; facilitating data collection; conducting statistical analysis of data; writing evaluation reports and providing statistical analysis of programs of similar scale and duration.
• Possess an in-depth and current understanding of program evaluation including the four major categories of standards (propriety, utility, feasibility, and accuracy) when conducting a program evaluation.
• Ability to evaluate the implementation and effectiveness of key initiatives and programs through the use of quantitative and qualitative research methods, and to provide results that inform policymakers and stakeholders' decisions regarding program viability and improvement.
• Ability to collect, organize, analyze, and interpret quantitative and qualitative data from multiple sources.
• Possess an in-depth and current understanding of research and evaluation methods and techniques.
• Experience evaluating military training, leadership development, education, human performance, organizational effectiveness, or related programs is highly desired.
Clearance: Must be able to obtain a SECRET security clearance.
Location: Colorado Springs, CO
Travel: Some travel will be required
group id: 10480131
