Job Requirements
Washington, DC
Top Secret/SCI CI Polygraph
Senior Level Career (10+ yrs experience)
Salary not specified
Join Premium to unlock estimated salaries 
Job Description
Benefits:
Description:
Specific QAF duties:
- A competitive salary with performance bonus opportunities.
- Comprehensive healthcare benefits, including medical, vision, dental, and orthodontia coverage.
- A substantial retirement plan with no vesting schedule.
- Career development opportunities, including on-the-job training, tuition reimbursement, and networking.
- A positive work environment where employees are respected, supported, and engaged.
Description:
- Develops and applies fundamental mathematics, mathematical or statistical theory to collect, organize, interpret and summarize numerical data to generate usable information to solve a wide range of intelligence problems.
- Applies mathematical theories and statistical methods to solve practical problems.
- Develops mathematical or statistical models of phenomena for analysis or computational simulation.
- Designs complex metrics projects that apply valid scientific techniques and utilize information obtained from baselines or historical data to structure analyses.
- Plans and performs data collection for projects, determining types/sizes of sample groups and prepares data for processing by organizing information and checking for inaccuracies.
- Processes large amounts of data for statistical modeling and graphic analysis (metrics).
- Develop computer code to automate the collecting and processing of data.
- Produces results of analyses in graphs, charts, tables, and metrics.
- Prepares products to describe and document findings and activities.
Specific QAF duties:
- Conduct audits to ensure compliant use of Al systems for approved use-cases in all source analysis.
- Evaluate AA performance and adherence to tradecraft standards and identify areas for improvement.
- Develop and maintain a repository of audit findings and recommendations to facilitate knowledge sharing and best practices across the organization.
- Design and execute TEVV protocols to evaluate the performance, robustness, and fairness of Al systems in all source analysis contexts.
- Develop and apply statistical models and methods to analyze TEVV results and identify areas for improvement.
- Collaborate with stakeholders to develop and implement corrective actions to address TEVV findings.
- Develop and track performance metrics to evaluate the effectiveness of Al systems in all source analysis.
- Analyze and interpret performance metrics to identify trends, patterns, and areas for improvement.
- Collaborate with stakeholders to develop and implement data-driven decision-making processes to inform Al system development and improvement.
- Develop and refine methodologies for evaluating Al system performance, robustness, and fairness in all source analysis contexts. Collaborate with stakeholders to develop and implement best practices for Al system development, testing, and deployment.
- Publish and present research findings on Al assurance best practices Supports capability development by editing and storing code in Government owned/controlled source version control repositories.
group id: 10431809
