Job Requirements
Annapolis Junction, MD
Top Secret/SCI Full Scope Polygraph
Early Career (2+ yrs experience)
Salary not specified
Join Premium to unlock estimated salaries 
Job Description
Candidates must already possess an active Top Secret/SCI w/ Full Scope Polygraph to be considered.
Summary:
• Evaluate AI/ML models and agentic systems to define success metrics and author technical reports.
• Collaborate with data scientists to establish evaluation methodologies and experimental designs.
• Utilize Python, Git, Jira, and Confluence to support model assessment and documentation.
Qualifications & Compensation:
• Degree: Technical bachelor's degree or equivalent experience
• Years of experience: 6+ years
• Total Compensation: $252k+ yearly
Job Description:
• Develop evaluation methodologies and experimental designs for assessing model and agent performance.
• Conduct reviews of current state-of-the-art AI/ML evaluation methods and emerging techniques.
• Define and document evaluation criteria, success metrics, and assessment rationale.
• Assess candidate models and agentic systems and produce written technical findings and recommendations.
• Author technical reports, evaluation plans, and decision-support documentation for stakeholders.
• Utilize key skills including Agentic AI, Mathematics, Python, Git, JIRA, Confluence, and Data Science.
About SYSTOLIC:
SYSTOLIC is dedicated to giving our employees the best possible company experience so that they can focus on providing outstanding support to their customer’s mission. Our company is founded on integrity, enthusiasm, and a relentless commitment to supporting the Intelligence Community. You can learn more about us and submit an application to be considered against our current and future openings at https://systolic.com.
To learn about our compensation ranges, visit our Pay Transparency page at: https://systolic.com/pay-transparency
Summary:
• Evaluate AI/ML models and agentic systems to define success metrics and author technical reports.
• Collaborate with data scientists to establish evaluation methodologies and experimental designs.
• Utilize Python, Git, Jira, and Confluence to support model assessment and documentation.
Qualifications & Compensation:
• Degree: Technical bachelor's degree or equivalent experience
• Years of experience: 6+ years
• Total Compensation: $252k+ yearly
Job Description:
• Develop evaluation methodologies and experimental designs for assessing model and agent performance.
• Conduct reviews of current state-of-the-art AI/ML evaluation methods and emerging techniques.
• Define and document evaluation criteria, success metrics, and assessment rationale.
• Assess candidate models and agentic systems and produce written technical findings and recommendations.
• Author technical reports, evaluation plans, and decision-support documentation for stakeholders.
• Utilize key skills including Agentic AI, Mathematics, Python, Git, JIRA, Confluence, and Data Science.
About SYSTOLIC:
SYSTOLIC is dedicated to giving our employees the best possible company experience so that they can focus on providing outstanding support to their customer’s mission. Our company is founded on integrity, enthusiasm, and a relentless commitment to supporting the Intelligence Community. You can learn more about us and submit an application to be considered against our current and future openings at https://systolic.com.
To learn about our compensation ranges, visit our Pay Transparency page at: https://systolic.com/pay-transparency
group id: 10527119