Job Requirements
Columbia, MD
Top Secret/SCI Full Scope Polygraph
Senior Level Career (10+ yrs experience)
$204,000 - $247,000
Job Description
We’re seeking a senior software engineer to support our AI infrastructure team at Columbia, MD. In this role, you’ll help build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications.
Responsibilities:
- Lead the evaluation, configuration, and deployment of inference models for our users.
- Mentor engineers and grow development best practices and standards for the team.
- Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
- Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
- Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.
Required Skills:
- Experience with Python and/or other modern programming languages.
- Experience with Argo CD and/or other CI/CD frameworks.
- Experience with Kubernetes/Helm.
- Experience with AWS or other cloud service providers.
- Strong communication skills and ability to mentor other engineers.
- Excellent leadership and stakeholder management skills.
Nice to Have:
- Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
- Experience with other LLM hosting frameworks and practices.
- Experience supporting production software using Site Reliability Engineering (SRE) best practices.
- Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.
Experience Required: 12 years with Bachelor's degree in a technical discipline or 16 years without degree
Location: Columbia, MD
Clearance: TS/SCI with Polygraph required
Salary Range: $204,000 - $247,000
group id: 91159412
