user avatar

Senior Software Engineer – Inference

Neural Solutions

Posted today

Job Requirements

Columbia, MD
Top Secret/SCI Polygraph
Senior Level Career (10+ yrs experience)
$204,000 - $247,000

Job Description


Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. In this role, you’ll help build and maintain the foundation for AI capabilities while supporting a broader ecosystem of AI-enabled applications.

Responsibilities:

  • Lead the evaluation, configuration, and deployment of inference models for our users.

  • Mentor engineers and grow development best practices and standards for the team.

  • Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.

  • Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.



Required Skills:

  • Experience with Python and/or other modern programming languages.

  • Experience with Argo CD and/or other CI/CD frameworks.

  • Experience with Kubernetes/Helm.

  • Experience with AWS or other cloud service providers.

  • Strong communication skills and ability to mentor other engineers.

  • Excellent leadership and stakeholder management skills.



Nice to Have:

  • Experience with vLLM, LiteLLM, or similar inference-serving frameworks.

  • Experience supporting production software using Site Reliability Engineering (SRE) best practices.

  • Knowledge of and interest in hosting AI capabilities.



Experience Required: 12 years with Bachelor’s degree in a technical discipline, or 16 years without degree

Location: Columbia, MD

Clearance: TS/SCI with Polygraph required

Salary Range: $204,000 - $247,000
group id: 91159412
Find Neural Solutions on Social Media
Recruiters
user avatar
About Us
At Neural Solutions, we believe that investing in our team's development is key to our success. By providing our employees with the means and opportunities to become the best versions of themselves, we cultivate an environment of innovation and expertise. This focus on personal and professional growth directly translates into the high-quality, advanced solutions we offer our clients. Our commitment to both employee development and technical delivery sets us apart in the industry. We pride ourselves on creating a workplace where talent thrives and where our clients receive state-of-the-art AI and cyber security applications that meet their evolving needs. At Neural Solutions you can expect: 401k with 8% monthly contributions and performance bonuses, 31 days PTO including holidays, HSA, dental, and vision insurance with partial premium coverage, Life insurance up to $250,000 and disability insurance, $10,000 referral bonus, $1,500 technology allowance

Neural Solutions Jobs


Job Category
IT - Software
Clearance Level
Top Secret/SCI