AI Systems Engineer - Active Top Secret Required

We are seeking a highly skilled, self-motivated, and resourceful AI Systems Engineer to spearhead the design and deployment of AI capabilities supporting the highest levels of government. This is a unique opportunity to build and manage a complete AI team, vision, infrastructure, and suite of capabilities from the ground up. This role demands a deep understanding of hardware, data engineering, software engineering, containerization, and system administration, coupled with a proactive and problem-solving mindset.

Seize your opportunity to fulfill our AI systems engineering requirements across our set of managed services and processes. With GDIT, you will gain unmatched experience within our fast-paced environment along with extensive options for further training, certification, and career advancement.

How an AI Systems Engineer will make an Impact:

• Identify and recommend optimal hardware infrastructure (compute, storage, networking) required to support inference workloads within a self-hosted, offline environment.
• Implement the integration of AI-specific hardware (e.g., GPUs and servers) within our existing Kubernetes clusters. Configure and optimize Kubernetes for AI workloads.
• Research, deploy, and manage suitable engines for large language models and other AI models. Optimize these engines for performance and efficiency.
• Evaluate and select open-weight models based on accuracy, performance, consistency, and unbiased responses.
• Implement prompt engineering concepts to provide optimal output and the best user experience.
• Develop Extract, Transform, Load (ETL) pipelines of structured and unstructured data from a verity of disparate sources.
• Properly format, chunk, and embed documents into vector databases for advanced search and Retrieval Augmented Generation (RAG) capabilities.
• Implement and manage appropriate database solutions for storing and retrieving data relevant to the AI applications. Ensure data integrity, security, and performance.
• Maintain and troubleshoot the underlying Linux operating systems powering the AI infrastructure. Ensure system stability, security, and performance.
• Configure on-prem S3-compatible storage solutions for storing datasets, models, and other AI-related artifacts.
• Implement and maintain stringent security measures to protect the AI infrastructure and data within the environment. Adhere to internal compliance requirements.
• Contribute to engineering of software that interacts with our internal models and other data platforms.
• Proactively monitor the AI infrastructure, diagnose and resolve issues, and provide support to internal users of the AI capabilities.
• Create comprehensive documentation for the infrastructure, deployment processes, and operational procedures.
• Stay up to date with the latest advancements in hardware, software, and best practices, and adapt them for our unique environment.

What You'll need to Succeed:

• Experience with containerization technologies, particularly Kubernetes, including hardware integration (e.g., GPU nodes).
• Strong understanding of AI/ML concepts and experience deploying and managing inference engines.
• Experience in designing and implementing data pipelines using relevant tools and technologies.
• Software engineering/development experience.
• Proficiency in database management.
• Proficiency in Linux system administration, including scripting and automation.
• Experience with configuring and managing S3-compatible storage solutions.
• Excellent problem-solving and troubleshooting skills, with the ability to work independently in a challenging environment.
• Strong understanding of security best practices for isolated environments.
• Excellent communication and documentation skills.
• Education: BS in Computer Engineering, Computer Science or related technology field. Experience may be substituted for education.
• Required Experience: 10+ years
• Required Technical Skills: DoD 8140/8570 IAT III compliance
• Security Clearance Level: Active Top Secret
• Location: Washington, District of Columbia; limited telework may be available

GDIT Is Your Place:

• 401K with company match
• Comprehensive health and wellness packages
• Internal mobility team dedicated to helping you own your career
• Professional growth opportunities including paid education and certifications
• Cutting-edge technology you can learn from
• Rest and recharge with paid vacation and holidays

Work Requirements