Data Engineer (TS/SCI)

Key Responsibilities

• Data Engineering: Design, develop, and maintain production-grade streaming and batch data pipelines supporting machine learning applications.
• Machine Learning Support: Collaborate with ML engineers to prepare, transform, validate, and deliver datasets for model development, training, and analytics.
• AWS Cloud Development: Develop and support scalable cloud-based data processing and storage solutions, preferably within AWS environments.
• Python Development: Build maintainable Python-based applications, data processing workflows, and automation solutions.
• Streaming & Sensor Data: Integrate real-time and historical data from radar, OPIR, databases, APIs, and other sensor systems.
• Data Architecture: Evaluate and implement solutions for data ingestion, processing, storage, and access based on operational requirements.
• Data Quality: Establish consistent schemas, timestamps, metadata, and validation processes to ensure accurate and reliable datasets.
• System Reliability: Implement automated testing, monitoring, deployment, recovery, and reprocessing procedures.
• Technical Collaboration: Work with senior engineers and ML teams to evaluate technologies and improve data infrastructure.

Required Qualifications

• Active TS/SCI security clearance.
• Strong programming and software development experience using Python.
• Experience with AWS cloud infrastructure and services.
• Experience supporting Machine Learning applications, workflows, or data pipelines.
• Experience designing, developing, and maintaining streaming and batch data pipelines.
• Knowledge of data ingestion, transformation, storage, and integration across multiple data sources.
• Understanding of streaming data concepts, including buffering, filtering, failure recovery, and replay.
• Experience working with time-series, telemetry, sensor, or other complex datasets.
• Familiarity with software engineering best practices, including version control, testing, and deployment.
• Ability to work independently in a primarily remote environment while collaborating with technical teams.
• Must reside within approximately one hour of Peterson SFB or Buckley SFB.

Preferred Qualifications

• Experience working with radar, OPIR, or other defense-related sensor data.
• Experience supporting DoD, Space Force, missile warning, or ITW/AA programs.
• Familiarity with Apache Kafka, Amazon Kinesis, or similar streaming technologies.
• Experience with AWS data services and cloud-native architectures.
• Knowledge of Docker, Kubernetes, Terraform, or infrastructure-as-code tools.
• Experience with ML feature engineering, dataset versioning, labeling, or training-data preparation.
• Familiarity with workflow orchestration, automated delivery, and monitoring tools.