Posted today
Top Secret/SCI
Unspecified
Unspecified
IT - Database
San Diego, CA (On-Site/Office)
Mount Indie is seeking a Senior Data Engineer to design, build, and operationalize advanced data pipelines and analytics supporting Naval and DoD mission challenges. This role requires deep experience across data engineering, distributed systems, event streaming, cloud data frameworks, and mission-focused analytics. The Senior Data Engineer will support complex data integration efforts, collaborate with cross-functional engineering teams, and lead data architecture improvements aligned with operational Navy needs.
Responsibilities:
Required Skills and Experience:
Preferred Skills and Experience:
Education and Certification Requirements:
Citizenship and Clearance Requirements:
Location:
Travel:
Responsibilities:
- Collaborate with cross-functional teams to understand and address Navy operational challenges using data pipelines and analytics.
- Design, develop, and implement data pipelines and analytics for naval applications.
- Perform exploratory data analysis, algorithm development, and testing.
- Normalize and structure data to common standards for interoperability.
- Work with multiple data formats, including CSV, JSON, XML, Parquet, and ORC.
- Develop and deploy data pipelines and analytics in real-world operational environments.
- Deploy, monitor, and optimize data pipelines to ensure high performance and reliability.
- Implement event streaming pipelines using Apache Kafka, AWS Kinesis, RabbitMQ, or ZeroMQ.
- Utilize distributed computing platforms such as AWS Lambda, Dask, or Spark.
- Leverage cloud-native tools including AWS S3, RDS, EFS, SNS, and SQS.
- Utilize data pipeline frameworks such as AirByte, Apache Airflow, dbt, Apache Iceberg, and Snowflake.
- Work with GIS data using ArcGIS, PostGIS, and related tooling.
- Implement containerized environments using Docker or Kubernetes.
- Apply cybersecurity principles in the context of secure DoD data applications.
- Communicate findings and engineering solutions effectively with technical and mission stakeholders.
Required Skills and Experience:
- At least 10 years of experience as a business analyst, data analyst, data scientist, data engineer, database administrator, geospatial analyst/engineer, machine learning engineer, or software engineer.
- Strong programming skills in Python.
- Programming experience in Go or Rust.
- Proven experience designing, developing, and deploying complex data pipelines.
- Familiarity with data formats including CSV, JSON, XML, Parquet, ORC.
- Familiarity with event streaming technologies: Kafka, AWS Kinesis, RabbitMQ, ZeroMQ.
- Experience deploying, monitoring, and optimizing operational data pipelines.
- Expertise in Elasticsearch, Redis, S3, PostgreSQL, or related datastores.
- Experience with AWS data services (EFS, RDS, S3, SNS, SQS).
- Experience with distributed computing: AWS Lambda, DASK, Spark.
- Familiarity with AirByte, Airflow, dbt, Iceberg, Snowflake.
- Experience integrating and retrieving GIS data (ArcGIS, PostGIS).
- Strong analytical and problem-solving skills.
- Excellent communication skills in a collaborative team environment.
- Previous experience supporting government agencies or military organizations.
Preferred Skills and Experience:
- Experience leading data engineering efforts in secure DoD environments.
- Experience working with NAVWAR, NIWC Pacific, or naval C2/ISR programs.
- Experience architecting data solutions across multi-domain or cross-domain systems.
- Familiarity with MLOps pipelines or AI-enabled analytics workflows.
- Experience with cloud-native data architecture and API design.
Education and Certification Requirements:
- Master of Science in Computer Science, Data Science, Geography, Math, Machine Learning, or Statistics.
- Additional certifications in data engineering, cloud, geospatial, or cybersecurity are a plus if required by contract.
Citizenship and Clearance Requirements:
- US Citizenship
- No dual citizenship
- Active DoD TS/SCI clearance required
Location:
- Arlington, VA; Colorado Springs, CO; Charleston, SC; Denver, CO; or San Diego, CA.
Travel:
- Up to 15% CONUS, and limited OCONUS if mission requires.
group id: 91082210