user avatar

Senior Data Engineer

Zachary Piper Solutions, LLC

Posted today

Job Requirements

Honolulu, HI
Top Secret/SCI Polygraph Unspecified
Career Level not specified
$120,000 - $180,000

Job Description

Zachary Piper Solutions is seeking a Big Data Engineer to support a company focused on delivering mission-critical data platform capabilities within the defense and intelligence sector. This position is on-site in Honolulu, HI . An active TS/SCI clearance is required. The Big Data Engineer will design, build, and maintain secure real-time and near-real-time data ingestion pipelines that support operational decision-making across complex data environments. This is an opportunity to play a key role in ensuring reliable, low-latency data delivery for high-impact mission operations.

Responsibilities for the Big Data Engineer include:
  • Design, build, and maintain resilient real-time and near-real-time data ingestion pipelines utilizing Apache NiFi, REST APIs, and streaming data architectures.
  • Configure, monitor, and optimize data movement across security domains while ensuring data integrity, compliance, and operational reliability.
  • Parse, transform, validate, and route structured and unstructured datasets including CSV, JSON, XML, and Excel formats.
  • Develop automation scripts using Python, Bash, or similar technologies to support data processing, monitoring, alerting, and data quality validation.
  • Collaborate with platform, software, security, and data engineering teams to improve pipeline performance, observability, scalability, and operational effectiveness.

Required Qualifications for the Big Data Engineer include:
  • 3+ years of experience in data engineering, data operations, DevOps, or a related role supporting production data pipelines.
  • Experience with Apache NiFi, REST APIs, and real-time or near-real-time data ingestion architectures.
  • Proficiency with Python, Bash, or similar scripting languages.
  • Working knowledge of Linux (RedHat) environments and command-line administration.
  • Experience working with ETL/ELT processes, streaming architectures, data quality practices, and data transformation workflows.
  • Familiarity with JSON, XML, CSV, and Excel data formats.
  • Strong understanding of monitoring, troubleshooting, and operational support for enterprise data pipelines.
  • Bachelor's degree in Computer Science, Mathematics, Electrical Engineering, Physics, Information Systems, Information Technology, or a related technical field.
  • Active TS/SCI Clearance.

Preferred Qualifications for the Big Data Engineer include:
  • Experience with Kafka, JMS, Apache Flink, Spark Streaming, or similar messaging and streaming technologies.
  • Experience with Grafana, Prometheus, Elasticsearch, or other observability platforms.
  • Experience with Snowflake or enterprise-scale data platforms.
  • Familiarity with cross-domain solutions, data transfer validation, content filtering, or secure data movement concepts.
  • Experience implementing encryption, authentication, authorization, and data classification controls.
  • Experience with Git, Agile methodologies, and Scrum environments.
  • Prior experience supporting government, defense, or intelligence community programs.

Compensation for the Big Data Engineer includes:

Salary Range: $120,000 - $180,000+ depending on experience

Full Benefits Package: PTO, Paid Holidays, Medical, Dental, Vision, 401K, Sick Leave as Required by Law

#LI-KD1 #LI-ONSITE

SEO Keywords:

Big Data Engineer, Data Engineer, Apache NiFi, Data Pipelines, Real-Time Data Processing, Near Real-Time Data Ingestion, ETL, ELT, Streaming Data, Kafka, Apache Flink, Spark Streaming, REST API, Python Developer, Bash Scripting, Linux Engineer, RedHat Linux, Data Operations, DevOps Engineer, Data Platform Engineer, Grafana, Prometheus, Elasticsearch, Snowflake, Data Quality, Data Validation, Data Integration, Cross Domain Solutions, CDS, Secure Data Transfer, TS/SCI Clearance Jobs, Defense Technology, Intelligence Community, Data Analytics Infrastructure, Enterprise Data Engineering, Mission-Critical Systems, Big Data Platform, Data Monitoring, Data Automation, Git, Agile, Scrum, Honolulu Hawaii Jobs, On-Site Engineering Jobs, Hawaii, Oahu, Maui.
group id: 10430981
job ad image
Find Zachary Piper Solutions, LLC on Social Media
Recruiters
user avatar
About Us
Zachary Piper Solutions is a National Security focused technology services and consulting firm with a top-secret facility clearance. We support mission-critical initiatives on behalf of the Intelligence Community, Department of Defense, Department of Homeland Security, Department of Justice, Department of State, and a variety of Civilian Agencies. ZPS is dedicated to help protect government networks against cyber threats and to maximize the wide-spectrum of intelligence and security-related technologies. Our dedicated support and proven experience drive results in support of our client’s mission objectives.
job ad2 image

Zachary Piper Solutions, LLC Jobs


Job Category
IT - Database
Clearance Level
Top Secret/SCI