user avatar

Data Streaming Engineer (TS/SCI)

Zachary Piper Solutions, LLC

Posted today

Job Requirements

San Diego, CA
Top Secret/SCI Polygraph Unspecified
Career Level not specified
$170,000 - $230,000

Job Description

Zachary Piper Solutions is seeking a TS/SCI cleared to support the United States Air Force's Joint Fires Network program in San Diego, California. This full-time, on-site role focuses on managing real-time data ingest operations, monitoring data quality, and supporting the delivery of mission-critical data feeds. The ideal candidate will have strong experience in data engineering, scripting, data visualization, and operational support within technical environments.


  • 5 years.
  • Program has been awarded and is live.
  • Currently in month 7 out of 5 years.


  • Full-time on-site role in San Diego, California, supporting operational data pipelines and mission systems. Travel up to 15% to Oahu, Hawaii may be required, including long-distance trips to additional government or contractor facilities.
  • Position operates in a low supervision independent capacity, working with cross-domain groups across the nation.



  • Support continuous data ingest operations, monitoring data feeds, pipeline health, and overall data quality.
  • Visualize and interpret data findings through dynamic reports and dashboards for leadership and users.
  • Use data manipulation and visualization tools to communicate real-time and historical trends.
  • Collaborate with platform, software, and data engineering teams to reconfigure pipelines for improved reliability.
  • Work with data in multiple formats including Excel, CSV, JSON, and XML.
  • Support incident management processes including issue documentation, resolution, and root-cause analysis for recurring data outages.
  • Develop and maintain software to automate monitoring of real-time data feeds, including alerts for timeliness, lineage, volume, and distribution issues.
  • Leverage historical pipeline data to identify improvements in ingest performance and reliability.
  • Assist with designing, developing, testing, and implementing web-based collaboration and reporting tools.
  • Demonstrate proficiency in Python or Bash scripting for analytics, automation, and data operations.
  • Utilize open-source analytics and visualization tools to monitor system performance.



  • Must have an active TS/SCI clearance
  • Bachelor's degree in Computer Science, Mathematics, Engineering, Physics, Information Systems, or related field.
  • 5-15 years of experience in data engineering or related experience
  • At least 2+ years of experience with real-time data streaming
  • Strong experience handling structured and unstructured data across various formats.
  • Experience with Linux OS


  • Experience with intelligence and C2 data sets (ELINT, COMINT, MASINT, GEOINT).
  • Knowledge of data mining, data modeling, statistics, and machine learning.
  • Familiarity with Kubernetes cluster deployment and management.


  • Pay range: $170,000 - $230,000 (Based on years of relevant experience)


  • Comprehensive benefits package including medical, dental, vision, 401k, 20 days of paid time off, 11 federal holidays, and sick leave.



#LI-NJ1

#LI-Onsite
group id: 10430981
job ad image
Find Zachary Piper Solutions, LLC on Social Media
Recruiters
user avatar
About Us
Zachary Piper Solutions is a National Security focused technology services and consulting firm with a top-secret facility clearance. We support mission-critical initiatives on behalf of the Intelligence Community, Department of Defense, Department of Homeland Security, Department of Justice, Department of State, and a variety of Civilian Agencies. ZPS is dedicated to help protect government networks against cyber threats and to maximize the wide-spectrum of intelligence and security-related technologies. Our dedicated support and proven experience drive results in support of our client’s mission objectives.
job ad2 image

Zachary Piper Solutions, LLC Jobs


Job Category
IT - Database
Clearance Level
Top Secret/SCI