Data Engineer

Core4ce has an opportunity with a mission critical IC Sponsor for a Data Engineer position. This Sponsor organization plays a significant role in the highly optimized mission-ready data conditioning and delivery systems in support of mission analytics. A Full-Scope polygraph is required, no exceptions.

Responsibilities

Candidate will design and develop complex new software products or make significant enhancements to existing software. The ideal candidate is a hands-on developer with significant experience in building modular, reusable services and features. Candidate must have expertise in a modern service-oriented architecture and must be familiar with working on an Agile team environment with little to no supervision. Successful candidates embody a passion for continuous improvement and innovation.

Requirements

• Active TS/SCI with Full Scope Poly.
• Experienced with Apache NiFi and IC equivalent.
• General understanding and ability to work with zookeeper.
• Expert level experience developing data ETL processes.
• Able to deploy and maintain NiFi clusters.
• 5+ years experience with a variety of scripting languages including bash, Python, and Groovy.
• Experienced using EC2 instances in AWS.
• 2-5 years of experience working with Ansible, developing playbooks and roles for software driven deployment of NiFi clusters and zookeeper clusters.
• Understanding of Git and Gitlab.
• 2-5 years' experience using REST APIs to call RESTful services.
• Familiar with Linux - particularly the new Rocky variant.
• Working level familiarity with Elasticsearch and Kibana. Able to develop dashboard visualizations in Kibana from data in Elasticsearch.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy), national origin, disability, veteran status, age, genetic information, or other legally protected status.