Today
Top Secret/SCI
Senior Level Career (10+ yrs experience)
Full Scope Polygraph
IT - Software
Herndon, VA (On-Site/Office)•Chantilly, VA (On-Site/Office)
FJM Innovative Technologies, LLC seeks a Senior Data Engineer to lead efforts in developing and maintaining tools and services for data movement, transformation, and exploration. This position involves data ingestion, ETL pipeline development, and close collaboration with data scientists and mission stakeholders to analyze and process structured and unstructured datasets. The candidate must be experienced in documenting data workflows, optimizing data flows for mission objectives, and enhancing existing code bases in accordance with best practices
REQUIRED
Must have ACTIVE TS/SCI clearance with a Full Scope Polygraph.
We must strictly adhere to this requirement.
Key Responsibilities
• Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers
• Ensure the pedigree and provenance of the data is maintained such that the access to data is protected
• Clean and preprocess data to enable access for advanced analytics
• Collaborate with enterprise working groups to advance the state of data standards
• Collaborate with the engineering team, data stewards, and mission partners to aid in getting actionable value out of the data holdings
• Collaborate with software engineers to update, configure, and maintain data services based on the requirements
• Ensure data quality by working with the testing and data quality team to enhance standardization of data conditioning pipelines
• Experience adapting to various types and formats of data, and working with development teams to integrate new data processing platforms
Required Skills:
10+ years' experience with:
• Data lifecycle engineering
• Development and maintenance of extract, transform and load (ETL) tools and services
• Cloud and on-prem data storage and processing solutions
• Python, SQL, Spark and other data engineering programming
• COTS and open source data engineering tools such as ElasticSearch and NiFi
• Processing data within the Agile Lifecycle
The role specifically requires candidates with an active TS/SCI security clearance with Full Scope Polygraph. We must adhere strictly to this requirement.
REQUIRED
Must have ACTIVE TS/SCI clearance with a Full Scope Polygraph.
We must strictly adhere to this requirement.
Key Responsibilities
• Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers
• Ensure the pedigree and provenance of the data is maintained such that the access to data is protected
• Clean and preprocess data to enable access for advanced analytics
• Collaborate with enterprise working groups to advance the state of data standards
• Collaborate with the engineering team, data stewards, and mission partners to aid in getting actionable value out of the data holdings
• Collaborate with software engineers to update, configure, and maintain data services based on the requirements
• Ensure data quality by working with the testing and data quality team to enhance standardization of data conditioning pipelines
• Experience adapting to various types and formats of data, and working with development teams to integrate new data processing platforms
Required Skills:
10+ years' experience with:
• Data lifecycle engineering
• Development and maintenance of extract, transform and load (ETL) tools and services
• Cloud and on-prem data storage and processing solutions
• Python, SQL, Spark and other data engineering programming
• COTS and open source data engineering tools such as ElasticSearch and NiFi
• Processing data within the Agile Lifecycle
The role specifically requires candidates with an active TS/SCI security clearance with Full Scope Polygraph. We must adhere strictly to this requirement.
group id: 91156911
