Data Engineer

We are seeking a Data Engineer/Integrator. In this role, you will be collaborating closely with a team of developers to fulfill data integration requirements.

Location: Elkridge MD or Annapolis Junction, MD

Position Details:

• Write and maintain code using an Extract-Transform-Load (ETL) platform to ensure data is transformed into suitable formats as defined by IC ITE initiatives.
• Interface with external teams and systems, employing various protocols including HTML and SFTP to collect data efficiently.
• Enhance the ETL platform by adding features aimed at shortening timelines for future data integration efforts.
• Develop and maintain software, ensuring seamless integration into a fully functional system.
• Collaborate with external teams will be necessary to validate data ingest processes.
• Provide comprehensive documentation covering system architecture, development, and any enhancements made throughout the process.

Required Experience:

• 5+ years of professional experience with a Bachelor's degree or equivalent
• 3+ years of professional experience with a Master's degree or equivalent
• 10+ years of professional experience
• Additional experience will be considered in lieu of a degree
• Active TS/SCI with with CI Polygraph
• Specialization using the Databricks platform for building, deploying, and managing data and AI solutions
• Experience building ETL pipelines, managing data pipelines, and working with large datasets using tools like Spark, Python, and SQL
• Experience with technologies like Delta Lake, Delta Live Tables, and Databricks Workflows

Desired:

• Experience collaborating with data scientists.
• Familiarity with Advana.
• Strong Python programming skills
• Solid SQL knowledge for querying and data manipulation
• Cloud platform experience, such as AWS, Azure, etc