Today
Secret
$80000.00 - $130000.00 / Year
Unspecified
Saint Louis, MO (On-Site/Office)
Description
Databricks Engineer
Position Type: Direct Hire (Full-Time, Salary)
Location: Scott Air Force Base (O'Fallon, IL 62269) - In-Office
Compensation: $80,000 - $130,000/year (DOE)
Clearance Requirement: U.S. Citizenship required. Must be able to obtain and maintain an Interim Secret Clearance.
Hiring Timeline: Immediate
About the Role
Our company partner (to be disclosed during the interview process) is seeking a Databricks Engineer to support mission-critical initiatives at Scott Air Force Base. This is a high-impact opportunity to build and optimize large-scale data pipelines, leverage cutting-edge big data technologies, and contribute to solutions that directly support federal agency operations.
The Databricks Engineer will design, develop, and maintain robust data engineering solutions, ensuring data is accurate, scalable, and reliable. The ideal candidate will have hands-on experience with Databricks, Spark, and modern ETL processes, as well as a strong understanding of data governance and compliance requirements.
Key Responsibilities
Databricks Engineer
Position Type: Direct Hire (Full-Time, Salary)
Location: Scott Air Force Base (O'Fallon, IL 62269) - In-Office
Compensation: $80,000 - $130,000/year (DOE)
Clearance Requirement: U.S. Citizenship required. Must be able to obtain and maintain an Interim Secret Clearance.
Hiring Timeline: Immediate
About the Role
Our company partner (to be disclosed during the interview process) is seeking a Databricks Engineer to support mission-critical initiatives at Scott Air Force Base. This is a high-impact opportunity to build and optimize large-scale data pipelines, leverage cutting-edge big data technologies, and contribute to solutions that directly support federal agency operations.
The Databricks Engineer will design, develop, and maintain robust data engineering solutions, ensuring data is accurate, scalable, and reliable. The ideal candidate will have hands-on experience with Databricks, Spark, and modern ETL processes, as well as a strong understanding of data governance and compliance requirements.
Key Responsibilities
- Design, develop, and implement end-to-end data pipelines, ensuring scalability, reliability, and high-performance data processing.
- Build and optimize pipelines from scratch using Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Perform data cleansing, integration, and quality assurance to maintain the accuracy and integrity of large datasets.
- Leverage big data technologies to efficiently process and analyze large-scale datasets in a federal environment.
- Implement and enforce data governance policies and procedures, ensuring compliance with regulatory standards and best practices.
- Collaborate with cross-functional teams to translate data requirements into effective models, architectures, and workflows.
- Partner with analysts, data scientists, and stakeholders to deliver timely, actionable insights.
- Maintain documentation for data workflows, pipelines, and engineering processes.
- Stay current with emerging trends in data engineering and recommend tools or practices to drive continuous improvement.
- Active Secret Clearance or the ability to obtain one.
- Minimum 3 years of experience as a Data Engineer, with proven ability to build data pipelines from the ground up.
- Hands-on expertise in ETL processes and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
- Strong problem-solving skills, with a track record of resolving complex data challenges.
- Experience with large datasets and big data technologies for efficient processing and analysis.
- Knowledge of data modeling, visualization, database design, and governance practices.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
- Detail-oriented with a commitment to delivering high-quality, reliable results.
group id: RTX1a8ec6
