Data Engineer II

Zachary Piper Solutions is seeking a Data Engineer II to join a leading federal health IT solutions provider located in Rockville, MD for a *Fully Remote* role . The Data Engineer II will Focus on building the systems, pipelines, and infrastructure that make data usable for analysts and data scientists. Seize your opportunity to make a personal impact as a Data Engineer while making meaningful contributions to challenging projects and grow a rewarding career at a company, who's people, are their differentiator.

Responsibilities of the Data Engineer II:

• Build and maintain PySpark data pipelines in the Databricks environment, Optimize Spark jobs performance and resource usage, identifying and addressing bottlenecks and inefficiencies in backend systems.
• Design, develop, and maintain high-quality backend software components and services, ensuring functionality, performance, and scalability.
• Research and build proof of concepts in the data space.
• Write clean, well-structured, and maintainable code, adhering to established coding standards and best practices.
• Perform thorough code reviews, providing constructive feedback to peers and identifying potential risks or areas for improvement.
• Debug and resolve defects, proactively identifying and addressing potential issues before they impact users.
• Create and maintain comprehensive technical documentation

Qualifications for the Data Engineer II:

• 5+ years of related experience plus a bachelors degree in computer science, computer engineering, or a related field.
• Strong technical skills including Python, Apache Spark, R, SAS, and solid understanding of software design patterns, data structures, algorithms, and distributed computing.
• Experience building data pipelines (ETL/ELT) and managing databases and SQL performance.
• Experience working with cloud platforms (AWS/AZURE/GCP).
• Technical Skills:
  • SQL (heavy)
  • Python/Scala
  • ETL Pipelines
  • Cloud Platforms (AWS/GCP/Azure)
  • Databricks/Spark
  • dbt/airflow
  • Data Modeling (star schemas, warehouses
• Desired Skills:
  • Experience working in Agile development environments
  • Databricks/Apache Spark certifications

Compensation for the Data Engineer II:

• Salary Range: $95,000 - $110,000 *depending on experience*
• Comprehensive Benefits: Cigna Medical, Dental, Vision, 401k Plan, PTO, Holidays, Sick Leave if required by law

This job opens for applications on 2/20. Applications for this job will be accepted for at least 30 days from the posting date.

#LI-MS1

#LI-REMOTE

Keywords: PySpark data pipelines, Databricks, Spark performance optimization, backend systems, backend software development, scalable services, data infrastructure, proof of concept development, clean code, coding standards, code reviews, debugging, technical documentation, Python, Apache Spark, R, SAS, distributed computing, software design patterns, data structures, algorithms, problem-solving, analytical skills, communication skills, Agile development, Databricks certification, Apache Spark certification