Job Requirements
Remote
Secret Polygraph not specified
Senior Level Career (10+ yrs experience)
$120,000 - $140,000
Job Description
Zachary Piper Solutions is seeking a Data Cloud Engineer
to help build and maintain scalable, cloud-native data platforms that power critical analytics and data-driven decision-making. This role is fully remote and will require extensive experience in data engineering solutions. In this role, you will develop high-performance data pipelines, support multi-cloud data integration initiatives, and contribute to the design of secure, enterprise-scale data architectures. The ideal candidate has experience with Azure and/or AWS, strong proficiency in Python, PySpark, and Spark SQL, and a track record of delivering robust data engineering solutions in complex environments.
Responsibilities:
• Build, enhance, and support scalable cloud-based data integration and processing pipelines across AWS and Azure technologies
• Develop high-performance data transformation workflows using PySpark, Spark SQL, and modern big data technologies.
• Create data ingestion solutions for a variety of sources, including databases, APIs, JSON, and file based systems.
• Design and implement efficient full-load, incremental, and change-tracking data processing strategies.
• Support the architecture and operation of enterprise-scale data lakes, warehouses, and analytics platforms.
• Contribute to automated deployment processes and CI/CD best practices to streamline development and operations.
• Partner with cross-functional teams, including engineering, security, operations, and application development, to deliver modern data solutions.
• Ensure platforms and processes align with organizational security, compliance, and operational standards.
Qualifications:
• Active security clearance required.
• Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical field.
• 10+ years of experience designing, implementing, and supporting enterprise-scale data engineering and analytics solutions.
• Strong hands-on experience with Python, SQL, PySpark, and Spark SQL for large-scale data processing.
• Proven experience building and maintaining cloud-native data platforms using technologies such as Azure Synapse, Databricks, AWS Glue, or similar tools.
• Experience developing data ingestion, integration, and transformation solutions for both structured and unstructured data sources.
• Solid understanding of change data capture (CDC), incremental processing, and modern data loading methodologies.
• Knowledge of data governance, data quality, security controls, and access management best practices.
• Experience supporting production data environments, troubleshooting complex issues, and optimizing performance and reliability.
Preferred Qualifications
• Experience with Azure Data Factory, Redshift, Amazon S3, and Oracle databases.
• Experience supporting federal or DoD cloud modernization programs.
• Familiarity with RMF, STIG, and FedRAMP compliance frameworks.
• Experience working in Agile development environments.
Salary and Benefits:
Salary $120,000-$140,000 depending on experience
to help build and maintain scalable, cloud-native data platforms that power critical analytics and data-driven decision-making. This role is fully remote and will require extensive experience in data engineering solutions. In this role, you will develop high-performance data pipelines, support multi-cloud data integration initiatives, and contribute to the design of secure, enterprise-scale data architectures. The ideal candidate has experience with Azure and/or AWS, strong proficiency in Python, PySpark, and Spark SQL, and a track record of delivering robust data engineering solutions in complex environments.
Responsibilities:
• Build, enhance, and support scalable cloud-based data integration and processing pipelines across AWS and Azure technologies
• Develop high-performance data transformation workflows using PySpark, Spark SQL, and modern big data technologies.
• Create data ingestion solutions for a variety of sources, including databases, APIs, JSON, and file based systems.
• Design and implement efficient full-load, incremental, and change-tracking data processing strategies.
• Support the architecture and operation of enterprise-scale data lakes, warehouses, and analytics platforms.
• Contribute to automated deployment processes and CI/CD best practices to streamline development and operations.
• Partner with cross-functional teams, including engineering, security, operations, and application development, to deliver modern data solutions.
• Ensure platforms and processes align with organizational security, compliance, and operational standards.
Qualifications:
• Active security clearance required.
• Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical field.
• 10+ years of experience designing, implementing, and supporting enterprise-scale data engineering and analytics solutions.
• Strong hands-on experience with Python, SQL, PySpark, and Spark SQL for large-scale data processing.
• Proven experience building and maintaining cloud-native data platforms using technologies such as Azure Synapse, Databricks, AWS Glue, or similar tools.
• Experience developing data ingestion, integration, and transformation solutions for both structured and unstructured data sources.
• Solid understanding of change data capture (CDC), incremental processing, and modern data loading methodologies.
• Knowledge of data governance, data quality, security controls, and access management best practices.
• Experience supporting production data environments, troubleshooting complex issues, and optimizing performance and reliability.
Preferred Qualifications
• Experience with Azure Data Factory, Redshift, Amazon S3, and Oracle databases.
• Experience supporting federal or DoD cloud modernization programs.
• Familiarity with RMF, STIG, and FedRAMP compliance frameworks.
• Experience working in Agile development environments.
Salary and Benefits:
Salary $120,000-$140,000 depending on experience
group id: 10430981
