Job Requirements
Remote
Secret Polygraph Unspecified
Career Level not specified
$120,000 - $140,000
Job Description
Zachary Piper Solutions is seeking a Data Cloud Engineer
to help build and maintain scalable, cloud-native data platforms that power critical analytics and data-driven decision-making. This role is fully remote and requires an active secret clearance. In this role, you will develop high-performance data pipelines, support multi-cloud data integration initiatives, and contribute to the design of secure, enterprise-scale data architectures. The ideal candidate has experience with Azure and/or AWS, strong proficiency in Python, PySpark, and Spark SQL, and a track record of delivering robust data engineering solutions in complex environments.
Responsibilities:
Qualifications:
Preferred Qualifications
Salary and Benefits:
Keywords
Data Engineering, Cloud Data Engineer, Data Pipeline Development, ETL, ELT, Cloud Architecture, Azure, AWS, Azure Synapse Analytics, Databricks, AWS Glue, Data Lake, Data Warehouse, Big Data, PySpark, Spark SQL, Apache Spark, Python, SQL, Data Integration, Data Transformation, Data Ingestion, Structured Data, Unstructured Data, Change Data Capture, CDC, Incremental Loads, Data Modeling, Data Analytics, Data Governance, Data Quality, Data Security, RBAC, Cloud Migration, Multi-Cloud, Analytics Platform, Enterprise Data Solutions, Production Support, Performance Optimization, Troubleshooting, CI/CD, DevOps, Automation, Infrastructure as Code, Agile, Scalable Systems, Distributed Computing, Enterprise Architecture, Secure Data Environments, Cloud Modernization, Business Intelligence, Data Operations, Advanced Analytics, Machine Learning Enablement, Cloud-Native Solutions, ETL, ELT, Data Lake, Data Warehouse, CDC, Data Integration, Data Transformation, Cloud Architecture, CI, CD, Data Governance, Big Data, Multi-Cloud, Enterprise Data Solutions
#LI-Remote #LI-JF2
to help build and maintain scalable, cloud-native data platforms that power critical analytics and data-driven decision-making. This role is fully remote and requires an active secret clearance. In this role, you will develop high-performance data pipelines, support multi-cloud data integration initiatives, and contribute to the design of secure, enterprise-scale data architectures. The ideal candidate has experience with Azure and/or AWS, strong proficiency in Python, PySpark, and Spark SQL, and a track record of delivering robust data engineering solutions in complex environments.
Responsibilities:
- Build, enhance, and support scalable cloud-based data integration and processing pipelines across AWS and Azure technologies
- Develop high-performance data transformation workflows using PySpark, Spark SQL, and modern big data technologies.
- Create data ingestion solutions for a variety of sources, including databases, APIs, JSON, and file based systems.
- Design and implement efficient full-load, incremental, and change-tracking data processing strategies.
- Support the architecture and operation of enterprise-scale data lakes, warehouses, and analytics platforms.
- Contribute to automated deployment processes and CI/CD best practices to streamline development and operations.
- Partner with cross-functional teams, including engineering, security, operations, and application development, to deliver modern data solutions.
- Ensure platforms and processes align with organizational security, compliance, and operational standards.
Qualifications:
- Active secret clearance required.
- Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical field.
- 10+ years of experience designing, implementing, and supporting enterprise-scale data engineering and analytics solutions.
- Strong hands-on experience with Python, SQL, PySpark, and Spark SQL for large-scale data processing.
- Proven experience building and maintaining cloud-native data platforms using technologies such as Azure Synapse, Databricks, AWS Glue, or similar tools.
- Experience developing data ingestion, integration, and transformation solutions for both structured and unstructured data sources.
- Solid understanding of change data capture (CDC), incremental processing, and modern data loading methodologies.
- Knowledge of data governance, data quality, security controls, and access management best practices.
- Experience supporting production data environments, troubleshooting complex issues, and optimizing performance and reliability.
Preferred Qualifications
- Experience with Azure Data Factory, Redshift, Amazon S3, and Oracle databases.
- Experience supporting federal or DoD cloud modernization programs.
- Familiarity with RMF, STIG, and FedRAMP compliance frameworks.
- Experience working in Agile development environments.
Salary and Benefits:
- Salary $120,000-$140,000 depending on experience
Keywords
Data Engineering, Cloud Data Engineer, Data Pipeline Development, ETL, ELT, Cloud Architecture, Azure, AWS, Azure Synapse Analytics, Databricks, AWS Glue, Data Lake, Data Warehouse, Big Data, PySpark, Spark SQL, Apache Spark, Python, SQL, Data Integration, Data Transformation, Data Ingestion, Structured Data, Unstructured Data, Change Data Capture, CDC, Incremental Loads, Data Modeling, Data Analytics, Data Governance, Data Quality, Data Security, RBAC, Cloud Migration, Multi-Cloud, Analytics Platform, Enterprise Data Solutions, Production Support, Performance Optimization, Troubleshooting, CI/CD, DevOps, Automation, Infrastructure as Code, Agile, Scalable Systems, Distributed Computing, Enterprise Architecture, Secure Data Environments, Cloud Modernization, Business Intelligence, Data Operations, Advanced Analytics, Machine Learning Enablement, Cloud-Native Solutions, ETL, ELT, Data Lake, Data Warehouse, CDC, Data Integration, Data Transformation, Cloud Architecture, CI, CD, Data Governance, Big Data, Multi-Cloud, Enterprise Data Solutions
#LI-Remote #LI-JF2
group id: 10430981
