Today
Top Secret
Mid Level Career (5+ yrs experience)
$150,000 and above
Occasional travel
IT - Software
Responsibilities
• Design, build, and maintain scalable data pipelines and ETL processes using Spark (PySpark) and Python.
• Architect and optimize data lakehouse and data warehouse solutions on AWS.
• Develop APIs and integrations with security intelligence platforms.
• Implement data governance, quality, and observability best practices.
• Optimize performance of high-volume data processing systems.
• Work closely with security teams to ensure compliance with cybersecurity regulations.
Requirements
• 5+ years of experience as a Senior Data Engineer, Full Stack Data Engineer, or similar role.
• Strong expertise in Python, PySpark/Spark, and SQL.
• Hands-on experience with AWS services like S3, Glue, Athena, EMR, Redshift, Lambda.
• Experience with real-time streaming (Kafka, Kinesis, etc.).
• Knowledge of data modeling, ETL frameworks, and performance tuning.
• Familiarity with CI/CD, containerization (Docker), and infrastructure-as-code (Terraform, CloudFormation).
• Cybersecurity domain knowledge is a big plus.
• Design, build, and maintain scalable data pipelines and ETL processes using Spark (PySpark) and Python.
• Architect and optimize data lakehouse and data warehouse solutions on AWS.
• Develop APIs and integrations with security intelligence platforms.
• Implement data governance, quality, and observability best practices.
• Optimize performance of high-volume data processing systems.
• Work closely with security teams to ensure compliance with cybersecurity regulations.
Requirements
• 5+ years of experience as a Senior Data Engineer, Full Stack Data Engineer, or similar role.
• Strong expertise in Python, PySpark/Spark, and SQL.
• Hands-on experience with AWS services like S3, Glue, Athena, EMR, Redshift, Lambda.
• Experience with real-time streaming (Kafka, Kinesis, etc.).
• Knowledge of data modeling, ETL frameworks, and performance tuning.
• Familiarity with CI/CD, containerization (Docker), and infrastructure-as-code (Terraform, CloudFormation).
• Cybersecurity domain knowledge is a big plus.
group id: 91128939
