Job Requirements
Washington Dc Brm, DC
Top Secret Polygraph not specified
Mid Level Career (5+ yrs experience)
Salary not specified
Join Premium to unlock estimated salaries
Job Description
Key Responsibilities
Design, develop, test, and deploy scalable ETL/ELT pipelines for high-volume, multi-source data environments.
Build reusable data connectors and integration services to ingest data from APIs, databases, files, and other enterprise data sources.
Develop and integrate RESTful APIs and data services to support data ingestion, retrieval, transformation, and downstream applications.
Design data transformation and normalization processes for structured and unstructured data.
Implement data quality controls, including validation, reconciliation, deduplication, error handling, and exception management.
Develop automated processes for data lineage, metadata capture, logging, monitoring, and auditability.
Design and optimize data models, schemas, and storage solutions using relational and other appropriate data technologies.
Develop efficient SQL queries, stored procedures, transformations, and data-processing logic for large datasets.
Build and maintain automated CI/CD pipelines for data engineering components and applications.
Required Qualifications
7+ years of experience in data engineering, data integration, or a related software engineering discipline.
Demonstrated experience building and maintaining production-grade data pipelines in enterprise environments.
Strong experience with ETL/ELT architecture, data transformation, orchestration, validation, reconciliation, lineage, logging, and monitoring.
Advanced proficiency with SQL and relational databases.
Strong programming experience in Python
Experience developing and integrating REST APIs and other data integration interfaces.
Experience working with relational databases and data-storage technologies, such as PostgreSQL or Microsoft SQL Server.
Experience with Linux-based development or deployment environments.
Experience with Git-based source control and CI/CD practices.
Experience developing automated tests for data pipelines, APIs, or software components.
Strong communication, documentation, problem-solving, and cross-functional collaboration skills.
Design, develop, test, and deploy scalable ETL/ELT pipelines for high-volume, multi-source data environments.
Build reusable data connectors and integration services to ingest data from APIs, databases, files, and other enterprise data sources.
Develop and integrate RESTful APIs and data services to support data ingestion, retrieval, transformation, and downstream applications.
Design data transformation and normalization processes for structured and unstructured data.
Implement data quality controls, including validation, reconciliation, deduplication, error handling, and exception management.
Develop automated processes for data lineage, metadata capture, logging, monitoring, and auditability.
Design and optimize data models, schemas, and storage solutions using relational and other appropriate data technologies.
Develop efficient SQL queries, stored procedures, transformations, and data-processing logic for large datasets.
Build and maintain automated CI/CD pipelines for data engineering components and applications.
Required Qualifications
7+ years of experience in data engineering, data integration, or a related software engineering discipline.
Demonstrated experience building and maintaining production-grade data pipelines in enterprise environments.
Strong experience with ETL/ELT architecture, data transformation, orchestration, validation, reconciliation, lineage, logging, and monitoring.
Advanced proficiency with SQL and relational databases.
Strong programming experience in Python
Experience developing and integrating REST APIs and other data integration interfaces.
Experience working with relational databases and data-storage technologies, such as PostgreSQL or Microsoft SQL Server.
Experience with Linux-based development or deployment environments.
Experience with Git-based source control and CI/CD practices.
Experience developing automated tests for data pipelines, APIs, or software components.
Strong communication, documentation, problem-solving, and cross-functional collaboration skills.
group id: 10105424