Today
Public Trust
Unspecified
Unspecified
IT - Database
Washington, DC (On-Site/Office)
Cloud Data Engineer
Remote (with potential travel to the Washington D.C. metro area on special occasions)
Public Trust- Can start with it pending
Looking for an opportunity to make an impact?
Client is seeking a seeking a customer experience focused Cloud Data Engineer to work with a team of subject matter experts and developers to design and implement full lifecycle data pipeline services for Azure cloud based data lake, SQL, and NoSQL data stores. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. You will support continued maintenance of legacy SQL Server ETL operations and transition to modern cloud native solutions. Our ideal candidate is mission focused and delivery oriented, and applies critical thinking to create innovative functions and solve technical issues.
Who we are
Client is a Fortune 500 technology, engineering, and science solutions and services leader working to solve the world's toughest challenges in the defense, intelligence, civil, and health markets. Client Civil Group helps the government modernize operations with leading edge AI/ML driven data management and analytics solutions. We are a trusted partner to both government and highly-regulated commercial customers looking for transformative solutions in mission IT, security, software, engineering, and operations. We work with our customers including the FAA, DOE, DOJ, NASA, National Science Foundation, Transportation Security Administration, Custom and Border Protection, airports, and electric utilities to make the world safer, healthier, and more efficient.
In this role, you will:
Maintain and operate legacy ETL processes utilizing Microsoft SSIS, Powershell, SQL procedures, SSAS, .NET code, and other technologies.
Implement full lifecycle Azure cloud native data pipeline development and operation.
Work closely with client personnel and team members to understand data requirements and develop appropriate data solutions.
Support the design and implementation of data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, SQL and NoSQL data stores.
Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines.
Redevelop existing SSIS extract, transform, load scripts to Azure Data Factory and Synapse Pipelines.
Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines.
Monitor and troubleshoot data related issues to maintain high availability and performance.
Implement governance, build, deployment and monitoring to automate platform operation.
Actively support Agile DevOps process, including Program Increment planning.
Actively engage in continuous learning to increase relevant skills.
Maintain strict versioning and configuration control to ensure integrity of data.
For this position, you must possess:
BS degree in Computer Science or related field and 8 years or Masters with 6 years of experience
4 years of experience developing and maintaining ETL processes using Microsoft SSIS, SQL, SQL Agent, and scripting languages including Powershell.
4 years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, PySpark
Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes), scripting languages including PowerShell
Experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synasolutions
About Equiliem
Equiliem believes in empowering success. It's our job to cultivate relationships that connect people and employers in a way that is inclusive, intelligent, and allows both to thrive.
Across the U.S., leading companies in healthcare, government, engineering, manufacturing, professional services, and energy rely on us for their workforce solutions. Our recruiting and HR services include contract and direct hire staffing, Payrolling/EOR, Independent Contractor Compliance, and Managed Services.
For almost 30 years, we've helped shape our industry. Today, we continue to research, ask questions, and continuously enhance the candidate journey and client experience.
Benefits
We offer a comprehensive benefits package to our employees, which includes:
EEO Employer
Equiliem is an equal opportunity employer. We do not discriminate or allow discrimination based on race, color, religion, creed, sex, age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Equiliem will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or (732) 238-6050 .
Remote (with potential travel to the Washington D.C. metro area on special occasions)
Public Trust- Can start with it pending
Looking for an opportunity to make an impact?
Client is seeking a seeking a customer experience focused Cloud Data Engineer to work with a team of subject matter experts and developers to design and implement full lifecycle data pipeline services for Azure cloud based data lake, SQL, and NoSQL data stores. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. You will support continued maintenance of legacy SQL Server ETL operations and transition to modern cloud native solutions. Our ideal candidate is mission focused and delivery oriented, and applies critical thinking to create innovative functions and solve technical issues.
Who we are
Client is a Fortune 500 technology, engineering, and science solutions and services leader working to solve the world's toughest challenges in the defense, intelligence, civil, and health markets. Client Civil Group helps the government modernize operations with leading edge AI/ML driven data management and analytics solutions. We are a trusted partner to both government and highly-regulated commercial customers looking for transformative solutions in mission IT, security, software, engineering, and operations. We work with our customers including the FAA, DOE, DOJ, NASA, National Science Foundation, Transportation Security Administration, Custom and Border Protection, airports, and electric utilities to make the world safer, healthier, and more efficient.
In this role, you will:
Maintain and operate legacy ETL processes utilizing Microsoft SSIS, Powershell, SQL procedures, SSAS, .NET code, and other technologies.
Implement full lifecycle Azure cloud native data pipeline development and operation.
Work closely with client personnel and team members to understand data requirements and develop appropriate data solutions.
Support the design and implementation of data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, SQL and NoSQL data stores.
Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines.
Redevelop existing SSIS extract, transform, load scripts to Azure Data Factory and Synapse Pipelines.
Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines.
Monitor and troubleshoot data related issues to maintain high availability and performance.
Implement governance, build, deployment and monitoring to automate platform operation.
Actively support Agile DevOps process, including Program Increment planning.
Actively engage in continuous learning to increase relevant skills.
Maintain strict versioning and configuration control to ensure integrity of data.
For this position, you must possess:
BS degree in Computer Science or related field and 8 years or Masters with 6 years of experience
4 years of experience developing and maintaining ETL processes using Microsoft SSIS, SQL, SQL Agent, and scripting languages including Powershell.
4 years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, PySpark
Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes), scripting languages including PowerShell
Experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synasolutions
About Equiliem
Equiliem believes in empowering success. It's our job to cultivate relationships that connect people and employers in a way that is inclusive, intelligent, and allows both to thrive.
Across the U.S., leading companies in healthcare, government, engineering, manufacturing, professional services, and energy rely on us for their workforce solutions. Our recruiting and HR services include contract and direct hire staffing, Payrolling/EOR, Independent Contractor Compliance, and Managed Services.
For almost 30 years, we've helped shape our industry. Today, we continue to research, ask questions, and continuously enhance the candidate journey and client experience.
Benefits
We offer a comprehensive benefits package to our employees, which includes:
- Medical Insurance
- Vision & Dental Insurance
- Life Insurance
- 401K
- Commuter Benefits
- Employee Discounts & Rewards
- Payroll Payment Options
EEO Employer
Equiliem is an equal opportunity employer. We do not discriminate or allow discrimination based on race, color, religion, creed, sex, age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Equiliem will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at [email protected] or (732) 238-6050 .
group id: 10107773
