Today
Public Trust
Senior Level Career (10+ yrs experience)
Occasional travel
IT - Database
Remote/Hybrid•Washington, DC (On/Off-Site)
Cloud Data Engineer
Remote (with potential travel to the Washington D.C. metro area on special occasions)
Public Trust- Can start with it pending
Looking for an opportunity to make an impact?
Client is seeking a seeking a customer experience focused Cloud Data Engineer to work with a team of subject matter experts and developers to design and implement full lifecycle data pipeline services for Azure cloud based data lake, SQL, and NoSQL data stores. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. You will support continued maintenance of legacy SQL Server ETL operations and transition to modern cloud native solutions. Our ideal candidate is mission focused and delivery oriented, and applies critical thinking to create innovative functions and solve technical issues.
Who we are
Client is a Fortune 500® technology, engineering, and science solutions and services leader working to solve the world's toughest challenges in the defense, intelligence, civil, and health markets. Client Civil Group helps the government modernize operations with leading edge AI/ML driven data management and analytics solutions. We are a trusted partner to both government and highly-regulated commercial customers looking for transformative solutions in mission IT, security, software, engineering, and operations. We work with our customers including the FAA, DOE, DOJ, NASA, National Science Foundation, Transportation Security Administration, Custom and Border Protection, airports, and electric utilities to make the world safer, healthier, and more efficient.
In this role, you will:
• Maintain and operate legacy ETL processes utilizing Microsoft SSIS, Powershell, SQL procedures, SSAS, .NET code, and other technologies.
• Implement full lifecycle Azure cloud native data pipeline development and operation.
• Work closely with client personnel and team members to understand data requirements and develop appropriate data solutions.
• Support the design and implementation of data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, SQL and NoSQL data stores.
• Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines.
• Redevelop existing SSIS extract, transform, load scripts to Azure Data Factory and Synapse Pipelines.
• Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
• Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines.
• Monitor and troubleshoot data related issues to maintain high availability and performance.
• Implement governance, build, deployment and monitoring to automate platform operation.
• Actively support Agile DevOps process, including Program Increment planning.
• Actively engage in continuous learning to increase relevant skills.
• Maintain strict versioning and configuration control to ensure integrity of data.
For this position, you must possess:
• BS degree in Computer Science or related field and 8+ years or Masters with 6+ years of experience
• 4+ years of experience developing and maintaining ETL processes using Microsoft SSIS, SQL, SQL Agent, and scripting languages including Powershell.
• 4+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, PySpark
• Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes), scripting languages including PowerShell
• Experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synasolutions
Remote (with potential travel to the Washington D.C. metro area on special occasions)
Public Trust- Can start with it pending
Looking for an opportunity to make an impact?
Client is seeking a seeking a customer experience focused Cloud Data Engineer to work with a team of subject matter experts and developers to design and implement full lifecycle data pipeline services for Azure cloud based data lake, SQL, and NoSQL data stores. As a data engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. You will support continued maintenance of legacy SQL Server ETL operations and transition to modern cloud native solutions. Our ideal candidate is mission focused and delivery oriented, and applies critical thinking to create innovative functions and solve technical issues.
Who we are
Client is a Fortune 500® technology, engineering, and science solutions and services leader working to solve the world's toughest challenges in the defense, intelligence, civil, and health markets. Client Civil Group helps the government modernize operations with leading edge AI/ML driven data management and analytics solutions. We are a trusted partner to both government and highly-regulated commercial customers looking for transformative solutions in mission IT, security, software, engineering, and operations. We work with our customers including the FAA, DOE, DOJ, NASA, National Science Foundation, Transportation Security Administration, Custom and Border Protection, airports, and electric utilities to make the world safer, healthier, and more efficient.
In this role, you will:
• Maintain and operate legacy ETL processes utilizing Microsoft SSIS, Powershell, SQL procedures, SSAS, .NET code, and other technologies.
• Implement full lifecycle Azure cloud native data pipeline development and operation.
• Work closely with client personnel and team members to understand data requirements and develop appropriate data solutions.
• Support the design and implementation of data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, SQL and NoSQL data stores.
• Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines.
• Redevelop existing SSIS extract, transform, load scripts to Azure Data Factory and Synapse Pipelines.
• Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
• Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines.
• Monitor and troubleshoot data related issues to maintain high availability and performance.
• Implement governance, build, deployment and monitoring to automate platform operation.
• Actively support Agile DevOps process, including Program Increment planning.
• Actively engage in continuous learning to increase relevant skills.
• Maintain strict versioning and configuration control to ensure integrity of data.
For this position, you must possess:
• BS degree in Computer Science or related field and 8+ years or Masters with 6+ years of experience
• 4+ years of experience developing and maintaining ETL processes using Microsoft SSIS, SQL, SQL Agent, and scripting languages including Powershell.
• 4+ years of experience with more than one of the follow scripting languages: SQL, T-SQL, Python, PySpark
• Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes), scripting languages including PowerShell
• Experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synasolutions
group id: 10107773
