TTG-359 - Spark Data Engineer - $331,850 Total Compensation

TTG Solutions is seeking a skilled Data Engineer to build and support innovative data-processing solutions using modern technologies. We are looking for someone with a deep understanding of cloud services and data pipelines to process and analyze complex datasets. The Data Engineer will be responsible for building and managing robust data pipelines, processing and analyzing data across multiple formats, and developing validated, unit-tested solutions. You will utilize technologies such as Python, AWS, Apache Spark, relational databases, and Linux for day-to-day tasks. A strong focus on writing and validating unit tests, as well as SQL queries, is essential.Subject Matter Expert Normally requires at least sixteen (16) years of experience specific to the skill or occupation. For specific computer languages, systems or technologies, expertise with the subject matter or technology outweighs the number of years of experience.

Requirements: 16 yrs+

• Building and managing data pipelines
• Python
• AWS cloud services
• Apache Spark data processing
• RDBMS technologies (PostgreSQL, Oracle, MySQL)
• SQL queries
• Linux and shell scripting
• Analyzing data in formats including CSV, XML, JSON, Avro, and Parquet
• Writing and validating unit tests

• NiFi
• Apache Airflow or equivalent data-pipeline orchestration tools
• Java or Scala
• Administering EMR/Spark clusters
• Spark job performance tuning
• Developing cloud-based security solutions
• Configuration-management processes for reviewing and deploying code

This position requires an active TS/SCI clearance with Polygraph. Total compensation is the total combination of salary, benefits, retirement, bonuses, etc... and it is calculated using the following formula:

Total Compensation = Base Salary + Benefits Budget + Retirement + Bonus + Training Budget + Phone Stipend

Although each company has their own blend of salary and benefits, comparing total compensation is typcially the best way to compare the financial impact of each position. At TTG Solutions, we work hard to ensure our particular blend always meets or exceeds the market average.

Total Compensation = $331,850