Senior Data Engineer - (Software Engineer Principal I)

Software Engineer - Principal I / Principal Data Engineer

PRISM is seeking a highly skilled and experienced Principal Data Engineer to join our team. This role will support PRISM's clients on critical, mission-focused initiatives involving enterprise digital transformation and the introduction of next-generation cyber capabilities. The engineer will primarily lead the design, development, and migration of large-scale data applications, services, and platforms to modern data architectures.

THIS IS A HYBRID ROLE
Responsibilities

• Data Pipeline Developer: Design, develop, and implement end-to-end data ingestion and processing pipelines using various Cloud and Platform Technologies.
• Medallion Model Implementation: Transform incoming bronze data (RAW) into silver (clean/validated) and finally create projected datasets in the gold tier to implement a modern Medallion Data Architecture.
• Orchestration and Monitoring: Schedule, orchestrate, and continuously monitor automated and semi-automated data pipelines for performance and reliability.
• Data Asset Integration: Perform mapping and integration of diverse data assets in support of the execution of PRISM's client missions.
• Process Improvement: Develop and maintain the data engineering team's process improvement plan and ensure Standard Operating Procedures (SOPs) are captured and communicated across the team.
• Automation: Develop code using various programming and scripting languages to automate data ingestion, pipeline orchestration, and improve overall data management processes.
• Observability: Implement transparency, leveraging monitoring technologies (e.g., AWS CloudWatch, Splunk) to measure and gather performance information on automated data pipelines.
• Quality Assurance: Ensure the technical correctness, timeliness, and quality of delivery for the team's output.
• Communication: Demonstrate excellent oral and written communication skills when engaging with all levels of management and PRISM's clients.

Required Qualifications

• Citizenship & Clearance: Must be a U.S. Citizen. Active Secret (S) clearance is required; must be able to obtain a Top Secret/SCI (TS/SCI) clearance.
• Suitability: Must be able to obtain client/agency suitability (e.g., DHS Suitability).
• Experience:
  
  • 8+ years of professional software engineering experience.
  • Minimum of 4 years of experience performing data engineering work in a cloud environment.
• Technical Skills:
  
  • Experience with relational, noSQL, and/or file-based storage systems (e.g., Databricks, Elasticsearch, Postgres, etc.).
  • Experience with DevOps tools such as Jenkins, Docker, Ansible, Puppet, Chef, Splunk, etc.
  • Working knowledge of Databricks, Cloud Relational Database Services, and Elasticsearch.

Desired Skills & Certifications

Desired Skills:

• Experience with Databricks workflows, Databricks Unity Catalog, Databricks Autoloader, and Databricks Delta Live Tables and Apache Spark.
• Basic working knowledge with Apache NiFi (Niagara Files).
• Experience with collaboration tools including MS Teams, MS Outlook, MS SharePoint, and Confluence.
• Amazon Web Services (AWS) Professional certification or equivalent.

Desired Certifications:

• DoD 8570.1-M Compliance at IAT Level I (e.g., Certified Information Systems Security Professional (CISSP) certification highly desired).

Required Education:

• Bachelor's degree in Software Engineering, Computer Science, or a related discipline is required. [Ten (10) years of relevant experience (for a total of eighteen (18) or more years) may be substituted for a degree.]