Job Requirements
Washington, DC
Secret Polygraph not specified
Career Level not specified
$160,000 - $190,000
Job Description
Data Pipeline Engineer (Palantir / Python / PySpark)
Location: Washington, DC (Onsite)
Clearance: TS/SCI
Apply Now!
or
Contact Recruiter: Brenton Anderson
Email: banderson3@kforce.com
LinkedIn: https://www.linkedin.com/in/myitrecruiterbrenton/
We are seeking a Data Pipeline Engineer to design, build, and maintain scalable data pipelines in support of mission-critical environments. This role focuses on working within the Palantir ecosystem to integrate, transform, and operationalize complex datasets while ensuring reliability, performance, and data integrity.
This is a highly technical, hands-on position ideal for engineers with experience in distributed data processing, backend systems, and troubleshooting complex data workflows.
Key Responsibilities
Design, develop, and maintain scalable data pipelines supporting structured and unstructured data
Build and optimize ETL/ELT workflows within Palantir Foundry or similar data platforms
Develop data processing solutions using Python, PySpark, Spark, and/or Polars
Debug and troubleshoot pipeline failures, data inconsistencies, and performance bottlenecks
Build and integrate APIs and backend services to support data ingestion and transformation
Analyze and trace network traffic and data flows to support system-level troubleshooting
Reverse engineer backend processes and data services to resolve complex technical issues
Implement monitoring, logging, and data pipeline reliability improvements
Collaborate with cross-functional teams to enhance data workflows and platform usability
Ensure data quality, governance, and consistency across data systems
Required Qualifications
Active TS/SCI clearance
Strong proficiency in Python development
Hands-on experience with PySpark, Apache Spark, and/or Polars for distributed data processing
Experience building and maintaining data pipelines and ETL/ELT workflows [Submittal:...- Palantir | Outlook]
Experience working with Palantir Foundry or similar data platforms [Submittal:...- Palantir | Outlook]
Experience developing and debugging APIs, endpoints, and backend services
Ability to trace and analyze network traffic and system interactions
Experience troubleshooting complex, production-level data issues
Strong understanding of data structures, data modeling, and pipeline architecture
Experience with Git/version control and CI/CD practices
Preferred Qualifications
Experience working in high-reliability or production-critical environments
Knowledge of distributed systems and large-scale data processing frameworks
Experience with streaming pipelines (Kafka, Spark Streaming, etc.)
Familiarity with cloud platforms (AWS or similar)
Experience with data visualization or analytics tools
Background in software engineering or backend systems development
Education
Bachelor’s degree in Computer Science, Engineering, or related field
Equivalent hands-on experience may be considered
Why This Role
Work directly with cutting-edge data platforms and large-scale pipelines
Solve complex, real-world data engineering challenges
Highly technical environment with strong engineering ownership
Stable, long-term onsite work in the DC market
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking “Apply Today” you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Location: Washington, DC (Onsite)
Clearance: TS/SCI
Apply Now!
or
Contact Recruiter: Brenton Anderson
Email: banderson3@kforce.com
LinkedIn: https://www.linkedin.com/in/myitrecruiterbrenton/
We are seeking a Data Pipeline Engineer to design, build, and maintain scalable data pipelines in support of mission-critical environments. This role focuses on working within the Palantir ecosystem to integrate, transform, and operationalize complex datasets while ensuring reliability, performance, and data integrity.
This is a highly technical, hands-on position ideal for engineers with experience in distributed data processing, backend systems, and troubleshooting complex data workflows.
Key Responsibilities
Design, develop, and maintain scalable data pipelines supporting structured and unstructured data
Build and optimize ETL/ELT workflows within Palantir Foundry or similar data platforms
Develop data processing solutions using Python, PySpark, Spark, and/or Polars
Debug and troubleshoot pipeline failures, data inconsistencies, and performance bottlenecks
Build and integrate APIs and backend services to support data ingestion and transformation
Analyze and trace network traffic and data flows to support system-level troubleshooting
Reverse engineer backend processes and data services to resolve complex technical issues
Implement monitoring, logging, and data pipeline reliability improvements
Collaborate with cross-functional teams to enhance data workflows and platform usability
Ensure data quality, governance, and consistency across data systems
Required Qualifications
Active TS/SCI clearance
Strong proficiency in Python development
Hands-on experience with PySpark, Apache Spark, and/or Polars for distributed data processing
Experience building and maintaining data pipelines and ETL/ELT workflows [Submittal:...- Palantir | Outlook]
Experience working with Palantir Foundry or similar data platforms [Submittal:...- Palantir | Outlook]
Experience developing and debugging APIs, endpoints, and backend services
Ability to trace and analyze network traffic and system interactions
Experience troubleshooting complex, production-level data issues
Strong understanding of data structures, data modeling, and pipeline architecture
Experience with Git/version control and CI/CD practices
Preferred Qualifications
Experience working in high-reliability or production-critical environments
Knowledge of distributed systems and large-scale data processing frameworks
Experience with streaming pipelines (Kafka, Spark Streaming, etc.)
Familiarity with cloud platforms (AWS or similar)
Experience with data visualization or analytics tools
Background in software engineering or backend systems development
Education
Bachelor’s degree in Computer Science, Engineering, or related field
Equivalent hands-on experience may be considered
Why This Role
Work directly with cutting-edge data platforms and large-scale pipelines
Solve complex, real-world data engineering challenges
Highly technical environment with strong engineering ownership
Stable, long-term onsite work in the DC market
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking “Apply Today” you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
group id: kforcecx
We offer roles across all three clearance levels: Confidential, Secret and Top Secret. With a Top Secret Facilities clearance, a proven subcontractor track record and a deep understanding of agencies across Defense, Intelligence, Homeland, Justice and Federal Civilian Sectors, Kforce brings more than 20 years of experience to supporting critical missions at federal, state and local levels.
