Data Engineer

The Data Engineer provides system and data engineering support to data analysis operations throughout the reporting and analysis lifecycle. The Engineer will build and maintain systems to extract, clean and transform data, using advanced automation and scripting tools.Duties include:

• Work with business owners and data analysts to develop technical solutions for reporting products
• Build, test, and maintain database pipeline architectures
• Use ETL tools to extract and load data for various reports
• Create data validation tools
• Automate data analysis and collection products
• Create documentation and presentations
• Create and maintain optimal data pipeline architecture
• Develop and conduct tests to ensure data solutions meet documented user requirements.
• Analyze IT environments to identify and assess critical capabilities and recommend solutions to problems of moderate scope and complexity.
• Collaborate with data science team to transform data and integrate algorithms and models into automated processes.
• Works with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• May coach and review the work of less-experienced professionals.
• Provide ongoing training for data analysts and staff on data tools and products
• Assist data analysts with data preparation to create sources for data products
• Help create governance processes and procedures
• Support data collection, analysis and visualization projects as needed, including data modeling, database creation, and technical support
• Recommend and implement technical and automated solutions for manual processes

• Provide recommendations to streamline and improve current business processes
• Respond and fulfill data requests as required
• Participate in special projects as needed

Education

• Requires BS/BA degree with 8 years of experience or 6 years with a Master's Degree.

Qualifications

• Expert coding knowledge including SQL and Python (required), and R (preferred).
• Experience working with Palantir Foundry, and tools such as Contour, Code Repository, Code Workbook, Pipeline Builder, Data Lineage.
• Experience with GitHub, MongoDB, MySQL, PostgreSQL, Salesforce and Tableau.
• Some knowledge of Databricks a plus.
• Understanding of relational and non-relational databases.
• Experience working with large datasets, performing tasks such as data cleaning and processing (ETL).
• Experience with automation/scripting.
• Knowledge of cloud storage and cloud computing/analytics.
• Understanding of data security.
• Ability to build prototypes of new data products and to automate workflows.
• Willingness to learn and explore new data tools.
• Ability to conduct feasibility studies to determine suitability to program requirements.
• Excellent analytical and writing skills.
• Strong verbal communication skills.
• Highly motivated and collaborative.

Work Requirements