Databricks Administrator

Overview

JOB TITLE:

Databricks Administrator

CAYUSE COMPANY:

Cayuse Civil Services, LLC

DEPT/CONTRACT

TX DIR

LOCATION

Hybrid in Austin, TX

SALARY:

$108,160.00-$153,920.00

EMPLOYEE TYPE:

Full-Time Salary Exempt

TRAVEL

No

RELOCATION

No

Employment in this role is conditional upon successful execution of the contract by the client.

The Work

The Databricks Administrator is responsible for the design, implementation, configuration, administration, and ongoing support of Databricks environments, with a focus on optimizing performance, security, reliability, and cost effectiveness. The administrator will work closely with data engineers, data scientists, cybersecurity personnel, and other IT stakeholders to ensure the integrity, availability, and confidentiality of enterprise data and analytics workloads.

This position aligns with Cayuse's core values of Innovation, Excellence, Collaboration, Adaptability, and Integrity by fostering technical solutions that meet customer needs, promoting teamwork, and prioritizing quality in deliverables.

Responsibilities

• Administer, configure, and support the Databricks platform to enable scalable data engineering, analytics, and AI/ML workloads for the enterprise.
• Ensure platform reliability, security, cost optimization, and compliance with relevant standards and organizational policies.
• Provide technical support, guidance, and troubleshooting assistance to data engineers, analysts, and data scientists across various business units.
• Manage workspace configuration, cluster policies, and user access controls to maintain secure and efficient operation of the Databricks environment.
• Integrate Databricks with cloud services and related enterprise platforms to enable seamless data and analytic workflows.
• Proactively monitor platform performance, usage, and system health, implementing corrective actions and improvements as necessary.
• Collaborate with stakeholders to understand business objectives, operational challenges, and user requirements related to data analytics and platform utilization.
• Identify and evaluate alternative solutions, conducting studies and cost/benefit analyses to determine the best approach for organizational needs.
• Analyze user requirements, procedures, and problems to automate processing or improve existing computer systems.
• Engage with personnel from multiple organizational units to assess current operational procedures, identify system deficiencies, and gather input/output requirements such as data input forms and reporting formats.
• Document detailed user requirements, program functions, and necessary steps for the development or modification of computer programs supporting the Databricks platform.
• Review computer system capabilities, specifications, and scheduling limitations to assess the feasibility of requested program changes within existing system constraints.
• Other duties as assigned.

Qualifications

Here's What You Need

The qualifications and skills listed below are intended to provide a general overview of the requirements for this position. However, due to the anticipated nature of the contract and the absence of a finalized task order from the client, this list should not be considered all-encompassing. Additional qualifications, certifications, skills, or experience specific to the client's requirements may be identified and requested upon award of the task order. Candidates should demonstrate flexibility and a willingness to adapt to evolving responsibilities as outlined by the client.

• 8 years of experience administering Databricks workspaces in a cloud environment, specifically AWS.
• 8 years of strong understanding of Databricks cluster configuration, job scheduling, and workspace management.
• 8 years of experience managing user access, roles, and permissions using IAM, SCIM, and role-based access control (RBAC).
• 8 years of proficiency with Apache Spark concepts, including performance tuning and troubleshooting.
• 8 years of experience integrating Databricks with cloud storage services (e.g., S3).
• 8 years of experience implementing and enforcing cluster policies and workspace governance standards.
• 8 years of familiarity with Databricks SQL, notebooks, and job orchestration.
• 8 years of experience monitoring platform health, performance, and availability.
• 8 years of understanding of data security, encryption, and compliance requirements.
• 8 years of experience with DevOps or automation tools such as Terraform, CI/CD pipelines, and scripting.
• Must be able to pass a background check. May require additional background checks as required by projects and/or clients at any time during employment.

Minimum Skills:

• Exceptional interpersonal skills with the ability to communicate in a clear, professional, and articulate manner.
• Exceptional verbal and written communication skills.
• Excellent organizational, analytical, and problem-solving skills with high-level attention to detail.
• Ability to analyze systems and procedures
• Strong multitasking skills with the ability to manage multiple design streams across concurrent work effort.
• Must be self-motivated and able to work well independently as well as on a multi-functional team.
• Ability to handle sensitive and confidential information appropriately.

Preferred Qualifications:

• 4 years of experience administering Databricks in an enterprise or government environment.
• 4 years of experience with Databricks Unity Catalog for data governance and access control.
• 4 years of knowledge of cost management and optimization for Databricks workloads.
• 4 years of experience supporting AI/ML workloads using Databricks ML and MLflow.
• 4 years of familiarity with data lake and lakehouse architecture.
• 4 years of knowledge of Python, SQL, or Scala for administration and troubleshooting.

Our Commitment to you / overview of benefits

• Medical, Dental and Vision Insurance; Wellness Program
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
• Short-Term and Long-Term Disability options
• Basic Life and AD&D Insurance (Company Provided)
• Voluntary Life and AD&D options
• 401(k) Retirement Savings Plan with matching after one year
• Paid Time Off

Reports to: Program Manager

Working Conditions

• Professional office environment, with the ability to work onsite in the main office.
• Must reside in the Austin area.
• Must be physically and mentally able to perform duties extended periods of time.
• Ability to use a computer and other office productivity tools with sufficient speed to meet the demands of this position.
• Must be able to establish a productive and professional workspace.
• Must be able to sit for long periods of time looking at computer screen.

• May be asked to work a flexible schedule which may include holidays.
• May be asked to travel for business or professional development purposes.
• May be asked to work hours outside of normal business hours.
• Travel costs, per diem, and other related expenses must be pre-approved in compliance with State of Texas travel guidelines.

Other Duties: Please note this job description is not designed to cover or contain a comprehensive list of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

Cayuse is an Equal Opportunity Employer. All employment decisions are based on merit, qualifications, skills, and abilities. All qualified applicants will receive consideration for employment in accordance with any applicable federal, state, or local law.

Pay Range

USD $108,160.00 - USD $153,920.00 /Yr.