Principal Architect, Databricks

Living Our Values
All associates are guided by Our Values. Our Values are the unifying foundation of our companies. We strive to ensure that every decision we make and every action we take demonstrates Our Values. We believe that putting Our Values into practice creates lasting benefits for all of our associates, shareholders, and the communities in which we live.

Why Join Us

• Career Growth: Advance your career with opportunities for leadership and personal development.
• Culture of Excellence: Be part of a supportive team that values your input and encourages innovation.
• Competitive Benefits: Enjoy a comprehensive benefits package that looks after both your professional and personal needs.

Total Rewards
Our Total Rewards package underscores our commitment to recognizing your contributions. We offer a competitive and fair compensation structure that includes base pay and performance-based rewards. Compensation is based on skill set, experience, qualifications, and job-related requirements. Our comprehensive benefits package includes medical, dental, and vision insurance, wellness programs, retirement plans, and generous paid leave. Discover more about what we offer by visiting our Benefits page.

A Day In The Life
The Principal Databricks Architect will act as our top technical expert and lead practitioner for the Databricks Platform. This role combines architectural leadership with practical implementation. You will be responsible not only for defining the architectural vision but also for developing core, reusable patterns and reference architectures that will accelerate our teams. The ideal candidate is a master of the Databricks ecosystem who leads by example, demonstrates what's possible through hands-on development, and empowers teams to build robust, scalable data solutions.

As a Principal Architect, Databricks you will:

• Develop and Implement Reference Architectures: Design, build, and maintain a library of production-quality reference architectures and reusable patterns that showcase best practices and accelerate development for engineering teams.
• Architect and Prototype Solutions: Architect and build proofs-of-concept for end-to-end solutions on the Databricks Lakehouse Platform, actively demonstrating feasibility and validating complex designs through hands-on implementation.
• Advise Through Doing: Serve as the primary consultant for engineering teams on all aspects of Databricks, providing expert guidance that extends beyond diagrams to include code, best practices, and hands-on support.
• Lead Platform Training: Create training sessions and train engineers, leading the adoption and implementation of new features such as Unity Catalog, Delta Live Tables, and advanced MLOps capabilities.
• Establish and Govern Best Practices: Define, document, and evangelize standards for Databricks development, including data modeling, performance tuning, security, and cost management.
• Mentor and Coach: Mentor engineers and other technical staff through code reviews, paired programming, and design sessions, elevating the overall technical proficiency of the organization within the Databricks ecosystem.

What We Need From You

• Bachelor's Degree Computer Science or related field. Req
• 10+ years Experience in software engineering, including significant experience in architecting systems. Required
• Proven experience acting as a hands-on technical architect and advisor on large-scale data projects. Required
• Databricks Mastery: Deep, expert-level knowledge of the Databricks Platform, including: Unity Catalog: Designing and implementing data governance and security. Delta Lake & Delta Live Tables: Architecting and building reliable, scalable data pipelines. Performance & Cost Optimization: Expertise in tuning Spark jobs, optimizing cluster usage, and managing platform costs. MLOps: Strong, practical understanding of the machine learning lifecycle on Databricks using tools like MLflow. Databricks SQL: Knowledge of designing and optimizing analytical workloads. Mosaic AI: Knowledge of designing and optimizing AI Agents.
• Cloud & Infrastructure: Deep knowledge of cloud architecture and services on AWS. Strong command of Infrastructure as Code (Terraform, YAML).
• Software Engineering & Programming: Strong background in software engineering and building large fault-tolerant systems.
• CI/CD & Automation: Experience with designing and implementing CI/CD pipelines (preferably with GitHub Actions) for data and ML workloads.
• Observability: Familiarity with implementing monitoring, logging, and alerting for data platforms.
• Automation: The platform is ephemeral, and all changes are implemented using Terraform and Python. Expertise in Terraform and Python is a must.
• Excellent communication and interpersonal skills, with the ability to influence and guide technical teams and stakeholders effectively.
• A strategic mindset with a passion for solving complex data challenges and driving business outcomes through technology.
• The ability to think critically, challenge assumptions, and make clear, well-reasoned architectural decisions.

Physical and Environmental RequirementsThe physical requirements described here are representative of those that must be met by an associate to successfully perform the essential functions of the job. While performing the duties of the job, the associate is required on a daily basis to analyze and interpret data, communicate, and remain in a stationary position for a significant amount of the work day and frequently access, input, and retrieve information from the computer and other office productivity devices. The associate is regularly required to move about the office and around the corporate campus. The associate must frequently move up to 10 pounds and occasionally move up to 25 pounds.

Travel Requirements
10% The associate is occasionally required to travel to other sites, including out-of-state, where applicable, for business.

Join Us
The Friedkin Group and its affiliates are committed to ensuring equal employment opportunities, including providing reasonable accommodations to individuals with disabilities. If you have a disability and would like to request an accommodation, please contact us at [email protected]. We celebrate diversity and are committed to creating an inclusive environment for all associates.

We are seeking candidates legally authorized to work in the United States, without Sponsorship.

#LI-TW1