LiftmyCVLiftmyCV

Senior Databricks SME

BuzzClan LLCOn-siteDallas, US
AI job summary

BuzzClan LLC is seeking a Senior Databricks SME with strong expertise in Lakehouse architecture, Delta Lake, and enterprise-level Spark deployments. This role involves leading design efforts for Databricks architectures, managing large-scale ETL/ELT pipelines, and guiding clients on ML workflows. The ideal candidate will have over 10 years of experience in data engineering and a proven background in multi-cloud environments. Responsibilities include client advisory, technical leadership, and contributing to thought leadership within the firm. The position is located in Dallas, TX and requires on-site presence.

Job description

Senior Databricks SME Location - Dallas, TX 75254

Full-time/ Contract

Must Have - The SME role calls for deep Databricks and Spark expertise, including Lakehouse architecture, Delta Lake, Unity Catalog, PySpark or Scala, and enterprise production deployments. Client advisory and leadership experience are also important. Job Description:

Solution Architecture & Design

  • Lead end to end design of Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and medallion (bronze/silver/gold) data models.
  • Define reference architectures, best practices, and reusable accelerators for client engagements.
  • Evaluate and recommend deployment patterns across Azure Databricks, AWS Databricks, and GCP, aligning platform choices with client infrastructure and governance needs.

Data Engineering & Pipeline Development

  • Architect and oversee large scale ETL/ELT pipelines using Apache Spark, Delta Live Tables, and Databricks Workflows.
  • Design real time and batch ingestion frameworks covering structured, semi structured, and unstructured data sources.
  • Establish data quality, lineage, and observability standards using Unity Catalog, Delta Lake features, and complementary tooling.

Machine Learning & MLOps

  • Guide clients on implementing end to end ML workflows using MLflow, Feature Store, and Model Serving on Databricks.
  • Advise on MLOps patterns including model versioning, A/B testing, monitoring, and automated retraining pipelines.
  • Collaborate with data science teams to productionize models and integrate ML outputs into business applications.

Client Advisory & Engagement Leadership

  • Serve as the trusted advisor to senior client stakeholders on all matters related to data platform strategy and Databricks adoption.
  • Lead discovery workshops, architecture reviews, and technical assessments to define solution roadmaps.
  • Support pre sales efforts by developing proposals, estimating level of effort, and delivering technical demonstrations.

Thought Leadership & Practice Development

  • Contribute to the firm's intellectual property by developing frameworks, white papers, and training curricula around Databricks.
  • Mentor and upskill consultants across the data practice; foster a community of Databricks practitioners.
  • Represent the firm at industry events, Databricks partner summits, and webinars.

Required Qualifications

  • 10+ years of professional experience in data engineering, analytics, or platform architecture.
  • 5+ years of deep, hands on experience with Databricks, including production deployments at enterprise scale.
  • Expert level proficiency in Apache Spark (PySpark and/or Scala), Delta Lake, and SQL.
  • Proven track record designing multi cloud Lakehouse architectures (Azure, AWS, or GCP).
  • Strong experience with Unity Catalog for data governance, access control, and lineage tracking.
  • Demonstrated ability to lead client facing engagements and communicate complex technical concepts to executive audiences.
  • Experience in a consulting or professional services environment, with a history of managing multiple concurrent engagements.
  • Bachelor's degree in Computer Science, Engineering, Data Science, or a related field (or equivalent practical experience).

Preferred Qualifications

  • Databricks Certified Data Engineer Professional or Machine Learning Professional certification.
  • Experience with Delta Live Tables, Databricks Workflows, and Photon engine optimization.
  • Familiarity with complementary tools such as dbt, Terraform/Pulumi (IaC), and CI/CD pipelines for data platforms.
  • Hands on experience with MLflow, Feature Store, and Model Serving in production environments.
  • Prior experience as a Databricks partner or in a Databricks aligned practice within a consulting firm.
  • Advanced degree (M.S. or Ph.D.) in a quantitative or technical discipline.

All your information will be kept confidential according to EEO guidelines.

Job details

Published
October 19, 2026
Experience
Senior
Job source
smartrecruiters
Workplace
On-site · Dallas, US
First seen
October 21, 2026

Skills mentioned in this job

DatabricksSparkLakehouseDelta LakeUnity CatalogPySparkScala

LiftmyCV exclusive data

BuzzClan LLC hiring intelligence

BuzzClan LLC currently has 2 active jobs tracked by LiftmyCV. 2 new jobs in the past 7 days.

Active openings

2

Currently tracked by LiftmyCV

New in 7 days

2

2 new jobs in the past 30 days

Published salaries

—

Not published by this employer yet

Average opening age

1 days

Across 2 active openings

Workplace breakdown

Remote0%
Hybrid50%
On-site50%

Hiring countries

United States of America

Top hiring cities

Chicago
Somerset St

Most in-demand roles

  • • Business Systems Analyst
  • • Product Analytics Consultant

Frequently requested skills

Amplitude Analytics
business intelligence
cohort analysis
conversion measurement
digital analytics
engagement analysis
event-based tracking
feature adoption

As of November 17, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at BuzzClan LLC

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.