Databricks Engineer
Plain Concepts is seeking a skilled Databricks Engineer to contribute to the design, construction, and scaling of a modern data platform utilizing Apache Spark and Delta Lake. This position focuses on data engineering, platform architecture, and performance optimization. Candidates will collaborate with data scientists and backend teams to develop efficient data pipelines and ensure data quality.
Job description
We’re looking for a hands-on Databricks Engineer to help design, build, and scale a modern data platform running on Apache Spark and Delta Lake. This role sits at the intersection of data engineering, platform architecture, and performance optimization. You’ll work closely with data scientists, analysts, and backend teams to ensure reliable, high-performance data pipelines and well-governed datasets.
Responsibilities
- Design and implement end-to-end data pipelines using Databricks (Jobs, Workflows, Delta Live Tables)
- Build and maintain scalable ETL/ELT processes leveraging Apache Spark (PySpark / Scala)
- Develop data models using Delta Lake, including schema design, partitioning strategies, Z-ordering, and optimization techniques
- Manage and optimize Databricks clusters (autoscaling, spot instances, instance pools, cluster policies)
- Implement CI/CD pipelines for Databricks deployments (e.g., using Databricks Repos, Terraform, Azure DevOps / GitHub Actions)
- Work with structured and semi-structured data (JSON, Parquet, Avro) at scale
- Ensure data quality and reliability through validation frameworks, unit/integration testing, and monitoring
- Implement data governance practices (Unity Catalog, access controls, lineage tracking, auditing)
- Troubleshoot performance issues (job failures, skew, shuffle bottlenecks, memory pressure) and optimize Spark workloads
- Integrate Databricks with cloud-native services (AWS S3, Azure Data Lake Storage, GCP BigQuery)
- Collaborate with data consumers to define SLAs, data contracts, and service interfaces
Job details
- Published
- April 21, 2026
- Job source
- jworkable
- Workplace
- Remote · BR
- First seen
- April 21, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Plain Concepts
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Databricks EngineerPlain ConceptsBRRemote
- Databricks EngineerRevStarTexas, USRemote
- Databricks EngineerV4C.aiUSRemote
- Databricks EngineerInetumBarcelona, ESHybrid
- Databricks EngineerBooz Allen Hamilton_United StatesBethesda, USOn-site$62,000–$141,000 per year
- Databricks EngineerConcentrix CVG Customer Management Group Inc.USOn-site$92,250–$120,000 per year
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.