Databricks Machine Learning Lead
Join Accenture's Data & AI Practice as a Databricks Machine Learning Lead, where you will provide technical leadership for scalable data solutions on the Databricks Lakehouse Platform. This senior, hands-on role requires expertise in designing architectures, developing efficient code, and optimizing performance for complex ETL pipelines. Ideal candidates will have over 8 years of experience in machine learning and a strong background in Databricks technologies, fostering best practices in data engineering and data operations.
Job description
Summary
Our talented Data & AI Practice is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals. If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk. Take your skills to a new level and launch a career where you can truly do what matters. The Databricks M/L Technical Lead is a senior, hands-on role responsible for the design, development, and delivery of highly scalable, secure, and performant data solutions on the Databricks Lakehouse Platform. It is expected to provide technical leadership to a team of engineers, defining coding standards, implementing architectural patterns, and ensuring the delivery of high-quality data products.
Key Responsibilities
- Lead the Design: Define and implement robust data architectures utilizing the Databricks ecosystem, including Delta Lake, Unity Catalog, Machine Learning Models and Databricks Workflows.
- Hands-on Development: Serve as the most senior developer, writing high-quality, production-grade code in PySpark/Scala and SQL for complex batch and streaming ETL/ELT pipelines.
- Performance Optimization: Lead performance tuning and optimization efforts for large-scale Spark jobs, ensuring efficient cluster utilization and cost management.
- Standards & Best Practices: Define and enforce technical standards, code quality, testing frameworks (unit, integration), and DataOps/CI/CD pipelines for the engineering team.
Skills & Experiences
- 8+ years of experience in machine learning, data science, or MLOps, with at least 4+ years focused specifically on the Databricks Lakehouse Platform.
- Expert proficiency in Python and PySpark/Scala for large-scale data processing and machine learning.
- Deep understanding and practical experience with Delta Lake architecture and optimization techniques.
- Proven expertise implementing MLOps principles using MLflow (Tracking, Registry, Projects, and Deployment).
Job details
- Published
- July 20, 2026
- Job source
- myworkdayjobs
- Workplace
- On-site · Kuala Lumpur, MY
- First seen
- July 20, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Avanade Malaysia Company
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.