Senior Databricks Data Engineer
Job description
Customized Energy Solutions India Pvt. Ltd. (CES India) is part of Customized Energy Solutions (CES), a globally recognized, privately held energy market intelligence, consulting, and operational services firm supporting retail and wholesale electricity and natural gas markets worldwide. Headquartered in Philadelphia, CES operates across the United States, Canada, Japan, India, and Vietnam, with approximately 400 associates globally. The company has earned multiple distinctions from INC. 500 | 5000 and the Philadelphia Business Journal, including Hall of Fame status and repeated recognition as a Best Place to Work. Established in 2010, CES India plays a critical role in supporting both domestic and international energy initiatives. The India team brings expertise in emerging technologies transforming the energy landscape, including energy storage, electric mobility, wholesale electricity markets, microgrids, and renewable energy systems. Associates in India collaborate closely with global teams while contributing deep technical and analytical capabilities to complex energy market challenges. CES India actively engages with industry bodies and ecosystem partners that are shaping India’s energy and technology landscape, including organizations such as the India Electronics and Semiconductor Association (IESA). Through industry collaboration, technology innovation, and engagement with public and private stakeholders, CES India supports the broader goal of advancing sustainable, high-growth energy and manufacturing sectors in India. At CES India, you will work in a fast-evolving industry where innovation, accountability, and professional growth are valued. Your work will contribute to meaningful outcomes across both regional and global energy markets. We are seeking a Senior Databricks Data Engineer to provide technical leadership for a large-scale enterprise BI modernization initiative. This is not a lift-and-shift migration effort. The role will lead the systematic transformation of a complex Microsoft BI ecosystem (SSIS, SSAS, SSRS) into scalable, governed Databricks Lakehouse architecture. The Senior Engineer will establish architectural standards, define repeatable migration frameworks,, and guide the modernization of thousands of legacy data assets into reusable, high-performance Spark-based solutions. This individual combines deep hands-on data engineering expertise with architectural thinking, mentorship capability, and strong cross-functional collaboration skills.
Key Responsibilities
- Lead the architecture and implementation of enterprise-scale data pipelines on Databricks.
- Serve as technical lead for the migration of a ~20TB Microsoft SQL Server data warehouse to the Databricks Lakehouse Platform.
- Design and implement reusable Spark-based pipeline frameworks to replace thousands of SSIS workflows.
- Deconstruct SSAS cube logic and redesign it into Lakehouse-native semantic models.
- Replace legacy SSRS reporting ecosystems with modern, governed analytics layers.
- Rebuild dimensional models within Delta Lake using scalable Lakehouse design patterns.
- Define data modeling standards, ingestion frameworks, CI/CD processes, and operational best practices.
- Implement and enforce Medallion architecture standards (Bronze/Silver/Gold) with performance optimization and governance controls.
- Optimize Spark workloads for scalability, reliability, and cost efficiency.
- Implement governance, lineage, security, and monitoring using Unity Catalog and related platform tooling.
- Mentor engineers, conduct architectural reviews, establish and maintain engineering standards.
- Partner with BI, analytics, and AI/ML teams to enable advanced analytics and downstream use cases.
- Influence platform roadmap and architectural decisions.
- Bachelor’s or master’s degree in computer science, engineering, or related field.
- 8 – 12 years of data engineering experience.
- 5+ years of hands-on experience building and operating production workloads on Databricks.
- Deep expertise in SQL, PySpark, and distributed data processing.
- Demonstrated leadership in structured enterprise BI modernization programs.
- Proven experience replacing SSIS-based ETL with scalable Spark-based frameworks.
- Strong understanding of SSAS cube architecture and semantic layer modernization.
- Experience designing and operating high-volume, enterprise-grade analytical data platforms.
- Strong knowledge of Delta Lake, Lakehouse and Medallion architectures, data versioning, and Workflows/Jobs orchestration.
- Experience implementing CI/CD, testing frameworks, and operational reliability for data platforms.
- AWS-based Databricks experience strongly preferred.
Preferred Skills
- Experience designing semantic layers and BI integrations (Power BI preferred).
- Exposure to Databricks AI/ML capabilities (MLflow, feature engineering, feature stores).
- Experience establishing enterprise migration patterns across distributed teams.
- Prior technical leadership experience in global or multi-team environments.
- Strong stakeholder engagement and communication skills.
- Databricks certification is a plus.
Customized Energy Solutions India offers competitive compensation commensurate with experience, along with performance-based incentives aligned to individual and company results. Our benefits are designed to support both professional and personal well-being and include comprehensive medical insurance coverage for associates and eligible dependents, generous paid time off, and structured opportunities for professional development through training programs and skill enhancement initiatives. We are committed to creating an environment where associates are supported, challenged, and positioned for long-term career growth. Customized Energy Solutions provides equal employment opportunities to all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Job details
- Published
- August 27, 2026
- Job source
- smartrecruiters
- Workplace
- On-site · Pune, IN
- First seen
- August 27, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Customized Energy Solutions
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Senior Databricks Data EngineerCustomized Energy SolutionsPune, INOn-site
- Senior Databricks Data EngineerClarkston ConsultingDetroit, USHybrid
- Senior Databricks Data EngineerHiflylabsBudapest, Bartok Bela ut 15b, 1114 HungaryOn-site
- Senior Databricks Data Engineer49 SolutionsOttawa, CAHybrid
- Senior Databricks Data EngineerDelan Associates, IncAustin, USRemote
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.