LiftmyCVLiftmyCV
CA

Big Data Engineer- Scala

CapcoOn-sitePune, IN

Job description

Job Title: Big Data Engineer - SCala

About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage. MAKE AN IMPACT

Job Description: Big Data Engineer – Scala

We are looking for an experienced Big Data Engineer with strong expertise in Scala and Apache Spark to design, develop, and optimize scalable data-processing solutions. The ideal candidate should have hands-on experience with distributed data platforms, large-scale ETL/data pipelines, and big data technologies.

Key Responsibilities

  • Design, develop, and maintain scalable Big Data applications and data pipelines.
  • Develop high-performance data-processing solutions using Scala and Apache Spark.
  • Build and optimize ETL/ELT pipelines for large volumes of structured and unstructured data.
  • Work with technologies such as Hadoop, HDFS, Hive, Kafka, and Spark SQL.
  • Perform Spark job performance tuning and optimization.
  • Develop reusable and maintainable data-processing frameworks.
  • Troubleshoot production issues related to data pipelines and distributed applications.
  • Implement data-quality checks, monitoring, and error-handling mechanisms.
  • Collaborate with data architects, analysts, business teams, and other engineering teams.
  • Follow software engineering best practices, including Git, code reviews, testing, and CI/CD.

Required Skills

  • Strong hands-on programming experience in Scala.
  • Strong experience with Apache Spark / Spark SQL.
  • Good understanding of Big Data and distributed computing concepts.
  • Experience with Hadoop ecosystem technologies, including Hadoop/HDFS and Hive.
  • Experience building large-scale ETL/data engineering pipelines.
  • Strong SQL skills.
  • Experience working with Kafka or similar messaging/streaming technologies.
  • Understanding of data formats such as Parquet, Avro, and JSON.
  • Experience with performance optimization and troubleshooting of Spark applications.
  • Good understanding of software development lifecycle and version-control systems.

Good to Have

  • Experience with AWS, Azure, or GCP.
  • Knowledge of Databricks.
  • Experience with Airflow or similar orchestration tools.
  • Exposure to Delta Lake or other modern lakehouse technologies.
  • Knowledge of Docker, Kubernetes, and CI/CD pipelines.
  • Experience working in Agile/Scrum environments.

Core Skills Scala | Apache Spark | Spark SQL | SQL | Hadoop | HDFS | Hive | Kafka | ETL | Data Engineering | Big Data

Job details

Published
November 3, 2026
Last checked
November 16, 2026
Job source
greenhouse
Workplace
On-site · Pune, IN
First seen
November 4, 2026

LiftmyCV exclusive data

Capco hiring intelligence

Capco currently has 270 active jobs tracked by LiftmyCV. 39 new jobs in the past 7 days.

Verified November 16, 2026

Active openings

270

Currently tracked by LiftmyCV

New in 7 days

39

214 new jobs in the past 30 days

Published salaries

4%

Median disclosed salary: $100,722

Average opening age

33 days

Across 270 active openings

Workplace breakdown

Remote0%
Hybrid0%
On-site100%

Hiring countries

Brazil
India
Canada
Germany
Poland

Top hiring cities

Rio de Janeiro
Bengaluru
Pune
Toronto
Munich
Warsaw

Most in-demand roles

  • • Senior Consultant - Murex/Capital Markets
  • • Técnico em Segurança do Trabalho
  • • (Senior) Business Analyst – Wealth Management & Advisory Platforms
  • • Data Engineer
  • • Engenharia ambiental/Geólogo
  • • Product Manager* – Artificial Intelligence

Frequently requested skills

Python
Agile
Java
SQL
Azure
Power BI
JavaScript
Microsoft Office

Median disclosed salary: $100,722 · 4% of jobs publish a salary

As of November 17, 2026

Capco, LLC · ACTIVE

Hiring insights calculated from active jobs tracked by LiftmyCV.

Company information from GLEIF.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at Capco

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.