LiftmyCVLiftmyCV

Senior Data Engineer

KplerHybridGB

Job description

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors. Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 850 experts from 69 countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success.

About the Role

As a Senior Data Engineer on our Maritime Models team, you will take technical ownership of the core data pipelines and distributed storage architectures powering Kpler's vessel tracking and predictive analytics. You will design, scale, and optimize high-throughput batch and streaming pipelines that ingest raw maritime telemetry and transform it into actionable intelligence. Working with distributed NoSQL systems like Apache HBase at scale, your work directly ensures the freshness, accuracy, and reliability of the data models our global customers depend on.

About the Role

As a Senior Data Engineer on our Maritime Models team, you will take technical ownership of the core data pipelines and distributed storage architectures powering Kpler's vessel tracking and predictive analytics. You will design, scale, and optimize high-throughput batch and streaming pipelines that ingest raw maritime telemetry and transform it into actionable intelligence. Working with distributed NoSQL systems like Apache HBase at scale, your work directly ensures the freshness, accuracy, and reliability of the data models our global customers depend on.

Key Responsibilities

  • Architect, build, and operate high-throughput batch and streaming data pipelines using Java, Apache Kafka, Apache Flink, and Airflow.
  • Design, tune, and maintain scalable distributed NoSQL databases, prioritizing Apache HBase performance for high-volume time-series maritime telemetry.
  • Drive end-to-end operational excellence across containerized cloud environments on AWS using Kubernetes, Docker, Terraform, and GitOps workflows.
  • Define and enforce system reliability metrics, monitoring pipeline latency, data completeness, and uptime to meet strict operational SLAs.
  • Partner with Data Scientists, Product Managers, and SRE teams to translate complex maritime modeling requirements into robust, production-grade infrastructure.
  • Mentor peer engineers, drive code review standards, and leverage modern AI development tools (Copilot, Cursor, Claude) to elevate team productivity.

Experience & Background

What you'll need (Must-haves)

  • 5+ years of professional experience as a Data Engineer designing, scaling, and maintaining production-grade data pipelines.
  • Deep, hands-on expertise in distributed NoSQL data stores, specifically Apache HBase, for high-volume time-series storage and query optimization.
  • Strong proficiency in software engineering using Java.
  • Demonstrated experience with stream processing and orchestration tools such as Apache Kafka, Apache Flink, and Apache Airflow.
  • Solid background operating containerized services on AWS cloud environments using Docker, Kubernetes, and Terraform.
  • Experience with relational databases such as PostgreSQL.
  • Experience working with geospatial data technologies (e.g., GeoServer) or spatial indexing algorithms.
  • Exposure to AI-assisted software development tools like Copilot, Cursor, or Claude Code.
  • Domain familiarity with maritime tracking, AIS telemetry, or supply chain logistics.

We are a dynamic company dedicated to nurturing connections and innovating solutions to tackle market challenges head-on. If you thrive on customer satisfaction and turning ideas into reality, then you’ve found your ideal destination. Are you ready to embark on this exciting journey with us?

We make things happen

We act decisively and with purpose, going the extra mile.

We build together

We foster relationships and develop creative solutions to address market challenges.

We are here to help

We are accessible and supportive to colleagues and clients with a friendly approach. Our People Pledge Don’t meet every single requirement? Research shows that women and people of color are less likely than others to apply if they feel like they don’t match 100% of the job requirements. Don’t let the confidence gap stand in your way, we’d love to hear from you! We understand that experience comes in many different forms and are dedicated to adding new perspectives to the team. Kpler is committed to providing a fair, inclusive and diverse work-environment. We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community. We welcome people of different backgrounds, experiences, abilities and perspectives and are an equal opportunity employer. By applying, I confirm that I have read and accept the Staff Privacy Notice

Job details

Published
November 10, 2026
Last checked
November 18, 2026
Experience
Senior
Job source
lever
Workplace
Hybrid · GB
First seen
November 10, 2026

LiftmyCV exclusive data

Kpler hiring intelligence

Kpler currently has 52 active jobs tracked by LiftmyCV. 3 new jobs in the past 7 days.

Verified November 18, 2026

Active openings

52

Currently tracked by LiftmyCV

New in 7 days

3

41 new jobs in the past 30 days

Published salaries

2%

Median disclosed salary: $150,000

Average opening age

22 days

Across 52 active openings

Workplace breakdown

Remote12%
Hybrid88%
On-site0%

Hiring countries

United Kingdom
Greece
United Arab Emirates
Singapore
United States of America
France

Top hiring cities

London
Dubai
Athens
Houston
Paris

Most in-demand roles

  • • Senior Account Executive (Government, Defense & Intelligence)
  • • Senior Data Engineer
  • • Fullstack Engineer
  • • Account Development Representative
  • • Account Executive - Automotive & Mobility Intelligence
  • • Account Executive - Commodities - Middle East

Frequently requested skills

Python
AWS
Docker
SQL
Kubernetes
CRM
sales
TypeScript

Median disclosed salary: $150,000 · 2% of jobs publish a salary

As of November 18, 2026

Hiring insights calculated from active jobs tracked by LiftmyCV.

AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

Visa sponsorship insights

Sponsorship not specified for this role

This job posting does not state whether visa sponsorship is available.

Employer UK sponsor status

Kpler Limited

Licensed sponsor

Global Business Mobility: Senior or Specialist Worker, Skilled Worker

A-rated

sponsor rating

A sponsor licence does not guarantee that this role offers visa sponsorship.

UK register of licensed sponsors

More at Kpler

Similar jobs from this company

Across the market

Similar jobs from other companies

Related job searches

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.