Staff Engineer – AI Data Engineering
Prudential seeks an experienced AI Data Engineering Lead to define and lead enterprise-scale data platforms for AI and machine learning. This role requires a senior technology leader with over 15 years of experience in data engineering, architecture, and managing engineering teams. Key responsibilities include designing scalable data architectures, leading engineering efforts for AI-ready data platforms, and establishing data governance practices. The candidate must exhibit strong technical depth in modern data platforms and practices, proficiently manage distributed data processing, and ensure data quality and observability.
Job description
Prudential’s purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our people to do their best work and make an impact to the business, and we support our people’s career ambitions. We pledge to make Prudential a place where you can Connect, Grow, and Succeed. We are looking for an experienced AI Data Engineering Lead to define and lead the engineering of enterprise-scale data platforms and data products that power Artificial Intelligence, Machine Learning, Generative AI and advanced analytics. This individual will build the organisation’s AI-ready data foundation by bringing together modern data engineering, cloud platforms, batch and real-time processing, unstructured data, vector and semantic technologies, data governance, and AI/ML engineering practices. The role requires a senior technology leader with 15+ years of experience, strong hands-on technical depth, architecture capability, and a proven ability to lead engineering teams and deliver complex data platforms at enterprise scale. Key Responsibilities AI Data Engineering Strategy & Architecture
- Define the enterprise AI Data Engineering strategy, architecture and engineering standards.
- Design scalable data architectures supporting AI/ML, GenAI, LLM, analytics and enterprise data products.
- Establish reusable architectural patterns for structured, semi-structured and unstructured data.
- Define patterns for data lakes, lakehouse architectures, data warehouses, streaming platforms, vector databases and AI knowledge layers.
- Drive architectural decisions covering performance, scalability, resiliency, security and cost.
AI-Ready Data Platforms
- Lead engineering of data platforms providing trusted and reusable data for ML models, LLMs, AI agents and GenAI applications.
- Build ingestion and transformation frameworks for data from databases, APIs, documents, events, logs and enterprise applications.
- Establish pipelines for batch, near-real-time and streaming data processing.
- Drive automated data validation, quality controls, metadata management and lineage.
- Establish engineering approaches for preparing text, documents, images and other unstructured data for AI consumption.
GenAI & LLM Data Engineering
- Provide technical leadership for Retrieval-Augmented Generation (RAG), document ingestion, parsing, chunking and enrichment.
- Lead embedding generation and management, vector and hybrid search, semantic retrieval and reranking.
- Design knowledge repositories, metadata and access-control filtering, and enterprise search integration.
- Create data pipelines for LLM evaluation, AI grounding, authorised retrieval, fine-tuning where applicable, and AI agents.
- Understand how poor retrieval, incomplete or stale data, weak metadata and inappropriate chunking affect enterprise AI reliability.
Modern Data Engineering
- Provide leadership across ETL/ELT, distributed processing, lakehouse and data warehouse architectures, streaming, event-driven design, data APIs and data services.
- Drive data modelling, data contracts, observability, quality engineering, lineage and metadata management.
- Embed Infrastructure-as-Code, CI/CD, DevOps and DataOps practices in the engineering lifecycle.
- Improve reusability, automation, reliability and developer productivity through common frameworks and standards.
Cloud & Technology Platforms
- Demonstrate significant expertise across modern cloud and data platforms such as Microsoft Azure, Azure Databricks, Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Snowflake and Databricks.
- Bring strong capability in Python, SQL, Apache Spark/PySpark, Kafka, Delta Lake, Airflow and dbt.
- Apply AI and GenAI data technologies including Azure AI Search, vector databases, embedding models, semantic search, RAG frameworks, MLflow and feature stores.
- Experience with Azure OpenAI, enterprise LLM platforms and agent architectures is highly valuable. Deep expertise is expected across a relevant enterprise-scale stack, rather than every technology listed.
Data Governance, Security & Responsible AI
- Embed data governance, privacy, security and regulatory controls into data engineering architecture.
- Implement appropriate access controls for sensitive and confidential information.
- Ensure lineage, traceability and auditability across AI data pipelines.
- Ensure AI solutions retrieve and process only appropriately authorised data.
- Partner with Cybersecurity, Risk, Compliance, Data Governance and AI Governance teams, while promoting Responsible AI engineering practices.
- Experience handling PII, sensitive customer information, data residency and regulatory requirements is highly valuable.
Data Quality & Observability
- Define enterprise standards for AI data quality and automated validation across ingestion, transformation and retrieval pipelines.
- Monitor data freshness, completeness, accuracy, schema changes and pipeline failures.
- Drive observability across data pipelines and AI knowledge systems.
- Establish measurable engineering SLAs and SLOs for critical data services.
Engineering Leadership
- Lead and mentor senior data engineers, AI engineers and platform engineers.
- Provide technical direction across multiple engineering squads and programmes.
- Establish engineering standards, reference architectures and reusable frameworks.
- Conduct architecture and engineering design reviews, and resolve complex technical issues.
- Build capability through coaching, communities of practice and technical mentoring.
- Partner with Enterprise Architecture, Cloud, Cybersecurity, Data, AI/ML and application engineering teams while remaining technically credible and sufficiently hands-on.
Required Experience
- 15+ years of overall technology and engineering experience, with substantial depth in data engineering, data platforms or related disciplines.
- Significant experience leading enterprise-scale data engineering programmes and teams.
- Strong experience designing and implementing cloud-native data platforms.
- Deep understanding of distributed data processing and modern data architectures.
- Demonstrated experience supporting AI/ML or GenAI workloads through data engineering.
- Strong understanding of structured and unstructured data processing.
- Experience with enterprise-grade security, governance and data-quality practices.
- Strong coding capability, particularly in Python, SQL and PySpark or equivalent technologies.
- Experience with CI/CD, DevOps/DataOps and automated engineering practices.
- Proven ability to operate across architecture, engineering and senior stakeholder environments.
Preferred AI-Specific Experience
- GenAI and LLM solutions
- RAG architectures, vector databases and embedding pipelines
- Semantic and hybrid search, knowledge graphs and AI agents
- Feature engineering and feature stores
- MLOps and LLMOps
- Model evaluation datasets and data preparation for fine-tuning
- Unstructured-document processing
- Responsible AI and AI governance
Leadership Competencies
- Technology Vision: Converts AI strategy into practical data-engineering architecture.
- Engineering Excellence: Drives scalable, resilient and maintainable engineering practices.
- AI Mindset: Understands how data architecture changes for GenAI, LLMs and AI agents.
- Enterprise Thinking: Designs reusable capabilities rather than point solutions.
- Technical Leadership: Guides senior engineers and architects through complex technology decisions.
- Stakeholder Influence: Communicates complex concepts effectively to senior business and technology stakeholders.
- Execution: Converts architecture into production-grade platforms and measurable outcomes.
- Talent Development: Builds engineering capability and develops future technical leaders.
Education & Certifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, Software Engineering, Information Technology or a related discipline.
- Relevant certifications from Microsoft Azure, Databricks or equivalent cloud/data technology providers are desirable.
- Advanced AI/ML, Data Engineering or Cloud Architecture certifications are advantageous.
Prudential is an equal opportunity employer. We provide equality of opportunity of benefits for all who apply and who perform work for our organisation irrespective of sex, race, age, ethnic origin, educational, social and cultural background, marital status, pregnancy and maternity, religion or belief, disability or part-time / fixed-term work, or any other status protected by applicable law. We encourage the same standards from our recruitment and third-party suppliers taking into account the context of grade, job and location. We also allow for reasonable adjustments to support people with individual physical or mental health requirements.
Job details
- Published
- November 2, 2026
- Experience
- Senior
- Job source
- myworkdayjobs
- Workplace
- Hybrid · Singapore, SG
- First seen
- November 2, 2026
Skills mentioned in this job
LiftmyCV exclusive data
Prudential Services Singapore Pte Ltd hiring intelligence
Prudential Services Singapore Pte Ltd currently has 4 active jobs tracked by LiftmyCV. 4 new jobs in the past 7 days.
Active openings
4
Currently tracked by LiftmyCV
New in 7 days
4
4 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
0 days
Across 4 active openings
Workplace breakdown
Hiring countries
Most in-demand roles
- • Business Analyst
- • Director, Health Underwriting Strategy
- • Head of Cloud Architecture & Data Platform
- • Senior Manager, HNW Distribution
Frequently requested skills
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Prudential Services Singapore Pte Ltd
Similar jobs from this company
- Senior Manager, HNW DistributionPrudential Services Singapore Pte LtdSingapore, SGOn-site
- Manager, Process Improvement and End User AutomationPrudential Services Singapore Pte LtdSingapore, SGOn-site
- Conventions & Events ManagerPrudential Services Singapore Pte LtdSingapore (Group Head Office)On-site
- Head of Cloud Architecture & Data PlatformPrudential Services Singapore Pte LtdSingapore, SGOn-site
- Director, Health Underwriting StrategyPrudential Services Singapore Pte LtdSingapore, SGOn-site
- Business AnalystPrudential Services Singapore Pte LtdSingapore, SGOn-site
Across the market
Similar jobs from other companies
- Engineer – EngineeringCatalent Pharma Solutions LLCMadison, WIOn-site
- Engineer - EngineeringCarl Zeiss India (Bangalore) Pvt. Ltd.Bangalore, INOn-site
- Engineering Manager Engineering Manager Engineering Manager Engineering Manager Engineering Manager Engineering Manager Engineering Manager Engineering Manager Engineering Manager Engineering Manager Engineering Manager Engineering ManagerDemo RecruitingLondon, GBOn-site
- Engineering Automation Engineer/Senior EngineerAstrazenecaQingdao SiteOn-site
- Engineer, Process Engineering (Manufacturing Engineering)SandiskBatu Kawan, MYOn-site
- Staff Engineer – Electrical Engineering, EnginesRehlkoKohler, USOn-site$98,900–$125,600 per year
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.