Airflow Platform Engineer
We are seeking an Airflow Platform Engineer with 4 to 6 years of experience to design, develop, and optimize Airflow DAGs for enterprise use cases. The ideal candidate will demonstrate strong experience with various operators, advanced DAG patterns, and Kubernetes support. Responsibilities include troubleshooting, enabling orchestration, and providing best practices for self-service adoption. Required skills include expertise in Apache Airflow, Python, and CI/CD tools, with preferred experience in Astronomer, Snowflake, and monitoring tools. This role is vital for ensuring reliable platform operations and supporting developer productivity.
Job description
Key Responsibilities
DAG Development & Developer Enablement
- Design, develop, and optimize Airflow DAGs for enterprise use cases
- Demonstrate strong experience with operators such as PythonOperator, SQL operators,
API/HTTP operators, KubernetesPodOperator etc.
- Apply advanced DAG patterns including dynamic DAGs, branching, sensors, retries, and
error handling
- Troubleshoot DAG failures, performance issues, and integration challenges
- Enable orchestration of modern data workflows including DBT pipelines
- Provide reusable templates, best practices, and onboarding support to drive self-service
adoption
Platform Operations & Kubernetes Support
- Support Airflow platform deployed on AKS, covering scheduler, webserver/API, workers,
and metadata services
- Troubleshoot issues related to task execution, scheduling delays, and resource bottlenecks
- Diagnose Kubernetes-level issues involving pods, networking, storage, and RBAC
- Work with Azure services such as Key Vault, Storage, and networking
- Support CI/CD pipelines for DAG and container-based deployments
- Improve platform stability, monitoring, and alerting
Required Skills
- Strong experience with Apache Airflow (3.x or later) in production environments
- Proven experience in DAG development using operators and orchestration patterns
- Working knowledge of Kubernetes (AKS preferred) to support Airflow runtime
- Expert-level Python knowledge for building, debugging, and maintaining production-
grade workflows and supporting libraries
- Expertise in writing unit, integration, and DAG validation tests for Airflow workflows,
including mocking operators, validating dependencies, and ensuring reliability in CI/CD pipelines
- Experience with DBT and modern data pipelines
- Experience with CI/CD tools (Git, Jenkins, Docker)
- Familiarity with Azure or other cloud platforms
Preferred Skills
- Experience with Astronomer / Astro Private Cloud
- Exposure to data platforms such as Snowflake, and APIs
- Experience with monitoring tools such as Splunk or Prometheus
- Knowledge of secrets management using Azure Key Vault
Summary
This role is critical to ensuring reliable platform operations and scalable adoption of the Airflow-based orchestration platform. The ideal candidate combines strong Airflow expertise, Kubernetes knowledge, and hands-on development experience to support both platform stability and developer productivity.
Job details
- Published
- June 30, 2026
- Job source
- myworkdayjobs
- Workplace
- On-site · Hyderabad, IN
- First seen
- August 1, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at Jade Global Software Pvt LTD
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.