
Data Engineer
Inallmedia LLC is seeking a remote Data Engineer for platform modernization and migration projects. The role involves migrating approximately 1,000 datasets to Snowflake using Apache Airflow 3, modernizing data lakes, and optimizing streaming infrastructures across cloud regions. Candidates should have at least 2 years of data engineering experience, with proficiency in Python, SQL, Apache Spark, and data modeling in Snowflake. Familiarity with Apache Iceberg and AWS S3 is preferred. Strong communication and problem-solving skills are essential for this fast-paced environment.
Job description
Position: Data Engineer (Platform Modernization & Migration) Location: Fully Remote (EMEA & APAC Preferred) Contract Type: Full-time, Permanent
Time Zone Alignment: Requires overlap until at least 12:00 PM Pacific Time (PT)
About Inallmedia.com Inallmedia.com is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation. Project Overview You will join a core Data Engineering organization, working in close partnership with the Data Platform team to drive a major data platform modernization initiative. The primary focus of this project is executing pre-designed migration blueprints for approximately 1,000 datasets to Snowflake with Airflow 3 orchestration. You will play a crucial role in accelerating time-sensitive infrastructure goals by evolving legacy Lakehouse formats to Apache Iceberg, modernizing streaming infrastructure across cloud regions, and adapting existing pipelines to uphold strict data quality and performance standards. Key Responsibilities
- Pipeline Migration & Upgrades: Execute the end-to-end migration of approximately 1,000 datasets to Snowflake, including upgrading orchestration workflows from Apache Airflow 2 to Airflow 3.
- Storage & Data Lake Modernization: Migrate legacy Hive data structures and datasets to Apache Iceberg format using the Snowpark Connect framework/connectors.
- Streaming Infrastructure & Region Migration: Reconfigure, update, and migrate Confluent/Apache Kafka streaming connections across cloud regions (e.g., migrating from US East 1 to US East 2).
- Pipeline Adaptation & Performance Tuning: Adapt existing data pipelines to target Snowflake environments while optimizing SQL queries (utilizing CTEs, window functions, and complex joins) to ensure high performance and data reliability.
- Workflow Scheduling & Monitoring: Manage, test, and debug DAGs (Directed Acyclic Graphs) and workflow scheduling within Apache Airflow.
- Testing & Quality Assurance: Implement testing strategies and conduct hands-on code debugging to guarantee data quality and consistency throughout the platform modernization.
Must-Have Skills
- Industry Experience: Minimum 2+ years of hands-on data engineering experience working with large-scale datasets, Apache Airflow, and Apache Spark.
- Core Languages & SQL: Strong software engineering fundamentals with hands-on Python development experience and advanced SQL skills (complex joins, CTEs, window functions, and query tuning).
- Data Warehousing & Modeling: Proven experience with Snowflake data modeling and schema architecture.
- Data Processing & Orchestration: Direct experience building and testing pipelines using Apache Airflow, Apache Kafka, and Apache Spark / PySpark.
- Data Formats & Cloud Storage: Expertise working with Apache Iceberg and Apache Parquet data formats, alongside AWS S3 (data lakes, bucket partitioning, and lifecycle policies).
- Testing & Debugging: Ability to define testing strategies and independently debug complex distributed data pipelines.
- Communication & Autonomy: Strong communication skills with a proven track record of working independently in a fast-paced environment.
- AWS WorkSpace Requirement: This role requires the use of a client-provisioned AWS WorkSpace. Candidates must demonstrate good connectivity to an AWS WorkSpace region by completing the connectivity test. Please note: You will be required to submit a screenshot of these results as supporting evidence with your application.
Nice-to-Have Skills
- Snowflake Migration: Experience with enterprise Snowflake migrations (warehouse modernization, cost and performance tuning).
- Airflow Migration: Direct experience with Apache Airflow platform migrations (version upgrades, executor changes, or platform moves).
- AI Tooling: Hands-on experience using AI-assisted coding/development tools to accelerate workflow velocity.
Time Zone & Collaboration The role is fully remote, with a strong preference for candidates located in the EMEA (Europe, Middle East, Africa) or APAC (Asia-Pacific) regions. Time zone coverage is required until at least 12:00 PM PT (Pacific Time) to ensure seamless overlap with the core engineering team. Language All interviews, documentation, and daily communication will be in English. #LI
Job details
- Published
- October 20, 2026
- Last checked
- October 29, 2026
- Job source
- breezy
- Workplace
- Remote · Bengaluru, IN
- First seen
- October 20, 2026
Skills mentioned in this job
LiftmyCV exclusive data
In All Media Inc hiring intelligence
In All Media Inc currently has 22 active jobs tracked by LiftmyCV. 8 new jobs in the past 7 days.
Verified October 29, 2026
Active openings
22
Currently tracked by LiftmyCV
New in 7 days
8
21 new jobs in the past 30 days
Published salaries
—
Not published by this employer yet
Average opening age
13 days
Across 22 active openings
Workplace breakdown
Hiring countries
Top hiring cities
Most in-demand roles
- • Salesforce Developer
- • 2130 Senior Backend Engineer - Payments Infrastructure
- • 2131 Sr Business Analyst - Salesforce / Enterprsie Platforms
- • 2132 Quality Assurance Engineer - Manual & API
- • 2135 Technical Lead - Salesforce & AI Agents
- • 2136 Product UX Designer - Platform & Workflows
Frequently requested skills
As of November 18, 2026
Hiring insights calculated from active jobs tracked by LiftmyCV.
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at In All Media Inc
Similar jobs from this company
- Back-End Data EngineerIn All Media IncBrasil / Argentina / Ecuador / PeruRemote
- Data Engineer (Salesforce Focus) 2147In All Media IncColombia / Costa Rica / Argentina / Peru / NicaraguaRemote
- Senior Salesforce Developer (Revenue Cloud / CPQ)In All Media IncPERemote
- Mid-Level Backend Engineer (Java/Integration)In All Media IncARRemote
- Sr Full Stack Engineer - AI AgenticIn All Media IncParamaribo, SRRemote
- Data Platform Engineer (2137)In All Media IncBogota, CORemote
Across the market
Similar jobs from other companies
Related job searches
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.