Senior Databricks Engineer (ML or Analytics)
Job description
BlueFlag is hiring Senior Databricks Engineers to help Department of Veterans Affairs teams move their data work to a premier data and artificial intelligence (AI) platform built on Databricks in Azure Commercial. The role is hands-on and customer-facing, much like professional services. You will work alongside VA teams to understand their on-premises workloads, rebuild them on Databricks, and teach them to use the platform with confidence. We're hiring for two focus areas. The ML focus helps teams build, deploy, and monitor machine learning models. The Analytics focus helps teams move ETL pipelines and reporting to Databricks. Both need the same foundation: a data engineer who has built production pipelines and enjoys helping customers succeed. You'll join a friendly, collaborative team doing work that makes a real difference for Veterans and their families.
What You'll Do
- Work directly with VA teams to scope use cases, plan migrations, and deliver working solutions on Databricks.
- Assess on-premises workloads (SQL Server, SSIS packages, stored procedures, scheduled jobs) and adapt them to Databricks patterns in Azure Commercial.
- Build and tune pipelines with PySpark, Spark SQL, Delta Lake, Lakeflow, and Azure Data Factory.
- Use Unity Catalog for access, lineage, and sharing, so customer data stays governed as it moves.
- Teach customers through workshops, pairing, and clear documentation so they can own their workloads.
- Package reusable templates and code (Git, CI/CD, Databricks Asset Bundles) that speed up the next migration.
AI / ML focus
- Build end-to-end ML workflows: feature engineering, training, evaluation, MLflow tracking, the Unity Catalog model registry, and model serving.
- Help data scientists move models from local notebooks and on-premises servers into governed, monitored production.
- Support generative AI use cases, such as retrieval-augmented generation (RAG) and agents, alongside predictive models.
Analytics focus
- Convert SSIS and stored procedure ETL into Databricks pipelines, with reconciliation that proves the results match.
- Replace on-premises reporting (SSRS reports, SSAS cubes) with Databricks SQL, AI/BI dashboards, and Power BI.
- Publish reporting data from Databricks SQL warehouses, including semantic models and query performance tuning.
Why Join BlueFlag
At BlueFlag, we're passionate about leveraging cutting-edge technology to make a real difference. You'll be at the forefront of cloud innovation, working on projects that directly impact people's lives. We offer a high-growth, entrepreneurial environment that values fresh ideas and authentic teamwork. If you're ready to take your data engineering career to new heights and contribute to meaningful projects that push the boundaries of technology, we want to hear from you. Join BlueFlag and be part of a team that's shaping the future of cloud solutions!
Job details
- Published
- September 26, 2026
- Job source
- jworkable
- Workplace
- Remote · Pittsburgh, US
- First seen
- September 26, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at BlueFlag LLP
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.