Machine Learning Infrastructure Engineer
Trend Micro is seeking a Machine Learning Infrastructure Engineer to join their team. The role involves building a GPU-accelerated platform for large language models to support various AI products at an enterprise level. Key responsibilities include managing Kubernetes clusters, optimizing GPU inference, and implementing Infrastructure as Code practices. Applicants should be skilled in Terraform and monitoring tools, with a focus on performance metrics. Candidates with bonus skills in fine-tuning workflows and CI/CD pipelines will be given preference. This position is based in Taipei.
Job description
Join Trend ‧ Join New Generation
趨勢科技 - 全球雲端資安領航者 / 全亞洲最大軟體公司 / 企業版圖橫跨五大洲 / 趨勢全球研發基地在台灣
===============================================================
About the Role
We are building a production-grade, GPU-accelerated LLM serving platform that powers multiple AI products at enterprise scale. You will be responsible for designing, building, and operating the infrastructure that serves large language models — from raw Kubernetes cluster management to multi-GPU inference optimization and autoscaling. Required Qualifications
Model Serving & Inference
- Operate multi-model LLM serving infrastructure
- Tune autoscaling policies to balance GPU cost and latency SLAs
Kubernetes & GPU Infrastructure
- Operate production K8s clusters with NVIDIA GPU nodes
- Handle GPU node lifecycle: NVIDIA driver setup
Infrastructure as Code
- Write and maintain Terraform/Terragrunt modules for AWS/GCP cloud
- Package platform components and model deployments as Helm charts
- Manage multi-environment configurations
Observability & Performance
- Maintain monitoring stack: Prometheus, Grafana,
- Build dashboards for GPU utilization, KV cache occupancy, TTFT/ITL latency, and cost per token
- Set up alerting for SLA violations and OOM events
Bonus Skills
These are not required, but candidates with these skills will stand out.
- LoRA / PEFT fine-tuning workflows
- MLflow for experiment tracking, model registry, and automated adapter deployment
- Experience building LoRA adapter CI/CD pipelines (training → registry → serving)
- Experience with alternative inference frameworks such as SGLang or NVIDIA NIM, including deep Parameter Tuning for Continuous Batching, KV Cache management, and Speculative Decoding.
=============================================================== 連結智慧 守護世界 --- Connected Intelligence for Securing a Connected World
Job details
- Published
- September 29, 2026
- Job source
- myworkdayjobs
- Workplace
- On-site · Taipei, TW
- First seen
- September 29, 2026
See how well you match this job
Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.
Sign up to see your matchAlready have an account? Log inMore at TWT Trend Micro Incorporated
Similar jobs from this company
None listed.
Across the market
Similar jobs from other companies
- Machine Learning Infrastructure EngineerTWT Trend Micro IncorporatedTaipei, TWOn-site
- Machine Learning Infrastructure EngineerPreference ModelSan Francisco, US$160,000 per year
- Machine Learning Infrastructure EngineerWindBorne SystemsRedwood City, US$140,000–$240,000 per year
- Machine Learning Infrastructure EngineerNewsBreakMountain View, USOn-site$125,000–$175,000 per year
- Machine Learning Infrastructure EngineerCharacter.AIRedwood City, CAOn-site
- Machine Learning Infrastructure EngineerMind RoboticsPalo Alto, USHybrid
Third-party content disclaimer
Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.
LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.
LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.
If you prefer, you may apply directly via the original listing for transparency.