LiftmyCVLiftmyCV
TT

Machine Learning Infrastructure Engineer

TWT Trend Micro IncorporatedOn-siteTaipei, TW
AI job summary

Trend Micro is seeking a Machine Learning Infrastructure Engineer to join their team. The role involves building a GPU-accelerated platform for large language models to support various AI products at an enterprise level. Key responsibilities include managing Kubernetes clusters, optimizing GPU inference, and implementing Infrastructure as Code practices. Applicants should be skilled in Terraform and monitoring tools, with a focus on performance metrics. Candidates with bonus skills in fine-tuning workflows and CI/CD pipelines will be given preference. This position is based in Taipei.

Job description

Join Trend ‧ Join New Generation

趨勢科技 - 全球雲端資安領航者 / 全亞洲最大軟體公司 / 企業版圖橫跨五大洲 / 趨勢全球研發基地在台灣

===============================================================

About the Role

We are building a production-grade, GPU-accelerated LLM serving platform that powers multiple AI products at enterprise scale. You will be responsible for designing, building, and operating the infrastructure that serves large language models — from raw Kubernetes cluster management to multi-GPU inference optimization and autoscaling. Required Qualifications

Model Serving & Inference

  • Operate multi-model LLM serving infrastructure
  • Tune autoscaling policies to balance GPU cost and latency SLAs

Kubernetes & GPU Infrastructure

  • Operate production K8s clusters with NVIDIA GPU nodes
  • Handle GPU node lifecycle: NVIDIA driver setup

Infrastructure as Code

  • Write and maintain Terraform/Terragrunt modules for AWS/GCP cloud
  • Package platform components and model deployments as Helm charts
  • Manage multi-environment configurations

Observability & Performance

  • Maintain monitoring stack: Prometheus, Grafana,
  • Build dashboards for GPU utilization, KV cache occupancy, TTFT/ITL latency, and cost per token
  • Set up alerting for SLA violations and OOM events

Bonus Skills

These are not required, but candidates with these skills will stand out.

  • LoRA / PEFT fine-tuning workflows
  • MLflow for experiment tracking, model registry, and automated adapter deployment
  • Experience building LoRA adapter CI/CD pipelines (training → registry → serving)
  • Experience with alternative inference frameworks such as SGLang or NVIDIA NIM, including deep Parameter Tuning for Continuous Batching, KV Cache management, and Speculative Decoding.

=============================================================== 連結智慧 守護世界 --- Connected Intelligence for Securing a Connected World

Job details

Published
September 29, 2026
Job source
myworkdayjobs
Workplace
On-site · Taipei, TW
First seen
September 29, 2026
AI match explained

See how well you match this job

Log in or sign up and Eva will compare your profile with this role, explain your strengths and show what to improve.

Sign up to see your matchAlready have an account? Log in

More at TWT Trend Micro Incorporated

Similar jobs from this company

None listed.

Across the market

Similar jobs from other companies

Third-party content disclaimer

Full job descriptions are sourced directly from third-party applicant tracking systems (ATS), job boards, recruitment platforms, and employer career pages.

LiftmyCV does not claim ownership of this content or guarantee its accuracy or current availability. All original content is the intellectual property of the respective employers or other rights holders.

LiftmyCV hiring intelligence, availability checks, and related-job recommendations are generated from LiftmyCV data and public sources.

If you prefer, you may apply directly via the original listing for transparency.