Trend Micro

Staff/Sr. ML Infrastructure / Platform Engineer

Trend Micro  •  Taipei, TW (Onsite)  •  5 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Join Trend ‧ Join New Generation

趨勢科技 - 全球雲端資安領航者 / 全亞洲最大軟體公司 / 企業版圖橫跨五大洲 / 趨勢全球研發基地在台灣

About the Role

We are building a production-grade, GPU-accelerated LLM serving platform that powers multiple AI products at enterprise scale. You will be responsible for designing, building, and operating the infrastructure that serves large language models — from raw Kubernetes cluster management to multi-GPU inference optimization and autoscaling.

Required Qualifications

Model Serving & Inference

  • Operate multi-model LLM serving infrastructure
  • Tune autoscaling policies to balance GPU cost and latency SLAs

Kubernetes & GPU Infrastructure

  • Operate production K8s clusters with NVIDIA GPU nodes
  • Handle GPU node lifecycle: NVIDIA driver setup

Infrastructure as Code

  • Write and maintain Terraform/Terragrunt modules for AWS/GCP cloud
  • Package platform components and model deployments as Helm charts
  • Manage multi-environment configurations

Observability & Performance

  • Maintain monitoring stack: Prometheus, Grafana,
  • Build dashboards for GPU utilization, KV cache occupancy, TTFT/ITL latency, and cost per token
  • Set up alerting for SLA violations and OOM events

Bonus Skills

These are not required, but candidates with these skills will stand out.

  • LoRA / PEFT fine-tuning workflows
  • MLflow for experiment tracking, model registry, and automated adapter deployment
  • Experience building LoRA adapter CI/CD pipelines (training → registry → serving)
  • Experience with alternative inference frameworks such as SGLang or NVIDIA NIM, including deep Parameter Tuning for Continuous Batching, KV Cache management, and Speculative Decoding.

連結智慧 守護世界 --- Connected Intelligence for Securing a Connected World

Trend Micro

About Trend Micro

Trend Micro, a global cybersecurity leader, helps make the world safe for exchanging digital information across enterprises, governments, and consumers.

Fueled by decades of security expertise and relentless innovation, Trend leverages the full power of AI to protect over 500,000 enterprises and millions of individuals across clouds, networks, endpoints, and devices.

At the core of this protection is Trend Vision One™, the only AI-powered enterprise cybersecurity platform that centralizes cyber risk exposure management and security operations, delivering robust layered protection across on-premises, hybrid, and multi-cloud environments.

This platform is fueled by world-class threat intelligence and insights that help defend organizations from hundreds of millions of threats every day.

With 7,000 employees across 70 countries, Trend empowers security leaders to stay ahead of threats, driving proactive security outcomes across the entire attack surface. This includes critical environments like AWS, Google, Microsoft, and NVIDIA.

Proactive security starts here.

Industry
IT & Software
Company Size
5,001-10,000 employees
Headquarters
Tokyo, JP
Year Founded
Unknown
Social Media