JobMatchApply
Back to results
TT

Member of Technical Staff, ML Systems

True Talent Solutions Partners · Menlo Park

Visa sponsored On-site / hybridData Science / ML Today

Is it worth applying?

AI checks visa and location, seniority and red flags, not just keywords.

??/100
Sign in to score

AI scoring needs a free account: you get 3 free AI scores after signing in.

About the job

Skills mentioned in this posting (5)

AIMachine LearningDistributed SystemsDeep LearningLLMs

Sign in and add your skills to see which ones you're missing.

ABOUT THE ROLE Join an AI company building high-performance training and inference systems for image, video, and world-model workloads. You will improve speed and efficiency across GPU kernels, distributed engines, and multi-node systems. WHAT YOU'LL DO - Optimize system and GPU performance for training and inference workloads. - Profile bottlenecks across kernels, memory, systems, and clusters using Nsight and related tools. - Implement low-level optimizations with CUDA and Triton. - Design and improve distributed training and inference engines for diffusion models. - Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, RoCE, and disaggregated serving. - Build benchmarking and regression tools to preserve performance gains in production. - Co-design kernels, runtimes, and models with hardware capabilities in mind. WHAT WE'RE LOOKING FOR - Two or more years of experience with deep learning training or inference systems, distributed systems, or related ML systems work. - At least one year of recent, hands-on ML systems or GPU performance experience. - Experience authoring core features in an inference or training framework, such as vLLM, SGLang, TensorRT-LLM, or Megatron, rather than focusing only on deployment or integration. - Direct experience writing CUDA, CUTLASS, Triton, or PTX kernels on NVIDIA GPUs. - Strong machine learning and computer science fundamentals, with a degree in computer science or a related quantitative field. - Experience improving inference or training performance, including GPU kernels, runtimes, or distributed execution; experience with diffusion, video, image, or multimodal workloads is relevant. COMPENSATION & BENEFITS Base salary: $180,000 to $260,000 annually. Visa sponsorship is available. LOCATION On-site in Menlo Park, California, United States.