Senior LLM Infra & Reliability Lead

Job Description

JPMorgan Chase & Co. in the United Kingdom seeks a Lead Software Engineer to design and operate scalable AI infrastructure for reliable LLM serving at production scale.

This role emphasizes cloud-based deployments, Kubernetes, observability, and cost aware performance tuning. You will own reliability, performance, and cost efficiency of the LLM platform end-to-end, manage diverse hosting environments including EKS, SageMaker, and on prem GPU clusters, and lead incident response with strong