BY Recruiting

BY Recruiting

Senior Backend Engineer

LiteLLM
San Francisco, CADirect HireOn-site
Apply Now

About the role

Seeking a Backend Engineer with 3+ years of experience to own critical guardrails and observability tooling. The role involves building for massive scale and engaging directly with developers at large enterprise customers to solve technical challenges.

Key Responsibilities:
- Build and scale core product infrastructure for 1B+ monthly requests with world-class performance and reliability
- Own backend code for guardrails and logging to ensure all calls are traceable and errors are properly surfaced
- Enhance observability stack to handle high-volume traffic with minimal latency
- Develop in Python and/or Rust to build CPU-level guardrails against common attacks
- Engage directly with developers at large enterprise customers several times per week to solve their challenges

Requirements

3+ years of backend software engineering experience
Experience building scalable backend systems
Ability to work with high-volume traffic and performance requirements
Comfortable engaging directly with enterprise customers

Preferred:
Experience at a high-growth startup
Background working with large-scale distributed systems