About the role
Preply’s GenAI Platform Team seeks a Senior ML Platform Engineer to design and scale production GenAI workloads, expanding the GenAI Platform and delivering self-service capabilities. You will write production code, shape platform abstractions, and partner across Applied Science, Data, Security and Engineering.
This hands-on role influences architecture, governance, and platform evolution, ensuring performance, reliability, and safe deployment across teams.
Architect unified gateway with automated routing and quota controls across model vendors. Improve system efficiency with dynamic traffic management and cost allocation controls. Establish evaluation mechanisms for high-precision, safe model outputs. Deliver observability with tracing, telemetry, and cost analytics. Standardize prompt engineering workflows with CI/CD integrations. Collaborate with Security and Privacy teams to enforce policies. Maintain incident response and postmortems for GenAI stacks. 5+ years designing, building and operating backend services or ML infra for production traffic. Strong Python and API/SDK development experience. Hands-on GenAI experience including vector retrieval and external APIs. Knowledge of distributed systems, caching, concurrency and rate limiting. Experience with at least one major cloud provider (preferably AWS). Hands-on with tracing, telemetry, SLOs and incident triage. English C1+ and willingness to join paid on-call rotation. Lesson budget Learning & Development budget Equity Relocation package Mental health support Gym access Global impact