About the role
You will build distributed platform systems that ingest high-volume structured and unstructured data from cloud storage, databases, and file sources. You will optimize streaming workloads for throughput, cost, latency, reliability, and scale; build ingestion observability; apply ML techniques; and collaborate on RAG, AI-agent, and Agentic SDK capabilities.
Responsibilities
- Build distributed infrastructure for streaming ingestion, incremental processing, and replication
- Reduce ingestion latency and cost while increasing throughput
- Design and optimize streaming and distributed workloads
- Apply ML techniques to optimize streaming workloads
- Build customer-facing and internal monitoring and observability capabilities
- Collaborate on RAG and AI-agent use cases
- Build Agentic SDKs with strong evaluations
Requirements
- 5+ years of production coding experience in Java, Scala, Go, C++, or Python
- Experience architecting, developing, and deploying large-scale distributed and asynchronous systems
- Experience with distributed systems, streaming, Spark, databases, data processing, or change data capture
- Experience operating systems where scale, throughput, latency, reliability, and cost matter
- Experience using AI tools and defining effective evaluations
Benefits
- Annual performance bonus eligibility
- Equity eligibility
Requirements
- 5+ years of production coding experience in Java, Scala, Go, C++, or Python
- Experience architecting, developing, and deploying large-scale distributed and asynchronous systems
- Experience with distributed systems, streaming, Spark, databases, data processing, or change data capture
- Experience operating systems where scale, throughput, latency, reliability, and cost matter
- Experience using AI tools and defining effective evaluations