About the role
Nous is seeking a data engineer to build and own data pipelines powering analytics and model training. The role focuses on long-horizon, agentic data at scale, turning millions of tool-conditioned interactions into reliable datasets for the company.
The role requires strong SQL, Python, and data modeling skills, plus production experience with orchestration tools. Open to any time zone with overlap with US hours, remote work possible.
Build, operate, and continuously improve the data pipelines that feed analytics and model training. Deliver reliable internal analytics so teams across Nous can make decisions on their own data. Wrangle long-horizon agentic data into structured, well-documented datasets ready for analysis and training. Choose ETL/ELT approaches based on destination capabilities, reproducibility, latency, and cost, and explain the tradeoffs behind each choice. Own pipeline operations in production, including failures, re-runs, and backfills, and debug issues across jobs, storage, permissions, and downstream consumers. Design and evolve schemas, storage formats, and data models as needs change. Build memory-efficient processing that scales, using streaming and partitioning, and recognize when a workload has outgrown a single machine. Communicate clearly about data location, lineage, quality, limitations, and fitness for use to engineers and non-engineers alike. 4+ years of data engineering experience building and operating production data pipelines. Strong fundamentals in SQL, data modeling, and schema design and evolution. Deep understanding of storage formats and database types and their use cases. Working model of the data stack across ingestion, storage, transformation, orchestration, cataloging, and serving. Strong Python, plus shell skills for batch and storage operations. Hands-on cloud experience with object storage, batch compute, and identity and access management. Production experience with a workflow orchestrator (Airflow, Dagster, Prefect, or equivalent). An instinct for data quality: data must be good, not just pipelines running. Experience with AI-assisted development tools and disciplined reviews.