About the role
You will design and operate data-lake infrastructure, ingestion pipelines, validation checks, and lifecycle policies for vehicle sensor data. You will create dataset-curation, pseudo-labeling, visualization, and dashboard tooling; connect logs to model failures; define data contracts; and partner with autonomy engineers on training and evaluation data.
Responsibilities
- Design and organize the data lake, schemas, partitioning strategy, and metadata indexing
- Build and maintain pipelines that ingest sensor logs into cloud storage
- Implement data validation, integrity checks, retention, tiering, and lifecycle policies
- Build dataset-curation and pseudo-labeling tooling
- Deploy and maintain log-review, annotation-QA, and autonomy-debugging visualization tools
- Build data-coverage dashboards and custom visualization panels
- Establish data contracts and contribute to the data roadmap
Requirements
- Bachelor’s degree with 4+ years of data engineering experience or Master’s degree with 2+ years
- Python
- SQL
- Cloud data infrastructure
- AWS S3, Glue, Athena, or Redshift
- Terraform or CloudFormation
- Data partitioning
- Columnar storage formats
- Parquet or ORC
- Time-series and binary-data pipelines
- Data monitoring, validation, and lineage tracking
- U.S. citizenship
Benefits
- Bonus component
- Stock options
- 100% paid medical, dental, and vision premiums
- 401(k) plan with 6% employer match
- Flexible schedule
- Generous paid vacation from the start date
- Company-wide holiday office closures
- AD&D and life insurance
Requirements
- Bachelor’s degree with 4+ years of data engineering experience or Master’s degree with 2+ years
- Python
- SQL
- Cloud data infrastructure
- AWS S3, Glue, Athena, or Redshift
- Terraform or CloudFormation