In short
Senior Data Engineer at Alpha10X in Doha designs and runs scalable ETL pipelines in Databricks and Azure Data Factory on an Azure-hosted platform, onboards client data into the ALPHA10X Ledger, extends its ontology/data model, and enforces data quality and residency to make data ready for AI workflows, working with teams in France and Doha.
About the role
Alpha10X in Doha is seeking a Senior Data Engineer to own the data side of client engagements and integrate client data into the ALPHA10X Ledger. You will extend the ontology and ensure data readiness for AI workflows.
You design and run pipelines in Databricks and Azure Data Factory on our Azure-hosted platform, maintain CI/CD, and enforce data quality and residency requirements in collaboration with teams in France and Doha.
Design, build and run scalable ETL pipelines in Databricks and Azure Data Factory. Onboard client data with contracts and secure access. Extend ontology and data model to cover new sources. Implement entity resolution and data quality checks. Document pipelines and runbooks for operability. Collaborate with client teams and internal data experts. Master’s degree in computer science or engineering. 7+ years of data engineering experience. Excellent written and spoken English. Proficient in PySpark, SQL and Python. Production-grade data processing at terabyte scale. Experience with Git and Azure cloud services. Familiar with document and graph DBs (CosmosDB, MongoDB, Neo4J). Knowledge of SQL and NoSQL internals.Requirements
- Master's degree in computer science or engineering
- 7+ years of data engineering experience
- Excellent written and spoken English
- Proficient in PySpark, SQL and Python
- Production-grade data processing at terabyte scale
- Experience with Git and Azure cloud services