About the role
Essential Requirements
Candidates must demonstrate experience in the following:
- Big data technologies, particularly Hadoop, Spark and Hive
- Apache Spark, including ETL and data aggregation
- Python and PySpark
- Docker and Kubernetes virtualisation/containerisation
- Multiple database technologies, including:
- Oracle
- SQL
- SQLAlchemy
- Alembic
- PostgreSQL
- RDBMS technologies
- API development, including FastAPI
Additional Requirements
Candidates should also demonstrate:
- Strong experience with Git or a similar version-control system
- Experience building data pipelines into AWS environments
- Ability to produce testable, maintainable code
- Experience creating and executing unit tests
- Ability to support performance and system testing
- Experience with cloud architectures, particularly AWS and/or Azure
Desirable Experience
Additional value will be given to candidates with experience in:
- Leading, mentoring or supporting junior team members
- LLMOps and MLOps
- Real-time architectures
- Data monitoring and data quality
- Machine Learning algorithms
- Apache Airflow
- Data lineage
- A strong, results-oriented approach
Technical Environment
The profile is particularly relevant to Big Data Engineers working with technologies such as:
Python | PySpark | Spark | Hadoop | Hive | AWS | Azure | Docker | Kubernetes | PostgreSQL | Oracle | SQL | SQLAlchemy | Alembic | FastAPI | Git | Airflow | MLOps | LLMOps | Machine Learning
Working Arrangements
- Hybrid working model with 50–60% remote working
- Office days determined by the manager
- VDAB equipment must be used
- Timesheets are required
- No standard night, weekend or on-call work is specified
- Monthly invoicing/payment following approval of the relevant timeshee