About the role
Our client, a data-driven startup focused on revolutionizing agricultural technology, is seeking a Senior Software Engineer with strong Python and data engineering skills. This position is pivotal in developing and maintaining the data pipelines and backend systems that process and analyze vast amounts of agricultural data. While the role is advertised in Paarl, Western Cape, it offers a fully remote working arrangement within South Africa. You will be responsible for building scalable data solutions, implementing robust ETL processes, and collaborating with data scientists and domain experts to drive insights. The ideal candidate is a proactive problem-solver with a deep understanding of data management, Python development, and cloud-based data platforms. This is an exceptional opportunity to make a significant impact in a growing company at the intersection of technology and agriculture.
Key Responsibilities- Design, develop, and maintain scalable data pipelines using Python and relevant data processing frameworks.
- Implement Extract, Transform, Load (ETL) processes for various data sources.
- Build and optimize data warehousing solutions and data lakes.
- Collaborate with data scientists to provide clean, reliable data for analysis and model training.
- Develop backend services and APIs to support data access and application functionality.
- Write clean, efficient, and well-documented Python code.
- Work with cloud platforms (e.g., AWS, Azure, GCP) for data storage and processing.
- Implement monitoring and alerting for data pipelines and infrastructure.
- Ensure data quality, integrity, and security across all data systems.
- Participate in code reviews and contribute to architectural decisions.
- Troubleshoot and resolve issues related to data pipelines and backend systems.
- Stay current with emerging data engineering technologies and best practices.
- Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
- Proven experience as a Software Engineer with a strong focus on Python and data engineering.
- Expertise in Python programming and relevant libraries (e.g., Pandas, Num Py, SQLAlchemy).
- Experience with building and managing data pipelines (e.g., using Airflow, Luigi).
- Proficiency in SQL and experience with relational databases (e.g., Postgre SQL, My SQL).
- Familiarity with big data technologies (e.g., Spark) and No SQL databases is a plus.
- Experience with cloud platforms (AWS, Azure, GCP) and their data services.
- Understanding of data warehousing concepts and best practices.
- Experience with containerization (Docker) and CI/CD pipelines is advantageous.
- Strong analytical, problem-solving, and debugging skills.
- Excellent communication and collaboration abilities, especially in a remote setting.
- Ability to work independently and manage time effectively.
- Previous experience in the South African tech industry is preferred.
- Our client offers a competitive salary, performance-based bonuses, and a flexible remote work environment within South Africa.
- Employees benefit from opportunities for professional development, challenging projects in a growing industry, and a collaborative team culture. Be part of an innovative Agri Tech solution from anywhere in the country!