About the role
Requirements:
- 13+ years of engineering experience, primarily in data engineering in an agile production environment.
- High proficiency in using Python or Scala, Spark, Hadoop platforms and tools (Hive, Impala, Oozie, Airflow, NiFi, Scoop), and SQL to build Big Data products and platforms.
- Extensive experience with Databricks, Spark, PySpark, or Java + Spark processing engine.
- Proficiency in at least one modern programming language such as Python, Java, or Scala.
- Strong computer science fundamentals in object-oriented design, data structures, algorithm design, problem solving, and complexity analysis.
- Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it.
- Working knowledge of software development engineering paradigms along with data engineering.
- Relational databases as well as NoSQL experience,
- Cloud technologies like Databricks/AWS/Azure (good to have).
- Basic shell scripting and knowledge of Linux/Unix systems.
- Experience in designing and developing software at scale.
- Strong written and verbal English communication skills.
- Motivation, creativity, self-direction, and desire to thrive on small project teams.
- Superior academic record with a degree in computer science or a related technical field.
Requirements
- 13+ years of engineering experience, primarily in data engineering in an agile production environment.
- High proficiency in using Python or Scala, Spark, Hadoop platforms and tools (Hive, Impala, Oozie, Airflow, NiFi, Scoop), and SQL to build Big Data products and platforms.
- Extensive experience with Databricks, Spark, PySpark, or Java + Spark processing engine.
- Proficiency in at least one modern programming language such as Python, Java, or Scala.
- Strong computer science fundamentals in object-oriented design, data structures, algorithm design, problem solving, and complexity analysis.
- Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it.