About the role
Caixa Mágica Software is seeking a Senior Data Engineer to support the Data Hub Chapter. You will analyze, design, implement and test Data Warehouse and data platform solutions, focusing on ingestion, integration and quality.
The role requires expertise in Big Data, ETL, and data governance, with strong Java/Scala/Python development and experience across Spark, Hive, and Hadoop ecosystems. Portuguese and English fluency required.
Analyze, plan, implement and technically test Data Warehouse solutions and data platform initiatives. Develop and maintain raw data ingestion pipelines for Data Lake and related environments. Ensure data accessibility, referencing, governance and quality across enterprise platforms. Design and implement ETL processes and data integration solutions. Collaborate with Business Areas and Functional Teams to gather requirements and define technical solutions. Participate in certification, quality assurance and User Acceptance Testing (UAT) activities. Document technical analyses, implemented solutions, testing activities and project decisions. Ensure industrialization, supervision and production integration of data solutions. Propose improvements and optimizations to data platforms, tools and processes. Contribute to Agile project delivery and continuous improvement initiatives. Bachelor's or Master's Degree in Computer Engineering, Information Technology or a related field. More than 6 years of experience in Data Engineering and Data Warehouse environments. Minimum 4 years of experience in functional and technical analysis and corporate data model design. Strong expertise in Big Data ecosystems and enterprise data integration solutions. Experience with SQL and T-SQL development. Experience with SQL Server Analysis Services (SSAS). Experience with Microsoft BI tools and Power BI. Experience with Data Warehouse architecture and development. Experience with ETL development and automation. Experience with the Hadoop ecosystem. Experience with Kafka, NiFi and Access & Exchange Layer technologies. Experience with Java, Scala and Python development. Experience with Apache Spark and Hive. Experience with SQL and NoSQL database technologies. Experience with Bash scripting and automation. Experience with DevOps practices and Continuous Integration environments. Experience with Jira, Confluence and Draw.io. Proficiency in Microsoft Office tools (Excel, Outlook, Word and PowerPoint). Experience with Agile methodologies and project environments. Experience in Banking environments, particularly Consumer Credit, is considered a strong advantage. Strong focus on data quality, governance, scalability and operational excellence. Strong communication, organizational, documentation and presentation skills. Ability to gather requirements and lead meetings. Health and Life Insurance Tech equipment and smartphone Training in latest technologies Team events