About the role
Cognizant is seeking a Senior Data Engineer (Databricks & AI Solutions) to build, operate, and support modern data platforms and AI-enabled data engineering solutions. You will work with architects, data teams, and stakeholders to translate requirements into production-ready data products, ensuring quality, observability, and reliability.
The role is hybrid in São Paulo, Brazil, and requires 4+ years in Data Engineering with strong Databricks, Spark, PySpark, SQL, and Python expertise.
Design, develop, and deploy scalable data pipelines using Databricks, PySpark, SQL, and cloud-native technologies. Implement and support data quality, lineage, governance, and validation processes across enterprise data products. Operate and continuously optimize AI-assisted and agent-based data engineering solutions to improve delivery efficiency and platform performance. Lead troubleshooting, root cause analysis, and support activities for data pipelines, platforms, and production incidents. Maintain technical documentation, knowledge repositories, and operational runbooks while collaborating with cross-functional teams throughout the data product lifecycle. 4+ years of hands-on experience in Data Engineering. Strong experience with Databricks, Apache Spark, PySpark, SQL, and Python. Experience building and maintaining ETL/ELT pipelines in enterprise environments. Experience working with cloud platforms, preferably Microsoft Azure. Knowledge of Delta Lake, Delta Live Tables, and Unity Catalog. Experience implementing data quality, reconciliation, and validation processes. Experience with Git-based CI/CD practices for data engineering solutions. Exposure to AI-assisted development tools, code generation platforms, or GenAI-enabled engineering workflows. Experience supporting production environments, incident management, and root cause analysis. Strong analytical, troubleshooting, and problem-solving skills. Advanced English proficiency. Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.