About the role
Job Title: Specialist Software Engineer Big Data (Java, Spark & Scala)
Job Description
The Specialist Software Engineer Big Data (Java, Spark & Scala) designs, develops, tests, and maintains high-quality big data solutions using modern engineering practices. This role focuses on building robust data pipelines and services, delivering clean and reusable code, and contributing across the full Software Development Lifecycle within an Agile environment. You will collaborate closely with cross-functional and distributed teams, support existing data models and standards, and help ensure reliable, scalable, and secure access to data.
Responsibilities
- Design, develop, and implement code and test case scenarios that follow software craftsmanship principles and meet defined acceptance criteria.
- Deliver features and enhancements across all phases of the Software Development Lifecycle (SDLC) in alignment with Agile and IT craftsmanship principles.
- Participate actively in daily meetings, Agile ceremonies, and chapter meetings, sharing updates and collaborating on solutions.
- Produce high-quality, clean, and reusable code and design components that support long-term maintainability and scalability.
- Collaborate with other development teams to define, implement, and maintain APIs and rules for secure and efficient data access.
- Perform release validations to ensure bug-free deployments,and prepare clear test and defect reports.
- Contribute to the development of scripts and configuration for quality assurance and automation frameworks.
- Run and maintain automated test suites under the guidance of engineers, ensuring continuous quality coverage.
- Support and maintain existing data models, data dictionaries, data pipeline standards, and the storage of source, process, and consumer metadata.
- Complete assigned learning paths to stay current with technologies and practices,and apply new knowledge to ongoing work.
- Work effectively with onshore and offshore teams in a multicultural environment, ensuring clear and professional communication.
- Adapt to changing requirements and priorities, demonstrating proactive problem-solving and self-driven execution.
Essential Skills
- 4+ years of experience as a software engineer with a focus on big data solutions.
- Intermediate-level proficiency in Java for big data applications.
- Intermediate-level experience working with big data technologies.
- Intermediate-level experience with Docker and Kubernetes for containerization and orchestration.
- Intermediate-level proficiency in Spring MVC for building Java-based applications.
- Advanced-level experience in designing and implementing REST services.
- Intermediate-level proficiency in PL/SQL for database interactions and data processing.
- Strong experience in testing, including unit testing and writing automated test scripts.
- Advanced-level experience with CI/CD pipelines for automated build, test, and deployment processes.
- Hands-on experience working within Agile methodologies and participating in Agile ceremonies.
- Practical experience with PySpark for building and managing big data processing workflows.
- Experience using Databricks for collaborative big data and analytics development.
- Demonstrated communication skills, both spoken and written, to work effectively with onshore and offshore teams in a multicultural environment.
- Ability to learn quickly, adapt to change, and work in a proactive and self-driven manner.
- Strong analytical and numerical skills to interpret data and solve complex technical problems.
- A strong sense of quality and client orientation when delivering solutions.
- Flexibility to work from different locations and at different times as required by project needs.
Additional Skills & Qualifications
- Experience with UX concepts and collaboration with user experience teams is an added advantage.
- Familiarity with JIRA or similar tools for issue tracking and Agile project management is an added advantage.
- Experience range of approximately 4 to 7 years working with PySpark, Databricks, and big data technologies.
- Comfort working with data dictionaries, data pipeline standards, and metadata management.
- Interest in continuous learning and following structured learning paths to enhance technical and professional skills.
JOB POSTING DISCLAIMER
Unless otherwise notified, the following terms apply to all job postings. This list is not exhaustive. If you have any questions regarding job postings, please contact the human resources department of Allegis Global Solutions (India) Private Limited (“Company” or “we”, “us”, or “our”) at info.agsapac@allegisglobalsolutions.com .
- We are an equal opportunity employer and value diversity. All qualified applicants will be considered for employment without discrimination based on race, colour, religion, sex, gender, sexual orientation, pregnancy, childbirth or related medical conditions, age, disability, military or veteran status, or any other protected characteristic under applicable law.
- While we endeavour to keep job postings accurate and up to date, positions may be modified, filled, placed on hold, or withdrawn at any time without prior notice.
- Submission of an application does not guarantee employment, an interview, or an offer. All hiring decisions are made at the sole discretion of the Company.
- Job postings may only specify that applicants must be authorised to work for any employer in India.
- Job posting will not contain any client confidential information.
- Please apply only through the official application process mentioned in the job posting. We do not accept applications sent through personal email addresses.
- By submitting your application, you consent to the collection, storage, and processing of your personal data in accordance with our Privacy Notice. Your information will be used solely for recruitment purposes and handled in compliance with applicable data protection laws.
- We will never request payment at any stage of the recruitment process. All official communications will be sent only from our Company’s authorised domain. If you suspect fraudulent activity, please report it immediately at apac.reportfraud@allegisgroup.com.
- We are committed to an inclusive recruitment process. Applicants requiring reasonable accommodation due to a disability may contact the Company’s human resources department at the email address set out above.
- Our job portal may contain links to third-party websites or application platforms. We are not responsible for the content, security, or privacy practices of such external sites.
- You confirm that all information provided in your application, curriculum vitae, and supporting documents is complete, accurate, and truthful. Any misrepresentation may result in disqualification from the recruitment process.