About the role
Join EPAM Malaysia as a Senior AI Engineer and lead the creation of cutting-edge AI solutions that solve complex, real-world problems. You’ll design, build and deploy scalable agentic AI systems, from chat interfaces to multi-agent backends, using modern agent frameworks and cloud platforms. Working closely with clients and cross-functional teams, you’ll turn business challenges into production-ready AI solutions and help shape how our teams build with AI.
Responsibilities
- Design and implement end-to-end AI systems, including chat UI, multi-agent workflows, RAG integration and tool-calling architectures
- Apply context engineering to agents, covering system prompts, memory, agent tools and structured inputs
- Design AI solutions that balance latency, cost and quality, making informed trade-offs to meet business and performance requirements
- Develop the services required for AI solutions, including frontend and backend services, and APIs for agent serving, prompt routing, response handling and tool execution
- Implement security measures and LLMOps practices, including observability, logging, tracing, guardrails and quality monitoring
- Design and run evaluation frameworks for AI solutions, including test datasets, automated scoring, and metrics for accuracy, groundedness, latency and cost
- Translate business requirements into robust system designs, then integrate and deploy AI solutions into enterprise environments through CI/CD pipelines for safe, repeatable releases
- Lead technical design discussions, review code and mentor engineers on AI engineering best practices
Requirements
- 5+ years of software engineering experience, including at least 2 years building AI/LLM solutions with at least one delivered to production, and a Bachelor’s or Master’s degree in Computer Science or a related field
- Demonstrated expertise in building LLM-based solutions on at least one cloud AI platform (e.g., AWS Bedrock, Azure AI Foundry, Google Vertex AI) using at least one agent framework (e.g., LangGraph, CrewAI, Microsoft Agent Framework, Google ADK), including prompt engineering, context engineering, multi-agent architectures and tool integration via MCP (Model Context Protocol)
- Proficient in Python, with experience in backend development, REST APIs and SQL or NoSQL databases; working knowledge of TypeScript and frontend frameworks (e.g., React) is a plus
- Proficient in RAG implementation, including chunking strategy, embeddings, optimizing retrieval efficiency and accuracy, and working with vector databases (e.g., Pinecone, Qdrant, pgvector, Azure AI Search)
- Familiarity with LLM evaluation and metrics (e.g., RAGAS, DeepEval), observability and tracing tools (e.g., LangSmith, Langfuse), AI guardrails and responsible AI best practices
- Familiarity with CI/CD pipelines (e.g., GitHub Actions, Azure DevOps), containerization (e.g., Docker, Kubernetes), DevOps tooling and enterprise-scale architectures
- Experience leading technical design decisions, conducting code reviews and mentoring engineers
- Strong analytical thinker and communicator, results-driven, customer-focused and actively following new AI advancements and industry best practices
Nice to have
- Client-facing consulting experience, such as pre-sales, solution proposals or presenting technical designs to stakeholders
- Experience fine-tuning LLMs and building automated ML pipelines for training, testing, deployment and monitoring, including GPU workload orchestration and cost optimization
- Relevant cloud AI certifications (AWS, Azure or Google Cloud)
Benefits
By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us