About the role
Softgile is an international IT consulting company specializing in enterprise technology solutions, digital transformation, and business process automation.
We are expanding our AI Lab team and looking for an experienced AI Engineer (Python / LLM) to design, develop, and deliver production-ready AI solutions for enterprise clients.
In this role, you will work with cutting-edge technologies, including Anthropic Claude, OpenAI, RAG, and AI agents, turning complex business challenges into practical, scalable solutions.
You will be involved in the full project lifecycle, from solution architecture and development to deployment and optimization, collaborating with technical teams and clients across different industries.
We are looking for someone who combines strong engineering expertise with a practical, solution-oriented mindset and is excited about bringing AI into real-world business environments.
Requirements
- 2-3+ years of commercial Python development (FastAPI, async, testing)
- 1+ years building LLM applications that ran in production, beyond PoCs
- Deep hands-on experience with the Anthropic Claude and/or OpenAI APIs: tool use, structured outputs, prompt caching, and context and cost management
- RAG: chunking, embeddings, hybrid search, reranking, and vector databases (pgvector, Qdrant, OpenSearch or similar)
- Agentic systems: orchestration, tool calling, multi-step workflows and error handling
- Evals and observability for LLM systems (Langfuse, promptfoo or in-house frameworks)
- PostgreSQL, Redis, task queues (Celery or similar) and object storage (S3/MinIO)
- Docker and Docker Compose, CI/CD (GitHub Actions/GitLab CI)
- Experience with AWS (Bedrock, ECS/EKS, Lambda, S3, IAM)
- Understanding of data security requirements: PII, access control, audit, and work in closed environments
- English at Upper-Intermediate (B2) level or higher, and fluent Russian
Responsibilities
- Design client AI solutions and take them to production, from discovery and architecture through deployment and support
- Build AI agents, RAG systems, document intelligence (OCR, field extraction, classification) and business process automation
- Integrate LLMs with enterprise systems such as Jira/Confluence, Microsoft 365/SharePoint, CRM, ERP/1C, DWH and core banking, using MCP, APIs and connectors
- Deliver on-prem and hybrid solutions for regulated clients: local models, PII masking, and work inside the client’s perimeter
- Set up quality evaluation: eval sets, accuracy and hallucination metrics, and production monitoring
- Take part in technical presales: solution architecture, effort estimates, demos and client technical Q&A
- Bring Claude Code and AI-assisted SDLC into client engineering teams, and run hands-on workshops
- Review code, set technical standards, and mentor AI Lab engineers
Nice to have
- Claude Agent SDK, MCP servers, Claude Skills, and Claude Code as part of daily work
- On-prem inference: vLLM, Ollama, open-weight models (Qwen, Llama, Mistral), quantization and GPU infrastructure
- Kubernetes
- Projects in banking, insurance or the public sector
- Anthropic (CCA) or AWS certifications
- Client-facing project experience (consulting or outsourcing) and presales involvement
- Azerbaijani language