In short
Senior Generative AI Developer (via InfoStride) for NC DHHS in Raleigh, NC — hybrid. Day to day: build and deploy production LLM applications, RAG pipelines, fine-tuned models, and AI agent workflows using Python, LangChain-style frameworks, FastAPI/Azure, vector/SQL/NoSQL databases, with a focus on AI security, Responsible AI, and PII protection.
About the role
Job ID: 814296
Job Title: Senior Generative AI Developer
Department: Department of Health and Human Services
Work Arrangement: Hybrid
Work Location: 1915 Health Services Way, Raleigh, NC 27607
Interview Type: Both Phone and In Person
Job Description:
NC DHHS is seeking a Senior Generative AI Developer to design, develop, and deploy secure, scalable, production-grade AI solutions using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), model fine-tuning, and enterprise data systems. The ideal candidate will have strong expertise in Python, cloud platforms, data engineering, and AI security, with a focus on Responsible AI, data privacy, and enterprise integration.
Key Responsibilities
• Develop and deploy LLM-powered applications, prompts, and AI agent workflows.
• Build RAG pipelines integrating vector, SQL, and NoSQL databases.
• Implement model fine-tuning and optimization techniques, including LoRA.
• Develop secure APIs and microservices using Python, FastAPI, or Azure Functions.
• Integrate structured and unstructured enterprise data while ensuring PII protection.
• Implement AI security controls, encryption, RBAC, and access management.
• Ensure Responsible AI practices, including bias detection, privacy, and hallucination mitigation.
• Maintain CI/CD pipelines and monitor AI performance, cost, reliability, and model drift.
• Collaborate with engineering, security, data, product, and governance teams.
• Maintain technical documentation and support compliance and audit requirements.
Required Qualifications
• 3+ years of experience in Generative AI or applied machine learning.
• 3+ years of experience with Azure, AWS, or GCP.
• 3+ years of Python development and LLM frameworks such as LangChain, Semantic Kernel, or LangGraph.
• 2+ years of experience building RAG pipelines and LLM applications.
• 2+ years of experience with vector databases such as Pinecone, Weaviate, Milvus, or FAISS.
• 5+ years of SQL, data modeling, and performance tuning experience.
• 2+ years of experience with NoSQL databases such as MongoDB, Cosmos DB, or DynamoDB.
• 2+ years of experience implementing AI security and Responsible AI practices.
• 5+ years of experience developing microservices using FastAPI, Node.js, or Azure Functions.
• 3+ years of Agile development experience.
Preferred Qualifications
• Experience with Azure AI Search, Azure Machine Learning, Databricks, or Hugging Face.
• Familiarity with Promptflow, Ragas, or AI evaluation frameworks.
• Experience with supervised fine-tuning and LoRA-based training.
• Knowledge of enterprise governance tools such as Microsoft Purview.
• Relevant certifications such as Azure AI-102, AWS ML Specialty, GCP ML Engineer, or SC-100.