Job Description

Role & Responsibilities Overview:

• Prompt Design & Optimization
• Design prompts for - summarization, risk insights, adverse media analysis, underwriter assistant agent etc.
• duplicate explanation, decision support
• Optimize prompts for accuracy, grounding, and consistency

Evaluation & Continuous Improvement

• Define evaluation scenarios and validation datasets
• Use LLM-as-judge and feedback loops to improve responses
• Continuously refine prompts based on - model performance, user feedback

RAG & Assistant Enablement

• Work with AI engineers to - improve retrieval quality, design context injection strategies
• Ensure outputs are – grounded, explainable, aligned with underwriting logic

Business Alignment

• Translate underwriting workflows into prompt logic
• Incorporate domain-specific language, risk indicators, and business rules
• Collaborate with underwriters and SMEs

Prompt Governance

• Maintain prompt library and versioning
• Define templates for different LOBs and use cases
• Ensure consistency across assistant and workflows

Candidate Profile:

• Experience: 5–8+ years with 2–4+ years in GenAI / prompt engineering
• Domain (Mandatory): Strong insurance / underwriting knowledge
• Education: Bachelor's/Master's in Engineering, Data Science, Business Analytics, or related
• Profile Type: Hybrid business + technical, strong analytical thinker

Technical skills

• GenAI & Prompting - prompt engineering techniques (few-shot, chain-of-thought, structured prompts);Experience with Azure OpenAI / LLM APIs; Prompt versioning and optimization
• RAG & Retrieval Awareness - understanding of Azure AI Search and retrieval behavior; Context design and grounding strategies; Ability to reduce hallucinations via prompt + retrieval design
• Evaluation & Quality - LLM-as-judge / evaluation frameworks; Output validation and benchmarking; A/B testing of prompts
• Safety & Governance - Awareness of guardrails (NeMo Guardrails); PII handling (Presidio); Responsible AI practices
• Collaboration & Tools - Familiarity with APIs, JSON, and structured outputs; Basic Python; Working with AI engineers and data teams