Codvo.ai

AI / LLM Integration Engineer (Remote)

Codvo.ai  •  Pune, IN (Remote)  •  15 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

AI/ML Engineer

Company: CODVO.AI

Department: Engineering

Location: Work From Home

Employment Type: Full-Time

Experience Level: Mid-Level (3+ years)

Shift Timing: 9:30 AM - 6:30 PM IST

We're seeking an experienced AI/ML Engineer to design and implement intelligent exception resolution capabilities within our financial reconciliation platform. You'll integrate advanced language models (Claude/OpenAI) into our core pipeline, crafting sophisticated prompts that transform complex reconciliation exceptions into clear, auditable resolution suggestions. This role is critical to delivering AI-powered insights that help financial teams resolve discrepancies faster and with greater confidence.

What You'll Do

  • Design and optimize prompts that accurately interpret flagged reconciliation exceptions and generate structured, actionable resolution suggestions with confidence scoring
  • Integrate LLM APIs (Anthropic Claude, OpenAI) into the exception resolution layer using Python, the Anthropic SDK, and async API patterns for production-grade reliability
  • Develop human-in-the-loop workflows that balance automation with human oversight, ensuring financial accuracy and auditability at every step
  • Build robust API integration code that handles edge cases, rate limiting, token management, and graceful error recovery in a financial context
  • Collaborate with backend developers to embed AI outputs cleanly into the reconciliation pipeline and ensure seamless data flow into final reports
  • Implement LLM evaluation and benchmarking frameworks to measure prompt effectiveness, accuracy, and consistency across diverse exception types
  • Document prompt strategies and model behavior to enable knowledge sharing and continuous improvement across the engineering team
  • Monitor and iterate on model performance, refining prompts and integration logic based on real-world exception data and user feedback

What We're Looking For

Required Qualifications:

  • 3+ years of professional software engineering experience, with at least 2+ years working directly with LLM APIs (Anthropic, OpenAI, or similar)
  • Strong proficiency in Python, including hands-on experience with the Anthropic SDK and async API calls
  • Demonstrated expertise in prompt engineering, particularly for structured outputs and domain-specific tasks
  • Solid understanding of confidence scoring, uncertainty quantification, and human-in-the-loop AI workflows
  • Experience writing clean, maintainable API integration code with attention to edge cases and error handling
  • Ability to work independently and communicate effectively with cross-functional teams
  • Familiarity with financial systems, reconciliation processes, or similar regulated domains is a plus

Technical Skills:

  • Backend development and ETL middleware concepts
  • Agent orchestration and agentic AI patterns
  • LLM evaluation and benchmarking methodologies
  • Version control (Git) and collaborative development practices

Nice to Have

  • Experience with Retrieval-Augmented Generation (RAG) or domain-specific knowledge grounding
  • Familiarity with financial reconciliation, accounting systems, or fintech platforms
  • Experience with prompt versioning and A/B testing frameworks
  • Knowledge of structured output formats (JSON, XML) and validation
  • Exposure to observability and monitoring tools for LLM applications
  • Background in machine learning model evaluation and metrics

What We Offer

  • Flexible work environment: 100% remote with a collaborative, inclusive team culture
  • Meaningful impact: Work on cutting-edge AI solutions that directly improve financial operations for our clients
  • Professional growth: Opportunities to deepen expertise in LLMs, agentic AI, and financial technology
  • Competitive compensation: Commensurate with experience and market rates
  • Collaborative culture: Work alongside talented engineers and product teams who value innovation and continuous learning
  • Billable engagement: Full-time, stable project with mid-to-late stage engagement timeline

About CODVO.AI

CODVO.AI is a forward-thinking technology company specializing in AI-driven financial solutions. We empower organizations to automate and optimize their reconciliation processes through intelligent, trustworthy AI. Our platform combines advanced language models with domain expertise to deliver accurate, auditable insights that save time and reduce errors. We're committed to building inclusive, innovative products that solve real-world problems in the financial services space.

Note- Please apply via our official careers portal only, as applications sent directly to executives may not be considered.

Codvo.ai

About Codvo.ai

At Codvo.ai, we specialize in leveraging artificial intelligence, cloud, and data to solve complex business problems and drive innovation. Our passion for innovation drives us to deliver solutions that not only meet but exceed your unique business needs, fostering smarter, more productive teams. Here’s why our approach has earned widespread acclaim from our clients:

67 Customer NPS: Our Net Promoter Score is a testament to the high level of satisfaction and loyalty among our clients. It underscores our ability to deliver quality and value through our specialized services, making us a preferred partner for businesses looking to leverage AI and data for competitive advantage.

78 Employee NPS: The satisfaction and engagement of our team directly influence the quality of service we provide. Our high employee NPS signifies a motivated, dedicated team that's committed to excellence. This positive work culture ensures that we can deliver exceptional AI-first engineering and enterprise data application services to you.

Our approach goes beyond traditional software development; we're dedicated to partnering with you to harness the power of AI and data. The combination of our high trial and engagement success rates, extensive experience, and positive feedback from both clients and employees positions us as more than just a service provider. We're your trusted ally in navigating the complexities of today's digital landscape, committed to transforming your vision into a reality with cutting-edge AI and data solutions.

Industry
IT & Software
Company Size
51-200 employees
Headquarters
Plano, Texas
Year Founded
2019
Website
codvo.ai
Social Media