
At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us.
You will work closely with product managers, software engineers, data scientists, architects, and business stakeholders to develop production-ready AI systems leveraging machine learning, deep learning, large language models, retrieval-augmented generation, Small Language Models, intelligent agents, and modernMLOpspractices.
This is a senior individual contributor role requiring deep technicalexpertise, strong architectural thinking, and the ability to influence engineering practices across teams. The successful candidate will be expected to build scalable solutions,establishengineering best practices, mentor peers, and drive adoption of modern AI and machine learning capabilities.
This role is ideal for an engineer who enjoys solving complex business problems through innovative AI technologies whilemaintaininga strong focus on scalability, reliability, governance, and user value.
Key Responsibilities
AI/ML Solution Architecture and Engineering
Architect and build production-grade machine learning, deep learning, generative AI, and agentic AI systems for commercial and field engagement use cases.
Lead technicaldesign forsolutions involving retrieval-augmented generation, embeddings, semantic search, LLM orchestration, Text2SQL, recommendation systems, predictive modeling, and intelligent workflow automation.
Design scalable AI services and APIs that integrate with enterprise data platforms, business applications, CRM ecosystems, and downstream product workflows.
Design, train, fine-tune, and deploy neural network models for domain-specific commercial and field use cases, including deep learning architectures such as Transformers, Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and LSTMs as applicable.
Develop deep learning solutions that prioritize performance, generalization, explainability, scalability, and production readiness.
Apply frameworks such asPyTorchand TensorFlow to build, experiment with, andproductionizeneural network models.
Build modular, reusable, observable, secure, and maintainable solutions aligned with enterprise technology patterns.
End-to-End Model and GenAI Delivery
Own the full lifecycle of AI/ML delivery, including problem framing, data preparation, feature engineering, experimentation, model training, prompt and context design, evaluation, deployment, monitoring, and continuous improvement.
Develop and productionize NLP and LLM capabilities, including RAG, prompt engineering, model adaptation, fine-tuning where appropriate, and response quality evaluation.
Train and fine-tune neural network and language models using full fine-tuning, instruction tuning, domain adaptation, and parameter-efficient techniques such asLoRAandQLoRAto optimize performance for specific business tasks and datasets.
Apply model distillation techniques to compress large teacher models into smaller, efficient student models, balancing accuracy, latency, infrastructure cost, and operational constraints for production deployment.
Design, train, evaluate, and deploy Small Language Models (SLMs) as lightweight, cost-efficient alternatives to large language models for latency-sensitive, on-device, resource-constrained, or specialized domain use cases, including task-specific SLM fine-tuning and evaluation against larger models.
Evaluate trade-offs between foundation models, fine-tuned models, distilled models, and Small Language Models todeterminethe most effective architecture for business, operational, and governance requirements.
Implement model evaluation frameworks for predictive, generative, and retrieval-based systems, including accuracy, relevance,groundedness, hallucination risk, latency, cost, and robustness.
Monitor production performance, data drift, model drift, failures, and usage patterns, and drive remediation or optimization.
Data, Platform, andMLOpsEngineering
Build andoperatescalable data and feature pipelines using cloud-native and enterprise data platforms.
ImplementMLOpsandLLMOpspractices including CI/CD, model registry, experiment tracking, version control, reproducibility, automated testing, observability, lineage, and auditability.
Work with platforms such as Databricks, SageMaker, Azure or AWS services, Kubernetes, Docker,MLflow, or similar tools based on approved enterprise patterns.
Partner with data engineering and platform teams to ensure data quality, governance, lineage, access control, and operational reliability.
Business Partnership and Product Impact
Work closely with product owners, business stakeholders, data scientists, architects, compliance, and engineering teams to translate business opportunities into AI/ML product capabilities.
Shape technical approaches for high-value use cases across HCP targeting, field engagement, content recommendation, analytics, workflow automation, and decision intelligence.
Communicate model behavior, design tradeoffs, risks, and recommendations clearly to technical and non-technical audiences.
Influence product roadmap decisions by bringing practical AI/ML feasibility, scalability, governance, and value considerations into planning.
Responsible AI, Security, and Governance
Apply secure-by-design, privacy-by-design, and responsible AI principles across the AI/ML lifecycle.
Ensure AI systems are designed withappropriate controlsfor explainability, traceability, bias awareness, grounding, auditability, and human oversight where needed.
Collaborate with governance, compliance, quality, and risk partners to ensure solutions meet standards for data use, reliability, documentation, and operational readiness.
Create andmaintainarchitecture, design, evaluation, and support documentation forproductionAI systems.
Technical Leadership and Coaching
Act as a senior technical contributor and guide for AI/ML engineers, data scientists, and product teams.
Promote reusable patterns, engineering standards, best practices, and evaluation approaches across multiple teams.
Review solution designs, code, architecture choices, and operational patterns to improve quality and consistency.
Support team capability building through mentoring, technical coaching, knowledge sharing, and hands-on examples.
Required Qualifications
6+ years of experience building and deploying production machine learning or AI solutions.
3+ years working with generative AI technologies, including LLMs, RAG architectures, embeddings, prompt engineering, model evaluation, and agentic workflows.
Strongproficiencyin Python and SQL.
Hands-on experience building and fine-tuning deep learning models usingPyTorch; TensorFlow experience preferred.
Experience with modern AI/ML frameworks such asPyTorch, TensorFlow, scikit-learn, Hugging Face,LangChain,DSPy, or equivalent technologies.
Experience designing and deploying AI services on AWS, Azure, or GCP.
Experience implementingMLOpsorLLMOpspractices including CI/CD, monitoring, observability, experiment tracking, model management, and automated testing.
Strong software engineering fundamentals including API development, system design, version control, code reviews, and testing.
Strong understanding of neural network architectures, transfer learning, model optimization, model evaluation, and production deployment considerations.
Experience working with structured, semi-structured, and unstructured data at scale.
Ability to communicate complex technical concepts to technical and non-technical audiences.
Demonstrated ability to translate ambiguous business challenges into scalable technical solutions that deliver measurable business value.
Demonstrated experience leading technical initiatives and influencing architectural decisions across teams.
Preferred Qualifications
Experience with commercial pharma, healthcare analytics, CRM, customer engagement, decision-support platforms, HCP data, field engagement workflows, targeting/orchestration, or Veeva-related ecosystems.
Experience with enterprise AI/data platforms such as Databricks, SageMaker, Azure ML, or similar.
Experience with GenAI patterns such as multi-agent systems, tool use, Text2SQL, semantic search, knowledge graphs, hybrid retrieval, reranking, context engineering, and LLM evaluation.
Experience with foundation model fine-tuning, instruction tuning,LoRA,QLoRA, model compression, model distillation, quantization, and Small Language Model development.
Experience evaluating andoptimizingAI systems across quality, latency, throughput, scalability, and cost dimensions.
Experience withFastAPI, Flask, or similar frameworks for model/API serving.
Experience with Kubernetes, Docker, GitHub Actions,MLflow, vector databases, Spark,PySpark, orlakehousearchitectures.
Familiarity with responsible AI practices such as explainability, bias detection, grounded generation, guardrails, auditability, and human-in-the-loop design.
Experience creating executive-facing dashboards, model insights, or AI observability views using tools such as Power BI,Plotly, Dash, or similar.
Strong documentation, design-review, and technical governance habits.
M.Tech, MS, or higher degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related quantitative discipline preferred.
Key Skills
• Machine Learning Engineering
• Small Language Models (SLMs)
• Deep Learning and Neural Network Architecture Design
• Model Evaluation and Error Analysis
• Generative AI and LLM Engineering
• Python, SQL,PySpark
• Retrieval-Augmented Generation
• Databricks, SageMaker, AWS/Azure
• Agentic AI and Multi-Agent Workflows
•MLOpsLLMOps
• Prompt Engineering and Context Engineering
• CI/CD, Docker, Kubernetes, Git
•PyTorchand TensorFlow
• Model Monitoring and Drift Detection
• Transformer Models, CNNs, RNNs, and LSTMs
• API Development and AI Service Integration
• Model Fine-Tuning, Instruction Tuning, and Domain Adaptation
• Responsible AI, Security, Privacy, and Governance
•LoRA,QLoRA, and Parameter-Efficient Fine-Tuning
• Business-facing Technical Leadership
• Model Distillation, Compression, and Quantization
Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form ( https://careers.lilly.com/us/en/workplace-accommodation) for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response.
Lilly does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.
#WeAreLilly

We're a medicine company turning science into healing to make life better for people around the world. It all started nearly 150 years ago with a clear vision from founder Colonel Eli Lilly: "Take what you find here and make it better and better." Harnessing the power of biotechnology, chemistry and genetic medicine, our scientists are urgently advancing science to solve some of the world's most significant health challenges.
General Information and Guidelines:
When you engage with us on LinkedIn, you're agreeing to these Community Guidelines: https://e.lilly/guidelines.
If you have questions about a Lilly medicine, contact The Lilly Answers Center at 1-800-Lilly-Rx (1-800-545-5979) Monday through Friday, excluding company holidays.