Peraton

Senior LLM/AI Platform Engineer

Peraton  •  $112k - $179k/yr  •  Maryland (Onsite)  •  13 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Responsibilities

Peraton Labs is seeking a senior engineer to serve as the technical lead for the multi-agent generative AI orchestration layer that powers an advanced analytical platform. This role owns the architecture governing how multiple LLM-based worker agents are spawned, routed, coordinated, and managed across diverse analytical tasks. The Senior LLM/AI Platform Engineer ensures that the platform's generative AI backbone is reliable, performant, and extensible as new worker types and capabilities are introduced.

Key Responsibilities

  • Architect and maintain the multi-agent orchestration framework, including worker spawning, conversation history isolation, context management, and inter-worker coordination
  • Design and implement token optimization strategies, including context window management, conversation summarization, and efficient prompt construction
  • Own the model routing layer that directs tasks to appropriate model tiers based on task complexity and user configuration
  • Develop and refine prompt engineering patterns for worker agents to ensure consistent, high-quality analytical outputs
  • Establish evaluation frameworks to measure generative AI output quality, accuracy, and reliability across worker types
  • Lead the design of new worker types to support program management capabilities (cost analysis workers, risk analysis workers, data fusion workers)
  • Collaborate with PM Domain Analysts to translate program management requirements into generative AI agent behaviors
  • Mentor junior LLM/AI Platform Engineers and establish engineering standards for generative AI development

Qualifications

Required Qualifications

  • Minimum of 8+ years of experience with a Bachelor's degree, 6+ years with a Master's degree, or 3+ years with a PhD in Computer Science, AI/ML, or related field
  • Deep experience with large language model architectures, fine-tuning, and inference optimization
  • Proficiency in Python; experience with LLM frameworks (LangChain, LlamaIndex, or equivalent)
  • Strong understanding of prompt engineering, retrieval-augmented generation (RAG), and agent-based architectures
  • Experience with vector databases and embedding models
  • Demonstrated ability to architect complex, multi-component generative AI systems
  • US Citizenship with the ability to obtain/maintain a Secret clearance

Preferred Qualifications

  • Experience with multi-agent systems or autonomous agent frameworks
  • Familiarity with government/defense program management concepts
  • Experience with model evaluation and red-teaming methodologies
  • Knowledge of FedRAMP or DoD cloud security requirements
  • 7+ years of software engineering experience, with 3+ years focused on LLM/NLP systems
  • Graduate degree in Computer Science, AI/ML, or related field is highly desired

Peraton Overview

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees do the can’t be done by solving the most daunting challenges facing our customers. Visit peraton.com to learn how we’re keeping people around the world safe and secure.

Target Salary Range

$112,000 - $179,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.

EEO

EEO: Equal opportunity employer, including disability and protected veterans, or other characteristics protected by law.

Peraton

About Peraton

At Peraton, we're at the forefront of delivering the next big thing every day. We're the partner of choice to help solve some of the world's most daunting challenges, delivering bold, new solutions to keep people around the world safer and more secure.

How do we do it? By thinking differently. We're not mired in the past. We look at all problems with fresh eyes. We look past the obvious to bring the best talent, tech, and ideas together to completely transform how things get done. So bring your unique ideas, your entrepreneurial spirit, and your drive to succeed and get ready to be part of something bigger. Get ready to do the can't be done.

________

Recruitment fraud is a growing trend where fraudsters have been known to attempt to use our name to trick job seekers with fake employment opportunities. This type of scam is typically carried out through fake job postings, fake websites, or email accounts claiming to be from Peraton. The intent of recruitment fraud is to gain access to your personal information, such as your banking information, credit card number, or social security number.

Please be aware that our careers site can be found at careers.peraton.com and our corporate site can be found at peraton.com.

To learn more about Recruitment fraud and what to expect and not to expect from a Peraton recruiter, please visit: https://careers.peraton.com/recruitment-fraud/

Industry
IT & Software
Company Size
10,000+ employees
Headquarters
Reston, Virginia
Year Founded
2017
Social Media