Job Description

Company Description

Abstrabit is a Private AI engineering company building AI-powered products and solutions for businesses. We work across the AI stack — from deploying and evaluating private and open-weight models to building production applications, agents, workflows, and integrations on top of them.

Our engineering work is organized across two closely connected layers: the AI layer, focused on models, inference, evaluation, and AI infrastructure; and the application layer, focused on building reliable, scalable software products that use those AI capabilities.

Job Description

The Context

Using an AI model through an API is very different from deploying and operating AI systems in production.

Private AI systems require decisions around model selection, inference, evaluation, latency, infrastructure, data pipelines, retrieval, cost, and reliability.

Our AI Engineering team works on this layer.

We are looking for interns who want to understand how modern AI systems work beyond prompt engineering and hosted APIs, and who are interested in learning how models are deployed, evaluated, and integrated into real products.

About the Role

As an AI Engineering Intern, you will work primarily on the AI layer of our products and solutions.

You will help deploy and evaluate open-weight models, build inference and retrieval pipelines, experiment with model configurations, and expose AI capabilities for application teams to use.

You will work primarily with Python and gain hands-on experience with technologies around model serving, LLM inference, embeddings, vector databases, RAG, evaluation frameworks, cloud infrastructure, and open-weight models.

You are not expected to already be an expert in model deployment or fine-tuning. We are looking for strong technical fundamentals, curiosity, and the ability to learn unfamiliar systems quickly.

What You'll Work On

Depending on the project, you may work on:

• Deploying open-weight language and embedding models.
• Building and testing model inference APIs and services.
• Comparing models based on quality, latency, throughput, memory usage, and cost.
• Building RAG pipelines using embeddings, vector databases, and retrieval systems.
• Creating evaluation datasets and running model and application-level evaluations.
• Experimenting with prompts, model parameters, retrieval strategies, and inference configurations.
• Working with GPUs, containers, cloud infrastructure, and model-serving frameworks.
• Investigating model failures and understanding why different models behave differently.
• Documenting experiments so results can be reproduced and compared.
• Working with Software Engineers to expose AI capabilities to production applications.

Qualifications

We care more about strong fundamentals and your ability to learn than whether you already know every AI framework.

You should have:

• Strong Python fundamentals.
• Good programming and problem-solving ability.
• Basic understanding of APIs, data structures, Git, and software development.
• Interest in understanding how machine learning and large language models work beyond using hosted APIs.
• Ability to read technical documentation and implement unfamiliar concepts.
• Comfort experimenting, measuring results, and investigating unexpected behaviour.
• At least one meaningful technical project through coursework, a personal project, internship, research, hackathon, or similar work.
• Ability to clearly explain what you built, what worked, what failed, and what you learned.

Prior experience with model deployment, RAG, PyTorch, Hugging Face, vector databases, GPUs, or cloud infrastructure is useful, but not required.

We use AI tools as part of our engineering workflow, and you are welcome to use them. We are not interested in testing whether you can memorize APIs or write every line of code without assistance.

What matters is whether you can understand what the system is doing, verify results, question incorrect assumptions, debug failures, and explain your reasoning.

Using AI effectively is useful. Blindly accepting its output is not.

What This Role Is Not

This is not a prompt-engineering internship.

You may work with prompts, but the role goes deeper into models, inference, retrieval, evaluation, and AI infrastructure.

This is also not primarily a data analytics or traditional data science role.

You will work closer to the engineering of AI systems — getting models to run reliably, evaluating their behaviour, understanding trade-offs, and making those capabilities usable by application teams.

You are also not expected to already be an AI specialist. The role is designed for someone with strong fundamentals who wants to build that specialization.

Additional Information

Why Join Abstrabit

You will get the opportunity to work close to the core AI systems behind production applications.

You will:

• Work with private and open-weight AI models rather than only hosted model APIs.
• Learn how models are deployed, evaluated, benchmarked, and operated in production environments.
• Gain exposure to inference, RAG, model serving, evaluation, GPUs, and AI infrastructure.
• Work closely with Software Engineers who build applications on top of the systems you help create.
• Receive technical guidance and feedback from experienced engineers.
• Gradually take ownership of larger experiments, systems, and technical decisions as you grow.
• Build practical AI engineering skills that sit between machine learning and production software engineering.

Our Interview Process

Our hiring process is designed to understand how you approach unfamiliar technical problems rather than how many AI tools are listed on your resume.

Step 1: Application Screening - We review your technical fundamentals, projects, and evidence that you have spent time building, experimenting, or learning deeply.

Step 2: Practical AI Engineering Assessment & Discussion - You will work through a practical technical problem and discuss your approach with one of our engineers.

The problem may involve Python, APIs, model outputs, retrieval, debugging, or interpreting experimental results. We may ask you to explain your approach, investigate an issue, modify your solution, or reason about why one result differs from another.

We are interested in how you learn, experiment, validate results, and respond when something does not work as expected.

Step 3: Final Conversation - A discussion about the role, your learning goals, expectations, and whether Abstrabit is the right environment for you.