About the Role

We are seeking a highly experienced Principal or Director Software Engineerto lead the design, development, and deployment of next-generation AI accelerator software systems forDatacenters This role combines deep technical expertise with strong leadership capabilities to guide a mid-sized engineering team focused on high-performance AI workloads, model serving infrastructure, and scalable distributed systems.

You will play a critical role in building software that powers large-scale LLM inference andfine-tuningtypeworkloads, optimizing performance acrossNPUaccelerators, and delivering production-grade AI infrastructure.

Key Responsibilities

Technical Leadership

• Architect and deliver scalable, high-performance AI model serving platformsforCloud Service Providers (CSP)and Neo-Clouddeployments.

• Lead development of software stacks for AI acceleratorsinDatacenter environments.

• Drive innovations in LLM inference optimization, includingdynamicbatching, scheduling, memory management, and latency reductionoverhigh-speednetworkssuch as RoCE,ESUN&UAL

• Grow an existing team into new areas for the site withadoption and optimization of frameworkssuch asPyTorch,SGLang,vLLMandTritonInference Server

• Design robust, production-ready systems for distributed inference andfine-tuningworkloads

Team Leadership

• Lead, mentor, andcontinuegrowingmid-sized team (20+engineers)

• Establish engineering best practices in performance, reliability, and scalability.

• Collaborate cross-functionally with hardware, research, and platform teams.

• Own technical roadmap and execution strategy aligned with business goals.

System Design & Infrastructure

• Build and maintain systems leveragingLinux Runtimes andPyTorchfor Linux and Windows for server and client markers includingorchestration and deployment of AI services.

• Optimize Linux-based systemsfor high-throughput compute workloads.

• Develop low-level system optimizations and integrations for NPU / custom accelerators

• Ensure high availability, fault tolerance, and observability of AI systems in production.

Required Qualifications

• 15+ yearsof software engineering experience, with at least 5–8years in a leadership role

• Experience working in companies which have matrixed organizations spanning multiple geographic regions.

• Expertise in C/C++ and Pythonwith strongsystem-level programming experience.

• Experience with PyTorchand modern Machine Learningframeworks.

• Proven experience building or scaling LLM-based systems or AI model serving platforms

• Hands-on experience with:

• Execution Runtimesfor AI accelerators(such asCUDA/ROCm)

• Kubernetes

• Triton Inference Server

• SGLang, vLLMor similar LLM serving frameworks

• Strong understanding of:

• Distributed systems

• High-performance computing

• NPU/accelerator programming environments

• Experience working in Linux environmentsat performance-critical levels.

Preferred Qualifications

• Experience with custom AI accelerators / ASICs / GPUsin aDatacenter setting.

• Experience with large-scale production systemsserving millions of requests.

• Experience withcurrent AI LLM models/architectures.

• Contributions to open-source AI infrastructure projects.

• Knowledge of networking, high-speed interconnectssuch as GPU Direct,ESUN, UAL, RoCEand/orRDMA

• Familiarity with performance profiling toolsand optimization techniques.

Leadership Profile

• Hands-on leader who can dive deep technically when needed

• Ability tostronglycollaborate with leads in other sites/geo’s

• Strategic thinker with a track record of delivering complex systems end-to-end.

• Strong communicator capable of aligning teams and stakeholderswithanemphasis on end customer experience.

• Passionate about building high-performing engineering cultures.

Where you will be working

Cork has a proud reputation as Ireland's second largest economic engine and is now one of the Top 20 location choices in Europe with 39,000 people being employed by over 170 overseas companies.
There's a growing diversity in the region with people from many nationalities relocating to Cork, relishing the opportunity to work and live in a location that offers an excellent quality of life.
A gateway to Europe, Cork airport provides access to almost 50 international destinations including transatlantic air routes.

Equal Opportunities
We are an Equal Opportunity employer; all qualified applicants will receive consideration for employment without regard to race, colour, religion, sexual orientation, gender identity, national origin, disability, veteran status, or any protected classification.

What's on Offer

Apart from working in an open, relaxed and collaborative space, you will enjoy:

• Salary, stock and performance related bonus

• Maternity/Paternity Leave

• Employee stock purchase scheme

• Matching pension scheme

• Education Assistance

• Relocation and immigration support (if needed)

• Life, Medical, Income and Travel Insurance

• Subsidised memberships for physical and mental well-being

• Bicycle purchase scheme

• Employee run clubs, including, running, football, chess, badminton + many more