Job Description

At Arm, we’re enabling AI and applications from the most influence developers in China to run everywhere—from cloud to edge —powering billions of devices worldwide!

This role sits at the intersection of machine learning, systems optimization, and developer experience, with a focus on enabling efficient deployment of AI models on Arm-based devices. You will work hands-on with model optimization techniques such as tiling, quantization, pruning etc. to help developers transform large foundation models into production-ready, resource-efficient versions that run locally on edge and mobile hardware. You will work on developer’s applications based on standard software stacks and frameworks by integrating arm-based AI technologies to boost performance of their models and frameworks much earlier before the technologies go to market. You will do in-depth profiling and analysis of the whole solution stack all the way from application usage down to the architecture even before silicon is available to use. You’ll work closely with engineering and product teams to identify friction in SDKs, runtimes, tooling or even silicon for app developer adoption of Arm technologies. You will advocate for improvements across areas like on-device inference, model deployment, etc. through high quality contents like white papers, talks, demos etc., in various developer events.

Success of this role means enablement of Arm AI technologies in highly influential AI applications before technologies go to market and equally important to drive in-depth insights based on analysis of the full system behavior to designer better future products.

What You’ll Bring

• Strong problem solving and analysis skills. Articulate and clarity in technical issues and deliverables in reports or meetings. Ability to explain sophisticated systems to a range of audiences
• Understanding of neural network (e.g. LLM, CNN etc.) and deploy efficient AI models on device through optimization techniques and tools like tiling, quantization, pruning, and LoRA/PEFT etc.
• Familiarity with ML frameworks (e.g., Pytorch, LiteRT, TensorRT, Core ML) and partner with ML frameworks and tooling ecosystems to optimize runtimes and ensure production readiness.
• Develop technical guides, tutorials, and benchmarking and analysis reports focused on performance and efficiency on Arm platforms.
• Strong debugging, profiling and analysis skills of full software stacks on arm based devices: mobile (Android) to cloud (server/Linux). Strong experience in Python, Embedded, C/C++.
• Passion in the above areas and great flexibility to work on various AI applications from 3rd parties
• Contributions to developer ecosystems through high quality contents like white papers, blogs, talks, demos and open source engagements.

Preferences

• Experience with automotive/robotics software and applications like Android automotive, IVI or ADAS will be a big PLUS
• Understanding of hardware and system architectures (compute, memory, PCIe, mesh, thermal) in a big PLUS
• Systems-level understanding of performance optimization on CPUs, NPUs and accelerators.
• Experience with edge-to-cloud applications (mobile or IoT + cloud integration)
• Familiarity with model formats and optimization (e.g., ONNX, quantization, TFLite)
• Familiarity with modern cloud infrastructure (containers, Kubernetes, serverless)

#LI-SC2

Accommodations at Arm

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email accommodations@arm.com. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working at Arm

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.