Huawei Canada has an immediate Co-op opening for an Engineer.
About the team:
The Intelligent Cloud Infrastructure Lab aims to innovate technologies, algorithms, systems, and platforms for next-generation cloud infrastructure. The lab addresses scalability, performance, and resource utilization challenges in existing cloud services while preparing for future challenges with appropriate technologies and architectures. Additionally, the lab aims to understand industry dynamics and technology trends to create a robust ecosystem.
About the job:
Understand AI System and Infrastructure technology landscape, and identify scalability/performance issues or challenges of current LLM/multi-modal LLM systems
Initiate and charter innovation projects to build or re-architect AI infrastructure platform, and plan milestones accordingly
Provide/contribute a scalable and high-performance architecture design or re-design for the infrastructure system that is optimized for AI training and inferencing, which includes but not limited to cluster management and scheduling, LLM model deployment, elastic LLM as well as AI container cold/warm start-up optimization, and so on.
Collaborate with internal and external teams to deliver the project or project features that improve our overall system scalability and performance.
The target annual compensation (based on 2080 hours per year) ranges from $58,000 to $104,000 depending on education, experience and demonstrated expertise.
About the ideal candidate:
Bachelors, Master/PhD degree in Computer Science, Computer Engineering
Experience in building large scale and high-performance distributed system
Experience in Nvidia TensorRT and/or Triton servers. Experience in container virtualization technologies
Knowledge & experience in distributed system design & development, including serverless technologies
Work experience in one or more of the following technologies: vLLM, Ray, SGLang, Kubernetes, TensorRT-LLM, Pytorch framework, Cuda libraries, GPU technologies
Work experience in one or more of the following programming languages: C/C++, Go, Java, Rust, python, C#
Have excellent interpersonal and communication skills to collaborate with multiple teams and build strong partnerships effectively
Demonstrated success working on software engineering problems that span multiple products
Huawei is a leading global provider of information and communications technology (ICT) infrastructure and smart devices. With integrated solutions across four key domains – telecom networks, IT, smart devices, and cloud services – we are committed to bringing digital to every person, home and organization for a fully connected, intelligent world.
Huawei's end-to-end portfolio of products, solutions and services are both competitive and secure. Through open collaboration with ecosystem partners, we create lasting value for our customers, working to empower people, enrich home life, and inspire innovation in organizations of all shapes and sizes.
At Huawei, innovation focuses on customer needs. We invest heavily in basic research, concentrating on technological breakthroughs that drive the world forward. We have more than 207,000 employees, and we operate in more than 170 countries and regions. Founded in 1987, Huawei is a private company fully owned by its employees.
House Rules
This page is for ICT professionals with an interest in Huawei and our industry to engage in open discussions.
To facilitate dialogue, please follow these rules:
- Huawei holds the right to delete comments that are offensive, misleading, false, unlawful, off-topic and in violation of any regulations.
- Repeated violations of any of the above will be removed and users may be blocked.
- Huawei does not necessarily endorse the information shared by members.
- Please be familiar with and follow LinkedIn's User Agreement.
- By publicly uploading a photograph or comment, you give Huawei permission to feature your content. This will always be credited.
Please visit the below portals for career or customer service queries.
Career page: http://bit.ly/2rdljD7
Customer service: http://bit.ly/2a4mXNY
Thank you for visiting us & we hope you enjoy your time on our page.
