Job Description
Job Summary
As part of the Apple’s Power and Performance Validation team, this role will lead QA, test automation, and device lab operations supporting AI/ML workloads on advanced silicon platforms.
The position is responsible for managing test labs, automation infrastructure, performance validation, data analysis, and a team of QA and lab engineers to ensure reliable, scalable, and high-quality testing operations.
Key Responsibilities
QA, Automation, Performance Validation & Lab Operations
Scope of Responsibilities
- Lab & Device Management
- Lead setup and maintenance of prototype and production devices for testing and validation.
- Oversee installation of test builds, device diagnostics, and validation across multiple hardware and software revisions.
- Ensure uptime, stability, and operational readiness of lab infrastructure, hosts, and test fixtures.
- Manage device inventory, hardware logistics, pick-up/return activities, and day-to-day lab operations.
- Drive documentation of lab processes, test procedures, and validation findings.
- Automation Infrastructure Development
- Lead development and enhancement of internal Python-based automation frameworks.
- Manage automation strategy for regression, integration, performance, and system-level testing.
- Oversee CI/CD infrastructure and test integration using Jenkins, GitHub, and Ansible.
- Review and improve automation architecture for scalability, reliability, and reusability.
- Mentor engineers on automation best practices and coding standards.
- Telemetry, Logging & Data Analysis• Oversee collection and analysis of logs, telemetry, performance traces, power metrics, and test data.
- Drive root-cause analysis of failures, regressions, and performance bottlenecks.
- Develop dashboards, reports, and quality metrics using Tableau, Metabase, PostgreSQL, and internal tools.
- Identify trends and provide actionable insights to engineering teams.
- Test Execution (Manual & Automated)
- Manage execution of A/B, sanity, regression, integration, performance, and power test suites.
- Ensure development of comprehensive test plans, reproducible test cases, and validation procedures.
- Drive automation coverage and execution efficiency across testing programs.
- Monitor test results, track defects, and ensure traceability of validation activities.
- Performance Bottleneck Identification
- Lead identification and debugging of performance and power regressions.
- Drive cross-functional investigations involving Software, Hardware, QA, and AI/ML teams.
- Analyze software and hardware interactions impacting system performance.
- Recommend corrective actions and process improvements to enhance product quality and performance.
Skill Requirements
Technical Skills / Tools
- Python
- Bash / Shell Scripting
- Git & GitHub
- Jenkins
- Ansible
- Linux / Unix
- CI/CD Automation
- Test Automation Frameworks• Telemetry & Log Analysis
- Performance & Power Validation
- PostgreSQL
- Tableau
- Metabase
- Confluence
- Slack
- Agile / Kanban Tools
Experience Required
- 3+ years of experience in QA, Validation Engineering, System Testing, or Test Automation.
- 1+ years of experience leading QA, Validation, or Lab Engineering teams.
- Strong experience managing hardware test labs and device validation environments.
- Expertise in Python automation, test framework development, and CI/CD processes.
- Experience with performance and power validation of complex hardware/software systems.
- Strong debugging, failure analysis, and stakeholder management skills.
- Excellent written and verbal communication skills.
Other Requirements
Preferred Qualifications
- Experience validating AI/ML workloads and machine learning systems.
- Familiarity with Apple Neural Engine (ANE) or similar AI acceleration platforms.
- Knowledge of CNN, Transformer, and Diffusion Model architectures.
- Experience with iOS/macOS environments.
- Experience supporting prototype hardware development and silicon validation programs.
