InfraCloud Technologies - An Improving Company

Senior Spark QA Engineer

InfraCloud Technologies - An Improving Company  •  Pune, IN (Onsite)  •  9 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Location: Pune,Maharashtra,India

Senior Spark QA Engineer – Functional & Performance Testing

Location: Remote
Experience: 5+ Years

-
We are looking for a Senior Spark QA Engineer with strong expertise in functional and performance testing of Apache Spark applications and distributed data platforms.

Key Responsibilities -

  • Perform manual and automated testing of Spark jobs, Spark SQL queries, and ETL pipelines.
  • Execute functional, scalability, and performance testing for Spark workloads.
  • Set up and manage Spark clusters on Standalone, YARN, Kubernetes, Mesos, Databricks, EMR, and Dataproc.
  • Conduct benchmarking, validation, and performance analysis of Spark applications.
  • Identify bottlenecks and troubleshoot distributed system issues.
  • Lead QA initiatives and mentor team members.

Required Skills -

  • 5+ years of QA/testing experience with strong hands-on expertise in Apache Spark.
  • Experience in functional and performance testing of distributed systems.
  • Strong understanding of Spark architecture and optimization techniques.
  • Experience with Kubernetes and cloud-based Spark environments.
  • Proficiency in Python or Java.
  • Experience with automation frameworks and CI/CD pipelines.

Apply to this job

InfraCloud Technologies - An Improving Company

About InfraCloud Technologies - An Improving Company

We help build AI Cloud, modernize applications and infrastructure with our expertise in cloud native technologies.

InfraCloud Technologies is Open Source Cloud Native Computing company which has been building products, services, and solutions for AI Cloud and to modernize applications and infrastructure.

InfraCloud was one of the first Kubernetes partners and have been contributing to the open source community around cloud-native technologies. It has been growing almost 100% for last few years consistently.

We are organizers of local chapters of Serverless & Kubernetes Meetup and are actively involved in building a community for new technologies in Cloud & DevOps space.

Industry
IT & Software
Company Size
51-200 employees
Headquarters
Pune, IN
Year Founded
Unknown
Social Media