Acceldata

Product Specialist - Hadoop

Acceldata  •  Bengaluru, IN (Onsite)  •  1 month ago
Apply
Save Job
Mark Applied Mark Interviewed Mark Offered
Hide Job Report Job
AI can make mistakes so check important info. Chat history is never stored.

Job Description

We are seeking a Product Specialist - Hadoop SME (Subject Matter Expert) who will be responsible for designing, optimising, migrating and scaling Hadoop and Spark-based data processing systems. This role involves hands-on experience with Hadoop and other core data operations, focusing on building resilient, high-performance distributed data systems. You will collaborate with customer engineering teams to deliver high-throughput Hadoop and Spark applications and solve complex data challenges in migration, upgrades, reliability, and optimise post-migration system performance.
If you’re passionate about working in fast-paced, dynamic environments and want to be part of the cutting edge of data solutions, this role is for you.

We’re looking for someone who can:

  • Design and optimise distributed Hadoop-based applications, ensuring low-latency, high-throughput performance for big data workloads.
  • Troubleshooting Provide expert-level support for data or performance issues in Hadoop and Spark jobs and clusters.
  • Data Processing Expertise Work extensively with large-scale data pipelines using Hadoop and Spark's core components
  • Performance Tuning Conduct deep-dive performance analysis, debugging, and optimisation of Impala and Spark jobs to reduce processing time and resource consumption.
  • Cluster Management Collaborate with DevOps and infrastructure teams to manage Impala and Spark clusters on platforms like Hadoop/YARN, Kubernetes, or cloud platforms (AWS EMR, GCP Dataproc, etc.).
  • Migration Provide dedicated support to ensure the stability and reliability of the new ODP Hadoop environment during and after migration. Promptly address evolving technical challenges and optimise system performance after migration to ODP.
  • This role requires flexibility to work in rotational shifts, based on team coverage needs and customer demand.
    • Candidates should be comfortable supporting operations in a 24/7 environment and be willing to adjust their working hours accordingly.
Acceldata

About Acceldata

Acceldata provides an Agentic Data Management platform that simplifies and speeds the ability for enterprises to deliver trusted data for AI and other initiatives.

Founded in 2018, Campbell, CA-based Acceldata developed the world's first enterprise data observability platform to help enterprises build and operate great data products. Built on that foundation, Acceldata's xLake Reasoning Engine now powers the Agentic Data Management platform.

Acceldata's solutions have been embraced by global enterprises such as Nestle, Dun & Bradstreet, Hershey, Pubmatic, HCSC, PhonePe (Walmart), TPG Telecom (Australia), Jenius Bank, Merkle, Pubmatic, and many more.

Acceldata investors include Insight Partners, March Capital, Industry Ventures, Lightspeed, Sorenson Ventures, Sanabil, and Emergent Ventures.

Industry
IT & Software
Company Size
201-500 employees
Headquarters
Campbell, California
Year Founded
Unknown
Website
acceldata.io
Social Media