KATBOTZ®

Databricks SME (Subject Matter Expert)

KATBOTZ®  •  Remote  •  1 day ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description


This is a remote position.


KATBOTZ

is seeking an experienced Databricks SME to support enterprise-level data engineering and analytics initiatives. The ideal candidate will have deep expertise in the Databricks ecosystem, big data technologies, cloud platforms, and modern data architecture. The candidate will work closely with cross-functional teams to design, optimize, and implement scalable data solutions for global clients.


Key Responsibilities


  • Lead the design, development, and optimization of Databricks-based data platforms and pipelines.


  • Provide technical expertise on Databricks architecture, performance tuning, and best practices.


  • Build scalable ETL/ELT workflows using Apache Spark and Databricks.


  • Collaborate with business stakeholders, architects, and engineering teams to gather requirements and deliver solutions.


  • Implement Delta Lake, data governance, and data quality frameworks.


  • Support migration of legacy data platforms to Databricks.


  • Optimize data processing workflows for performance and cost efficiency.


  • Mentor development teams on Databricks, Spark, and cloud-native solutions.


  • Troubleshoot production issues and provide timely resolutions.


  • Ensure adherence to security, compliance, and coding standards.


Required Skills & Qualifications


  • 10+ years of experience in Data Engineering and Big Data technologies.


  • Strong hands-on expertise in Databricks and Apache Spark.


  • Experience with Python, PySpark, SQL, and Scala.


  • Expertise in Delta Lake, Unity Catalog, and Databricks Workflows.


  • Strong understanding of data warehousing and modern lakehouse architecture.


  • Experience with cloud platforms such as Microsoft Azure, Amazon AWS, or Google GCP.


  • Experience integrating Databricks with BI and reporting tools.


  • Knowledge of CI/CD pipelines and DevOps practices.


  • Strong analytical and problem-solving skills.


  • Excellent communication and stakeholder management abilities.


Preferred Qualifications

  • Databricks Certified Professional certification.


  • Experience in real-time streaming using Kafka or Structured Streaming.


  • Exposure to AI/ML workflows within Databricks.


  • Prior experience working with global remote teams.


Benefits

  • Competitive compensation package

  • Opportunities for professional development and career advancement.

  • Flexible working conditions, with remote options available.

  • Dynamic and supportive work environment.

Equal Employment Opportunity


KATBOTZ LLC is an Equal Opportunity Employer. We provide equal employment opportunities to all qualified individuals, regardless of race, religion, gender, gender identity, age, marital status, national origin, sexual orientation, citizenship status, veteran status, disability, or any other legally protected status. As an organization, we are unwavering in our commitment to maintaining a discrimination-free work environment, and fostering a culture of inclusivity, belonging and equal opportunity for all employees and applicants.

KATBOTZ®

About KATBOTZ®

Making Business Transformation Real

KATBOTZ is a business consulting and tech-innovation firm empowering enterprise transformation through SAP and next-generation digital solutions. With deep expertise in finance transformation, data integration, M&A advisory, and end-to-end project delivery, we help organizations reimagine possibilities, accelerate growth, and thrive in a smarter, more connected world. Backed by a network of 100+ consultants and domain experts, KATBOTZ combines global experience with deep industry insight across Life Sciences, High Tech, Consumer Goods, and Manufacturing.

Combining strategy, technology, and human capability, KATBOTZ drives organizations to simplify complexity, accelerate growth, and achieve continuous performance in a world defined by change and opportunity.

Our Core Focus Areas include:

Business Consulting: We are driving SAP S/4HANA transformations, optimizing financial and operational processes, and embedding analytics that enhance transparency, efficiency, and decision-making.

Technology & Innovation: We are creating intelligent ecosystems that connect SAP S/4HANA, SAP Analytics Cloud, and AI-powered dashboards for smarter control and faster insight. From CFO Dashboards to data conversion, migration, and pipelines, our goal is to create connected ecosystems that automate workflows, enhance visibility, and deliver real business value.

Education & Capability Building: We are empowering teams with the digital, ERP, and leadership capabilities needed to lead transformation confidently and sustainably.

Talent Solutions: We are providing specialized professionals through targeted recruitment and staff augmentation, ensuring every stage of delivery is supported by the right expertise.

Our approach unites deep expertise, lean delivery, and global scalability, helping enterprises modernize systems, strengthen financial control, and achieve lasting transformation.

Industry
Consulting & Advisory
Company Size
11-50 employees
Headquarters
Bridgewater, NJ
Year Founded
2021
Social Media