Central Business Solutions Inc.

Senior Databricks AI Platform SRE

Central Business Solutions Inc.  •  Alpharetta, GA (Onsite)  •  5 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Senior Databricks AI Platform SRE

 We are looking for a Senior Databricks AI Platform SRE to join our Platform SRE team. This role will be critical in designing, building, and optimizing a scalable, secure, and developer-friendly Databricks platform to enable Machine Learning (ML) and Artificial Intelligence (AI) workloads at enterprise scale

You will partner with ML engineer, data scientists, platform teams, and cloud architects to automate infrastructure, enforce best practices, and streamline the end-to-end ML lifecycle using modern cloud-native technologies.

Total Experience – 5+ Years. Bachelor's or master's degree in computer science, Engineering or a related field.

Responsibilities:
  • Design and implement secure, scalable, and automated Databricks environments to support AI/ML workloads.
  • Develop infrastructure-as-code (IaC) solutions using Terraform for provisioning Databricks, cloud resources, and network configurations.
  • Build automation and self-service capabilities using Python, Java and APIs for platform onboarding, workspace provisioning, orchestration and monitoring.
  • Collaborate with data science and ML teams to define compute requirements, governance policies, and efficient workflows across dev/qa/prod environments.
  • Integrate Databricks offering with cloud-native services on Azure/AWS
  • Champion CI/CD and GitOps for managing ML infrastructure and configurations.
  • Ensure compliance with enterprise security and data governance policies using RBAC, Audit Controls, Encryption, Network Isolation, and policies.
  • Monitor platform performance, reliability, and usage, and drive improvements to optimize cost and resource utilizations
Required Skills:
  • Proven experience with Terraform for building and managing infrastructure.
  • Strong programming skills in Python and Java
  • Hands-on experience with cloud networking, identity and access management, key vaults, monitoring, and logging in Azure
  • Hands on experience with Databricks (Workspace management, Clusters, Jobs, MLFlow, Delta Lake, Unity Catalog, Mosaic AI)
  • Deep understanding of Azure or AWS infrastructure (e.g. IAM, VNets/VPC, Storage, Networks, Compute, Key management, monitoring)
  • Strong experience in distributed system design, development and deployment using agile/devops practices.
  • Experience with CI/CD pipelines (GitHub Actions, or similar)
  • Experience implementing monitoring and observability using Prometheus, Grafana or Databricks-native solutions.
  • Good communication skills, excellent teamwork experience, ability to mentor and develop more junior developers, including participating in constructive code reviews
Preferred Skills:
  • Experience in multi-cloud environments (AWS/GCP) is a bonus
  • Experience in working in highly regulated environments (finance, healthcare, etc.) is desirable
  • Experience with Databricks REST APIs and SDKs
  • Knowledge of MLFlow, Mosaic AC, & MLOps tooling
  • Working with teams using Scrum, Kanban or other agile practices
  • Proficiency with standard Linux command line and debugging tools
  • Azure or AWS Certifications
Central Business Solutions Inc.

About Central Business Solutions Inc.

Central Business Solutions Inc (CBS), founded in 2000 and headquartered in Newark, California, has carved a niche for itself in the global business solutions market. Our experience spans across various industries, serving both small businesses and Fortune 500 companies. Here's a breakdown of our core offerings:

Technology Solutions: CBS acts as your IT department's backbone, offering a comprehensive suite of services. We provide expert guidance on crafting a technology strategy that aligns with your business goals. This includes consulting on system architecture and implementation, ensuring your infrastructure is built for efficiency and scalability. Our expertise extends to software development, crafting custom solutions or integrating existing ones to streamline operations. But CBS doesn't stop at setup; we also provide ongoing maintenance and support to keep your technology running smoothly.

Outsourcing: Whether you need to supplement your existing IT staff or completely outsource your IT department, CBS offers flexible solutions. We can provide qualified personnel to handle specific tasks like software development, UI/graphic design, or recruitment. Alternatively, we can take over the entire IT management responsibility, freeing your internal team to focus on core business functions.

Consulting: Our expertise extends beyond technology. CBS offers consulting services to help you achieve your overall business goals. Our team of experienced professionals can analyze your operations and identify areas for improvement. We'll develop data-driven strategies to streamline processes, enhance efficiency, and ultimately deliver bottom-line results.

In essence, Central Business Solutions Inc goes beyond just being a vendor. We position ourselves as a strategic partner for businesses. By combining our IT prowess with business acumen, we help clients optimize technology infrastructure, streamline operations, and achieve sustainable success.

Industry
IT & Software
Company Size
51-200 employees
Headquarters
Newark, CA
Year Founded
2000
Social Media