Blue Pearl HQ

Senior Solutions Architect (Databricks Specialist)

Blue Pearl HQ  •  Remote  •  1 day ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description


This is a remote position.


We are seeking an experienced
Senior Solutions Architect specializing in Databricks

to provide strategic leadership and architectural oversight for a large-scale data modernization program within a leading Financial Services organization.


The client is currently transitioning from a traditional SQL Server and Microsoft-centric data ecosystem to a modern Databricks-based platform to support its long-term data, analytics, and AI strategy. While the client has an established and capable Data Engineering team, they require a senior-level architect to provide strategic direction, implementation frameworks, architectural governance, and best-practice guidance to ensure a successful and cost-effective transformation.


  • This role will focus on defining the target-state architecture, establishing standards and governance, optimizing platform design, and ensuring alignment between technology investments and business objectives.


Key Responsibilities


  • Provide strategic architectural leadership for the organisation's Databricks implementation and data modernization initiatives.

  • Design and define enterprise-scale data and analytics architectures aligned to business and AI objectives.

  • Develop and implement architectural frameworks, standards, patterns, and best practices for Databricks adoption.

  • Guide the Data Engineering team on solution design, scalability, performance optimization, security, and governance.

  • Assess current SQL Server and Microsoft-based environments and define migration strategies to Databricks.

  • Ensure architecture decisions support future AI, machine learning, advanced analytics, and reporting requirements.

  • Evaluate and optimize platform utilization to drive cost efficiency and maximize return on investment.

  • Establish governance, architecture review processes, and implementation roadmaps.

  • Provide executive-level insights and recommendations on technology direction, risks, opportunities, and investments.

  • Collaborate with business stakeholders, technology leadership, engineering teams, and vendors to drive successful outcomes.

  • Oversee solution quality and ensure alignment with enterprise architecture principles and regulatory requirements.

  • Identify technical risks, dependencies, and potential challenges, implementing mitigation strategies where required.

  • Mentor engineering teams and promote architectural excellence across the program


Requirements


Required Technical Skills


Essential


  • Deep expertise in
    Databricks architecture, implementation, and optimization

  • Strong understanding of enterprise data platforms and modern data architectures

  • Data Lakehouse architecture design and implementation

  • Data governance, security, compliance, and data management frameworks

  • Data migration strategy and execution

  • Enterprise integration patterns and cloud-based architectures

  • Analytics, Business Intelligence, and AI/ML platform enablement


Preferred


  • Experience with Microsoft Azure Data Services

  • Azure Data Factory

  • Azure Synapse Analytics

  • SQL Server

  • Delta Lake

  • Unity Catalog

  • DataOps and DevOps practices

  • AI and Machine Learning platform architecture


Essential Experience & Qualifications


  • 10+ years of experience in Solution Architecture, Enterprise Architecture, or Data Architecture roles.

  • Demonstrated experience delivering large-scale data transformation and modernization initiatives.

  • Extensive experience designing and implementing Databricks solutions in enterprise environments.

  • Proven track record supporting cloud migration and modern data platform programs.

  • Experience within Financial Services, Banking, Insurance, or highly regulated environments.

  • Strong understanding of data governance, security, compliance, and risk management frameworks.

  • Experience developing enterprise architecture standards, frameworks, and governance models.

  • Relevant certifications in Databricks, Cloud Platforms (Azure preferred), TOGAF, or related disciplines are highly advantageous.


Key Competencies


Strategic Leadership


  • Ability to align technology architecture with long-term business strategy.

  • Strong commercial acumen and focus on value delivery.

  • Ability to influence technology direction at executive level.


Stakeholder Engagement


  • Comfortable engaging with C-suite executives and senior business leaders.

  • Strong communication, presentation, and facilitation skills.

  • Ability to simplify complex technical concepts for non-technical audiences.


Architecture & Governance


  • Excellent architectural design and decision-making capabilities.

  • Strong focus on governance, standards, and best practices.

  • Ability to drive consistency across multiple teams and initiatives.


Delivery & Outcomes


  • Results-driven with a focus on business impact and measurable outcomes.

  • Strong problem-solving and analytical thinking skills.

  • Ability to work independently while guiding large technical teams.


Ideal Candidate Profile


The ideal candidate is a highly experienced
Senior Solutions Architect with deep Databricks expertise

, capable of providing strategic oversight to an established engineering team. They will bring extensive experience in enterprise data transformation, architecture governance, and cloud-based analytics platforms. The successful individual will be comfortable operating at executive level, influencing business and technology strategy, while ensuring Databricks is implemented in a scalable, cost-effective, and future-ready manner that supports the organisation's AI and data ambitions.

Blue Pearl HQ

About Blue Pearl HQ

Blue Pearl is a market-leading CLOUD Solutions developer with extensive knowledge and insight into the latest technologies, standardised processes, advanced technical capabilities and consulting processes available, ensuring wholistic success for our clientele. We offer professional consulting to compliment your business strategy and overall management and make it our priority to add value to any business by listening, analysing and creating a conducive solution that will empower our client.

We implement a Data Analysis Process that includes inspecting, cleansing, transforming, and modelling data with the end-goal of discovering useful information, informing conclusions, and relevant information to support your decision-making. Your business cannot afford not to engage with us, allowing our data analysis to play a role in making your business decisions more scientific and helping your business achieve effective operation.

Blue Pearl’s team of experts include BI strategists, BI analysts, Data Warehouse Architects, Data Scientists, Implementation and Development experts. With the use of BI, Analytics and Big Data, we effectively partner with our customers on their mission to achieve a competitive business advantage and real ROI from the structured information we collect.

Industry
IT & Software
Company Size
11-50 employees
Headquarters
Johannesburg, ZA
Year Founded
2013
Social Media