Rubicon Path

Databricks Data Engineer

Rubicon Path  •  Toronto, CA (Onsite)  •  2 months ago
Apply
Save Job
Mark Applied Mark Interviewed Mark Offered
Hide Job Report Job
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Who we are looking for

This is a hands-on Data Engineer position. We are looking for candidate with good knowledge on Bigdata technology and strong development experience with Databricks.

What you will be responsible for

As Data Engineer you will

  • Design & Develop custom high throughput and configurable frameworks/libraries
  • Architect and implement scalable data ingestion pipelines using Azure Data Factory and Databricks
  • Transform raw datasets into structured data lakes (Medallion architecture: bronze, silver, gold)
  • Convert Hive Metastore to Unity Catalog and configure associated permissions
  • Design and secure Delta tables with appropriate schema and access controls
  • Enable business intelligence through Power BI integration and dashboard-ready datasets

What we value

These skills will help you succeed in this role

  • Experience performing data analysis and data exploration
  • Experience working in an agile delivery environment
  • Strong knowledge on Databricks SQL/Scala - Data engineering pipeline
  • Strong Experience in Unix, Python and complex SQL
  • Strong critical thinking, communication, and problem-solving skills
  • Strong hands-on experience in troubleshooting DevOps pipelines and Azure services
  • Azure cloud, Apache PySpark

Education & Preferred Qualifications

  • Bachelors Degree level qualification in a computer or IT related subject
  • 5+ years of Databricks hands on experience
  • Data Bricks Data Engineer Professional Certification
Rubicon Path

About Rubicon Path

Crossing the Rubicon isn’t just an ancient tale; it’s a daily reality for businesses seeking to navigate the complex business and technology landscape. Meet Rubicon Path, the premier technology consulting and professional services firm focused on Data Management and Artificial Intelligence solutions.

Proudly serving our clients, our delivery team have developed deep expertise in business operations and artificial intelligence solutions. We continue to evolve and learn in the fast-paced realm of emerging technologies and methodologies, staying ahead isn’t an option; it’s a necessity.

Our approach is personal. Our relationships, long-term. Ready to cross the Rubicon to success?

Industry
IT & Software
Company Size
1-10 employees
Headquarters
Toronto, CA
Year Founded
2019
Website
rubiconpath.com
Social Media