Quantiphi

Senior Technical Architect - Databricks

Quantiphi  •  Republic of India (Hybrid)  •  16 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Required Skills:

  • Experience: 15+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.

  • Experience with Databricks implementations - developing data pipelines using PySpark

  • Experience in Databricks Workspaces,Notebooks, Delta Lake, APIs

  • Expertise in production grade solutions using: AWS (Redshift, S3, Glue, Lambda, Airflow), Pyspark, Python, Data pipelines using Glue/Airflow/Sagemaker.

  • Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases

  • Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.

  • Exposure to ETL tools and Data warehouse.

  • Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)

  • Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.

  • Experience building and supporting large-scale systems in a production environment.

  • Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads.

  • Experience using Github/codecommit for developmental activities

Good to have skills:

  • Experience with AWS services - S3,Redshift,Secrets Manager
  • Experience in implementing data integration projects using ETL

  • Experience in using Airflow or Step Functions for orchestration

  • Exposure to IaC tools like Terraform and to CI/CD tools

  • Prior experience in migrating (on-prem to cloud) and processing large amounts of data

  • Experience in implementing data lake and data warehouse on cloud

  • Experience in implementing the industry's best practices

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Quantiphi

About Quantiphi

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of the business. Since its inception in 2013, Quantiphi has solved the toughest and most complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve accelerated and quantifiable business results. Learn more at www.quantiphi.com.

Industry
IT & Software
Company Size
1,001-5,000 employees
Headquarters
Marlborough, Massachusetts
Year Founded
2013
Social Media