Quantiphi

Senior Data Engineer

Quantiphi  •  Republic of India (Onsite)  •  2 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.
43
AI Success™

Job Description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role: Senior Data Engineer - Snowflake

Experience Level: 4+ Years

Work location: Mumbai, Bangalore & Trivandrum

Notice Period: 0- 15 days

Role & Responsibilities

  • Design, develop, and optimize data loading techniques, virtual warehouses, and performance tuning within Snowflake.

  • Build complex SQL logics, stored procedures, and User-Defined Functions (UDFs) in Snowflake.

  • Implement and manage Snowflake data sharing and security features.

  • Design, develop, and orchestrate complex data pipelines using Azure Data Factory (ADF).

  • Work proficiently with Azure Data Lake Storage Gen2, Azure Blob Storage, and Azure SQL Database.

  • Integrate Azure Key Vaults for secure credential management within data solutions.

  • Perform advanced SQL querying, optimization, and data manipulation across various relational database systems.

  • Implement and manage CI/CD pipelines for data solutions, preferably using Azure DevOps, including version control (Git) and branching strategies.

  • Develop automated testing for data pipelines and data quality.

  • Apply solid understanding of dimensional modeling (Star Schema, Snowflake Schema) and data warehousing concepts.

  • Utilize strong programming skills in Python , Pyspark for data processing, scripting, and automation.

  • Solve complex analytical and data-related problems with meticulous attention to detail.

  • Lead the development of data pipelines and orchestration using Azure Data Factory (ADF) for data ingestion, cleansing, and transformation.

  • Lead, mentor, and conduct code reviews for Junior Data Engineers. Assist in development and developing automated testing for data pipelines and data quality.

  • Knowledge on financial processes such as budgeting, forecasting, financial reporting, accounts payable/receivable, sage intact general ledger , and treasury operations, and relevant financial regulations.

Skills expectation:

  • Snowflake Expertise: Deep expertise in Snowflake, data loading techniques, virtual warehouses, and performance tuning. Strong experience with Snowflake SQL / building complex logics, stored procedures, and UDFs. Experience with Snowflake data sharing and security features.

  • Azure Data Services (Expert): Azure Data Factory (ADF)-> Extensive experience designing, developing, and orchestrating complex data pipelines. Azure Data Storage-> Proficient with Azure Data Lake Storage Gen2, Azure Blob Storage, and Azure SQL Database. Azure Key Vaults-> Hands-on experience integrating Key Vaults for secure credential management.

  • SQL (Expert): Advanced SQL querying, optimization, and data manipulation skills. Experience with various relational database systems.

  • CI/CD (Advanced): Proven experience implementing and managing CI/CD pipelines for data solutions, preferably using Azure DevOps. Understanding of version control (Git) and branching strategies. Experience with automated testing for data pipelines and data quality.

  • Data Modeling: Solid understanding of dimensional modeling (Star Schema, Snowflake Schema) and data warehousing concepts.

  • Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail.

  • Python: Strong programming skills in Python for data processing, scripting, and automation. Experience with relevant libraries.

  • Domain Knowledge: Finance / Good to have Sage Intact GL knowledge.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Quantiphi

About Quantiphi

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of the business. Since its inception in 2013, Quantiphi has solved the toughest and most complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve accelerated and quantifiable business results. Learn more at www.quantiphi.com.

Industry
IT & Software
Company Size
1,001-5,000 employees
Headquarters
Marlborough, Massachusetts
Year Founded
2013
Social Media