Brillio

Fabric Lead Data Engineer - R01558819

Brillio  •  Chennai, IN (Onsite)  •  4 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

About the Role

We are seeking a Microsoft Fabric Data Engineer with 7+ years of experience for a lead role. The ideal candidate will be responsible for designing, developing, and deploying data pipelines, ensuring efficient data movement and integration within Microsoft Fabric.

Responsibilities

Data Pipeline Development: Design, develop, and deploy data pipelines within Microsoft Fabric, leveraging OneLake, Data Factory, and Apache Spark to ensure efficient, scalable, and secure data movement across systems.ETL Architecture: Architect and implement ETL workflows optimized for Fabric’s unified data platform, streamlining ingestion, transformation, and storage.Data Integration: Build and manage integration solutions that unify structured and unstructured sources into Fabric’s OneLake ecosystem. Utilize SQL, Python, Scala, and R for advanced data manipulation.Fabric OneLake & Synapse: Leverage OneLake as the single data lake for enterprise-scale storage and analytics, integrating with Synapse Data Warehousing for big data processing and reporting.Cross-functional Collaboration: Partner with Data Scientists, Analysts, and BI Engineers to ensure Fabric’s data infrastructure supports Power BI, AI workloads, and advanced analytics.Performance Optimization: Monitor, troubleshoot, and optimize Fabric pipelines for high availability, fast query performance, and minimal downtime.Data Governance & Security: Implement governance and compliance frameworks within Fabric, ensuring data lineage, privacy, and security across the unified platform.Leadership & Mentorship: Lead and mentor a team of engineers, oversee Fabric workspace design, code reviews, and adoption of new Fabric features.Automation & Monitoring: Automate workflows and orchestration using Fabric Data Factory, Azure DevOps, and Airflow, ensuring smooth operations.Documentation & Standards: Document Fabric pipeline architecture, data models, and ETL processes. Contribute to Fabric engineering best practices and enterprise guidelines.Innovation: Stay current with Fabric’s evolving capabilities (Real-Time Analytics, Data Activator, AI integration) and drive innovation within the team.

Qualifications

7+ years of experience in data engineering, with a strong focus on Microsoft Fabric and related technologies.

Required Skills

Proficiency in SQL, Python, Scala, and R.Experience with data pipeline development and ETL processes.Strong understanding of data governance and security practices.Ability to lead and mentor a team effectively.

Preferred Skills

Experience with Azure DevOps and Airflow.Familiarity with Power BI and AI workloads.Knowledge of real-time analytics and data activator features.

Pay range and compensation package

Competitive salary based on experience and qualifications.

Equal Opportunity Statement

We are committed to creating a diverse and inclusive environment for all employees. We encourage applications from individuals of all backgrounds and experiences.

Primary Skills

  • AKS, Event Hub, Azure DevOps, Cosmos DB, Azure Functions

Specialization


Job requirements


Brillio

About Brillio

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Founded in 2014 as a digitally native full-service digital transformation services and consulting firm, we apply our expertise in customer experience transformation, data analytics, Artificial Intelligence (AI), platform and product engineering, cloud infrastructure, and security to help clients quickly innovate for growth, create digital products, build service platforms, and drive smarter, data-driven performance.

Headquartered in Dallas, Texas, we are powered by a diverse global team of world-class professionals across the U.S., the UK, Romania, Canada, Mexico and India, and are certified a Great Place to Work®. We help clients harness the transformative potential of the four superpowers of technology: cloud computing, Internet of Things (IoT), AI, and mobility. We bring deep expertise across the full spectrum of digital capabilities:

• Accelerating customer experience transformation to drive growth, customer advocacy, and superior customer experience

• Powering intelligent enterprises by harnessing the potential of data, analytics, and AI

• Crafting products of relevance with a product mindset and high-performance engineering

• Enabling enterprise agility with resilient cloud infrastructure and security

To learn more, please visit https://www.brillio.com/ and follow us here or @brillioglobal.

Industry
Unknown
Company Size
5,001-10,000 employees
Headquarters
Dallas, Texas
Year Founded
Unknown
Social Media