Brillio

Lead Data Engineer - R01569363

Brillio  •  Bengaluru, IN (Onsite)  •  9 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Lead Data Engineer

Primary Skills

  • AKS, Event Hub, Azure DevOps, Azure sentinel, Cosmos DB, Azure Functions

Specialization

  • Azure Data Engineering Advanced: Senior Lead Data Engineer

Job requirements

  • Experience Range: with at least 4 to 6 years of hands-on experience in data engineering, including substantial expertise in Azure analytics and pipeline development Key Responsibilities: 1. Design and implement scalable ETL processes using Azure Data Factory, Synapse Analytics, and Spark, delivering robust real-time and batch data feeds 2. Develop and optimize data pipelines and models for large-scale lakehouse and warehouse analytics systems, achieving high performance and reliability targets 3. Integrate and manage data sources from Azure Data Explorer, Kusto, and Delta Lake formats to enable advanced analytics and reporting capabilities 4. Configure and maintain cloud-hosted data architectures, leveraging Azure services to ensure secure, efficient, and resilient data operations 5. Collaborate with cross-functional teams to capture data requirements and drive test-driven, data-driven development methodologies 6. Monitor, troubleshoot, and enhance SQL performance, ensuring efficient query execution and maintaining data quality across all systems 7. Develop and maintain Power BI reports, focusing on data modeling and DAX to deliver actionable insights to stakeholders 8. Document technical business processes and data architecture, supporting organizational knowledge sharing and compliance Required Skills: 1. Azure Synapse Analytics 2. Azure Data Factory 3. Azure Data Explorer (Kusto) 4. Pyspark 5. Delta Lake 6. SQL performance tuning 7. Power BI (Data Modeling and DAX) 8. Azure Data Lake Preferred Skills: 1. Azure DevOps for CI/CD 2. AKS (Azure Kubernetes Service) 3. Event Hub 4. Azure Sentinel 5. Experience with large-scale streaming analytics Desired Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline 2. Microsoft Certified: Azure Data Engineer Associate 3. Microsoft Certified: Azure Solutions Architect Expert Additional Information: Location: Bangalore
Brillio

About Brillio

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Founded in 2014 as a digitally native full-service digital transformation services and consulting firm, we apply our expertise in customer experience transformation, data analytics, Artificial Intelligence (AI), platform and product engineering, cloud infrastructure, and security to help clients quickly innovate for growth, create digital products, build service platforms, and drive smarter, data-driven performance.

Headquartered in Dallas, Texas, we are powered by a diverse global team of world-class professionals across the U.S., the UK, Romania, Canada, Mexico and India, and are certified a Great Place to Work®. We help clients harness the transformative potential of the four superpowers of technology: cloud computing, Internet of Things (IoT), AI, and mobility. We bring deep expertise across the full spectrum of digital capabilities:

• Accelerating customer experience transformation to drive growth, customer advocacy, and superior customer experience

• Powering intelligent enterprises by harnessing the potential of data, analytics, and AI

• Crafting products of relevance with a product mindset and high-performance engineering

• Enabling enterprise agility with resilient cloud infrastructure and security

To learn more, please visit https://www.brillio.com/ and follow us here or @brillioglobal.

Industry
Unknown
Company Size
5,001-10,000 employees
Headquarters
Dallas, Texas
Year Founded
Unknown
Social Media