Brillio

Lead Data Engineer - R01561308

Brillio  •  Chicago, IL (Onsite)  •  1 month ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

About Brillio:
Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction. Brillio takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. Brillio's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.
Data Architect

Primary Skills

  • Athena, Step Functions, Spark - Pyspark, ETL Fundamentals, SQL (Basic + Advanced), Glue, Python, Lambda, Data Warehousing, EBS /EFS, AWS EC2, Lake Formation, Aurora, S3, Modern Data Platform Fundamentals, PLSQL, Data Modelling Fundamentals, Cloud front

Job requirements

  • About the Role
  • We are seeking an experienced Data Engineer to design and build scalable, cloud-native data platforms supporting IoT, operational systems, and enterprise analytics.
  • This role requires a hands-on technical leader who can architect modern data pipelines, enable real-time and batch ingestion, and design performant serving layers for APIs and applications.
  • The ideal candidate blends deep AWS expertise, strong data modeling skills, and the ability to translate business requirements into scalable technical solutions.

  • Key Responsibilities
  • Data Engineering & Architecture
  • Architect ingestion pipelines for streaming and event-based data (IoT telemetry)
  • Implement time-window logic and event-to-state transformations
  • Design, build, and optimize data pipelines using AWS Glue, Lambda, and Step Functions for ingestion, transformation, and curation.
  • Develop and maintain data lakes (S3 + Lake Formation) and data warehouses (Redshift) to support analytics and visualization.
  • Integrate Aurora (PostgreSQL/MySQL) as a serving layer for APIs and dashboards.
  • Design APIs or direct query interfaces that expose curated datasets for React-based dashboards and web applications.
  • Define and implement data models, partitioning strategies, and schema evolution best practices for performance and scalability.

  • Security, Governance & Compliance
  • Implement data security policies, encryption, and role-based access controls using AWS IAM, KMS, Lake Formation, and Secrets Manager.
  • Ensure compliance with organizational data governance and privacy standards.
  • Maintain data cataloging, lineage, and access tracking within AWS Glue Data Catalog and Lake Formation.
  • Implement CI/CD pipelines for data workflows in collaboration with DevOps teams.

  • Required Skills & Qualifications
  • 12+ years of experience in data engineering and AWS data architecture.
  • Strong expertise with AWS Glue, Redshift, S3, Lake Formation, Aurora (Postgres/MySQL).
  • Proven experience building APIs or exposing curated datasets for web applications (preferably React or similar front-end frameworks).
  • Strong programming skills in Python and SQL.
  • Experience with data modeling, ETL/ELT frameworks, and performance optimization.
  • Working knowledge of Terraform/CloudFormation and CI/CD practices.
  • Understanding of data security, IAM policies, encryption, and governance frameworks.

  • Preferred Skills
  • Experience with Athena for ad-hoc analytics.
  • Familiarity with API Gateway, AppSync, or GraphQL APIs for serving data to front-end applications.
  • Knowledge of event-driven pipelines (Kinesis, EventBridge, kafka) and data quality monitoring.

  • Know more about DAE: https://www.brillio.com/services-data-analytics/
    Know what it’s like to work and grow at Brillio: https://www.brillio.com/join-us/
    Equal Employment Opportunity Declaration
  • Brillio is an equal opportunity employer to all, regardless of age, ancestry, colour, disability (mental and physical), exercising the right to family care and medical leave, gender, gender expression, gender identity, genetic information, marital status, medical condition, military or veteran status, national origin, political affiliation, race, religious creed, sex (includes pregnancy, childbirth, breastfeeding, and related medical conditions), and sexual orientation.

  • #LI-SR1
 Know what it’s like to work and grow at Brillio: Click here
Brillio

About Brillio

Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Founded in 2014 as a digitally native full-service digital transformation services and consulting firm, we apply our expertise in customer experience transformation, data analytics, Artificial Intelligence (AI), platform and product engineering, cloud infrastructure, and security to help clients quickly innovate for growth, create digital products, build service platforms, and drive smarter, data-driven performance.

Headquartered in Dallas, Texas, we are powered by a diverse global team of world-class professionals across the U.S., the UK, Romania, Canada, Mexico and India, and are certified a Great Place to Work®. We help clients harness the transformative potential of the four superpowers of technology: cloud computing, Internet of Things (IoT), AI, and mobility. We bring deep expertise across the full spectrum of digital capabilities:

• Accelerating customer experience transformation to drive growth, customer advocacy, and superior customer experience

• Powering intelligent enterprises by harnessing the potential of data, analytics, and AI

• Crafting products of relevance with a product mindset and high-performance engineering

• Enabling enterprise agility with resilient cloud infrastructure and security

To learn more, please visit https://www.brillio.com/ and follow us here or @brillioglobal.

Industry
Unknown
Company Size
5,001-10,000 employees
Headquarters
Dallas, Texas
Year Founded
Unknown
Social Media