State Street

Senior Data Engineering Lead - Assistant Vice President 2

State Street  •  Bengaluru, IN (Onsite)  •  16 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

AVP 2 – Data Platform – Capability Engineer

State Street Investment Management’s Data, Analytics & AI Services (DAAIS) team is seeking a Senior Data Engineering Lead (Assistant Vice President –2) for our Bangalore, India office. This role is accountable for the design, build, and operate of modern data platform and software capabilities that enable the investment management business. The successful candidate will bring deep hands-on expertise in large-scale data platform architecture, distributed computing, data pipeline engineering, and modern cloud architecture. This role will execute on the broader platform roadmap in partnership with senior leadership and global stakeholders, and may lead a small team/pod to deliver reliable, scalable platform outcomes.

Key Responsibilities

  • Design and deliver core data platform capabilities (lakehouse, batch, events/streaming, metadata/catalog, observability, and security) with reliability, scalability, and operability.
  • Build and operate scalable batch and streaming pipelines on Snowflake and/or Databricks to deliver analytics-ready datasets.
  • Implement and optimize Apache Iceberg tables (partitioning, compaction, metadata) for consistent performance across compute engines.
  • Apply strong engineering practices across the SDLC: CI/CD, Infrastructure as Code (Terraform/CloudFormation), automated testing, schema/versioning, data quality, and end-to-end observability.
  • Partner with Product, Analytics, ML, and SMEs to implement data semantics and data product contracts (schemas, SLAs, documentation, versioning, access controls) aligned to governance and compliance.
  • Build curated semantic/serving models and publish governed consumption interfaces via BI and/or APIs.
  • Optimize pipeline and query performance and cost using partitioning/clustering, caching, lifecycle management (retention/purge), and workload tuning.
  • Own operational stability: troubleshoot issues, support backfills, participate in on-call/incident response, and drive root-cause fixes and reliability improvements.
  • Provide technical leadership for a small team/pod (as applicable), including planning, mentoring, performance reviews, and ensuring delivery and operational excellence.

Required Qualifications

  • 14+ years in software/data engineering; BS/MS in CS/Engineering (or equivalent experience).
  • Strong hands-on coding in Python and SQL (Java/Scala a plus).
  • Proven delivery of Lakehouse/data platform solutions using Databricks and/or Snowflake on AWS (GCP or Azure acceptable).
  • Strong Spark (batch/streaming) development and performance/cost tuning.
  • Experience with Apache Iceberg and table/catalog governance concepts (e.g., Unity Catalog or equivalent).
  • Production engineering practices: CI/CD, IaC (Terraform/CloudFormation), automated testing, security basics, and observability.
  • Ownership mindset for operations: on call/incident response, RCA, backfills, and reliability improvements; strong communication with global teams.

Preferred Qualifications

  • Financial services experience (asset management preferred).
  • Experience across structured + alternative/unstructured data, plus governance tooling (Snowflake Horizon/Unity Catalog/Collibra/Alation or similar).
  • Use of AI-assisted coding tools (e.g., GitHub Copilot, Claude Code) while maintaining code quality.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

State Street

About State Street

At State Street, we deliver leading investment platforms, data, expertise, and solutions that accelerate performance and better decision making.

With over 200 years of global financial leadership, we equip institutional investors through a comprehensive suite of capabilities:

Investment Services: Integrated front-to-back solutions across custody, accounting, and operations.

Investment Management: Index and active strategies from one of the world’s largest asset managers.

Markets: Multi-asset trading, FX solutions, and data-driven research to enhance portfolio value.

Who We Are

• 50,000+ employees worldwide

• Active in 100+ markets

• #1 in ETF servicing

What You’ll Find Here

• Executive perspectives and thought leadership

• Timely market commentary and macro insights

• Our views on investment operations, ETFs, private markets, and digital finance

• Stories reflecting our culture, values and commitment to diversity and inclusion

Industry
Finance & Insurance
Company Size
10,000+ employees
Headquarters
Boston, Massachusetts
Year Founded
1792
Social Media