Weekday (YC W21)

Flink Manager

Weekday (YC W21)  •  United States (Remote)  •  3 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

This role is for one of the Weekday's clientsa

Salary range: Rs 10000000 - Rs 40000000 (ie INR 100 - 400 LPA)

Min Experience: 8 years

Location: United States

JobType: full-time

As a Flink Manager, you will be responsible for driving real-time streaming initiatives, managing high-performing engineering teams, and architecting scalable data solutions that power mission-critical business applications. You will collaborate closely with product, analytics, infrastructure, and leadership teams to translate business requirements into resilient streaming architectures.

Requirements

Key Responsibilities

  • Lead the design, development, and deployment of real-time data processing pipelines using Apache Flink
  • Architect scalable, fault-tolerant, and low-latency streaming systems leveraging Flink’s DataStream and Table APIs.
  • Manage end-to-end lifecycle of Flink applications including development, testing, optimization, monitoring, and production support.
  • Drive best practices for state management, checkpointing, windowing, event-time processing, and fault tolerance in Flink.
  • Optimize Flink job performance, resource allocation, and cluster tuning for high-throughput environments.
  • Oversee integration of Flink with distributed systems such as Kafka, data lakes, warehouses, and microservices.
  • Lead and mentor a team of data engineers, conducting code reviews and enforcing engineering excellence standards.
  • Collaborate with DevOps teams to manage Flink deployments on cloud and on-prem environments.
  • Establish monitoring, logging, and alerting mechanisms for streaming pipelines to ensure high availability and reliability.
  • Contribute to roadmap planning for streaming and real-time analytics platforms.

Required Qualifications

  • 8–12 years of overall experience in data engineering, distributed systems, or backend engineering.
  • Strong hands-on expertise in Apache Flink (minimum 3–5 years preferred).
  • Deep understanding of stream processing concepts including event-time semantics, watermarking, state backends, and exactly-once guarantees.
  • Proven experience designing and managing high-throughput, low-latency Flink pipelines.
  • Strong programming skills in Java or Scala for Flink development.
  • Experience with distributed messaging systems (e.g., Kafka) and data storage systems.
  • Familiarity with cluster resource management frameworks (YARN, Kubernetes, or similar).
  • Strong debugging, troubleshooting, and performance tuning skills specific to Flink workloads.
  • Experience leading engineering teams and managing cross-functional stakeholders.

Preferred Qualifications

  • Experience deploying Flink in cloud environments (AWS, Azure, or GCP).
  • Knowledge of batch and stream unification architectures.
  • Exposure to big data ecosystems including Hadoop or Spark.
  • Understanding of CI/CD practices for streaming applications.
  • Experience implementing real-time analytics, fraud detection, personalization, or IoT streaming use cases.

Leadership Expectations

The ideal candidate is a strategic thinker and technical leader who can balance hands-on involvement with managerial responsibilities. You will champion best practices in Flink architecture, ensure production stability, and drive continuous improvement across streaming platforms.

Weekday (YC W21)

About Weekday (YC W21)

AI recruiter that runs outbound sourcing campaigns to find top talent. At Weekday, we have built the most accurate database of talent (250mn+ people in US & India with contact data), we run outbound campaigns to identify top talent for any role you might be hiring for. We generate the highest response rates (30-40%) on our campaigns making sourcing talent as easy as making a job posting. We are backed by Y-Combinator and were also ranked #1 on Product Hunt.

Industry
Consulting & Advisory
Company Size
51-200 employees
Headquarters
San Fransisco, CA
Year Founded
2021
Social Media