hireVouch

Senior Software Engineer - Data Platform

hireVouch  •  Toronto, CA (Onsite)  •  17 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

About the role

We’re looking for an engineer who thrives on building scalable data platforms and enjoys tackling complex backend challenges. This isn’t just a data engineering role, you’ll be designing and optimizing the data platform that powers our API, managing everything from data streaming and storage to analytics features at petabyte scale.

You should be comfortable navigating both data and backend engineering, with a solid foundation in software development. You’ll work with advanced data architectures, including Iceberg, Flink, and Kafka, tackling large-scale challenges and contributing to core product development using Java and Python. If you’re excited by the opportunity to shape a high-impact platform and tackle diverse engineering problems, we’d love to hear from you.

What you will do

  • Own projects aimed at enhancing data replication, storage, enrichment, and reporting capabilities.

  • Build and optimize efficient streaming and batch data pipelines that support our core product and API.

  • Design scalable storage solutions for handling petabytes of IoT and time-series data.

  • Develop and maintain real-time data systems to ingest growing data volumes.

  • Implement distributed tracing, data lineage and observability patterns to improve monitoring and troubleshooting.

  • Write clean, maintainable code in Java and Python for various platform components.

  • Shape architectural decisions to ensure scalability and reliability throughout the data platform.

The ideal candidate will have

  • 3+ years of experience in platform engineering or data engineering.

  • 2+ years of experience designing and optimizing data pipelines at TB to PB scale.

  • Proficient in Java, with a focus on clean, maintainable code.

  • Strong system design skills with a focus on big data and real-time workflows.

  • Familiarity with lake-house architectures (e.g., Iceberg, Delta, Paimon).

  • Experience with real-time data processing tools like Kafka, Flink and Spark.

  • Knowledge of distributed systems and large-scale data challenges.

  • Strong problem-solving skills and a collaborative mindset.

Note: You don't need to check every box. Java experience is strongly preferred, but if you're confident you can pick it up quickly, we're open to that. Same goes for other competencies on this list.

Nice to haves

  • Experience working with orchestration / workflow engines (e.g. Step Functions, Temporal)

  • Experience with serverless and/or event-driven architectures (e.g. AWS Lambda, SQS).

  • Experience with Javascript/Typescript languages (for cross team work)

Tech stack

  • Languages: Java, Python

  • Framework: Springboot

  • Storage: AWS S3, AWS DynamoDB, Apache Iceberg, Redis

  • Streaming: AWS Kinesis, Apache Kafka, Apache Flink

  • ETL: AWS Glue, Apache Spark

  • Serverless: AWS SQS, AWS EventBridge, AWS Lambda and Step Functions.

  • Infrastructure as Code: AWS CDK

  • CI/CD: GitHub Actions

hireVouch

About hireVouch

Our Edge

Hiring and retaining skilled talent is paramount for your company’s success. Finding the right people – who have the right skills and right personality fit – can be incredibly challenging in today’s job market. Here at hireVouch we can help you acquire the highest calibre candidates through the relationships we have formed over more than a decade. Our approach is an ethical one. Rather than use the often-employed aggressive methods typical of the recruitment industry, our focus is placed largely on referral-based networking.

Getting it right really matters to us. Let us leverage our network of talent that has already been vouched for by leading professionals in the industry to help your business grow.

Services Offered

Contingency and Retained Search

Here at hireVouch we focus on sourcing best-in-class candidates for rewarding positions in Canada and the US. We have extensive expertise in Contingency, Retained and Temporary placement, primarily within the IT sector.

On-Site Search Assistance

We have a trusted network of HR and search professionals who can provide on-site search services to help fulfill immediate needs as well as help train internal staff in finding the highest quality talent

Company Marketing Strategy

We know how competitive the job market can truly be and how important it is to have a strategy to attract talent. At hireVouch we have extensive expertise in helping companies better market themselves. We can provide the tools and knowledge that will assist you in making your business a highly attractive place to work. Developing a company marketing strategy is key to hiring the talent you need to grow.

Industry
HR & Recruiting
Company Size
1-10 employees
Headquarters
Unknown
Year Founded
2016
Social Media