Gridware

Senior Data Engineer, Data Lake & Governance

Gridware  •  San Francisco, CA (Onsite)  •  21 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

About GridwareGridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid. We pioneered a groundbreaking new class of grid management called active grid response (AGR), focused on monitoring the electrical, physical, and environmental aspects of the grid that affect reliability and safety. Gridware’s advanced Active Grid Response platform uses high-precision sensors to detect potential issues early, enabling proactive maintenance and fault mitigation. This comprehensive approach helps improve safety, reduce outages, and ensure the grid operates efficiently. The company is backed by climate-tech and Silicon Valley investors. For more information, please visit www.Gridware.io
As a Senior Data Engineer at Gridware, you’ll design and scale the data infrastructure that powers our real-time grid monitoring platform. You’ll build high-performance pipelines that transform massive streams of sensor and telemetry data into actionable insights - helping detect faults, predict failures, and strengthen the grid that powers entire communities.

Responsibilities

  • Deploy and manage Unity Catalog to standardize data governance, lineage, and access control across data domains.
  •  Design, develop, and maintain scalable data pipelines and architectures.
  • Implement data ingestion, transformation, and storage solutions.
  • Ensure data quality and integrity across various data sources and destinations.
  • Collaborate with software engineers, data scientists, analysts, and other stakeholders to meet data requirements.
  • Optimize and tune data workflows for performance and efficiency.
  • Monitor, troubleshoot, and resolve issues in data pipelines and related systems.
  • Document data processes, architecture, and workflow procedures.

Required Skills

  • 5+ years of professional experience in data engineering or related roles, building and scaling real-time data infrastructure
  • Experience designing and maintaining data lakes and lakehouse architectures with governance and access controls
  • Strong in Python and SQL, with deep experience in relational, time-series, and streaming databases
  • Hands-on with modern data stacks - Spark, Kafka, Databricks, Grafana, and other cloud-native tools
  • Skilled in data modeling, ETL/ELT pipelines, and real-time streaming architectures for production systems
  • Familiar with CI/CD, version control, and data governance/security best practices

Bonus Skills

  • Experience with real-time data processing and streaming analytics frameworks
  • Familiarity with IoT and embedded systems, including sensor data pipelines and edge computing
  • Hands-on with Docker, Kubernetes, and Protobuf in production environments
  • Exposure to machine learning workflows and real-time monitoring for IoT and time-series data
  • Comfortable operating in a high-growth startup environment, adapting quickly across domains
**At this time, Gridware is unable to provide visa sponsorship or immigration support for this role. We’re only able to consider candidates who are currently authorized to work in the country of employment without visa sponsorship now or in the future.**
This describes the ideal candidate; many of us have picked up this expertise along the way. Even if you meet only part of this list, we encourage you to apply!
BenefitsHealth, Dental & Vision (Gold and Platinum with some providers plans fully covered) Paid parental leave Alternating day off (every other Monday)“Off the Grid”, a two week per year paid break for all employees. Commuter allowance Company-paid training
Gridware

About Gridware

For most organisations in Australia, a data breach can be more than a PR disaster, it could be the final chapter. Gridware was established to help companies beat hackers with preventative strategies and superior security talent that is not available to other vendors on the market. We are specialised cybersecurity consultancy firm and an emerging global player in the cybersecurity intelligence and advisory field. The company was founded in 2017 and has headquarters in Sydney, Australia. Very quickly Gridware has become a recommended security partner of choice by leading ASX100 companies.

As the threat landscape continues to expand, more doors open for threat actors to explore and attack, putting organisations at immense risk of unauthorised access and loss of data. Gridware is at the forefront of understanding what your organisation needs to do to prevent a cyber security breach, which means you'll have the most talented team available on your cyber security journey.

Industry
Unknown
Company Size
11-50 employees
Headquarters
Sydney, AU
Year Founded
2017
Social Media