Bonapolia

Middle/Senior Data Engineer

Bonapolia  β€’  Madrid, ES (Onsite)  β€’  1 hour ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

🧠 Tech Level: Middle

πŸ—£οΈ Language Proficiency: Upper-Intermediate

🧾 Employment type: Full time

🌍 Candidate Location: Poland, Kazakhstan, EU, Georgia, Armenia, Serbia.

πŸ• Working Time Zone: CET

πŸš€ Start: ASAP

🧭 Planned Work Duration: by the end of the year

πŸ‘₯ Customer Description:

The customer is a global mobility platform providing on-demand transportation services.

βš™οΈ Project Phase:ongoing

🀝 Soft Skills:

β€’ Strong analytical and problem-solving skills with the ability to make decisions based on technical evidence and logical reasoning.

β€’ Excellent communication, active listening, collaboration, and consensus-building skills.

πŸ’‘ Hard Skills / Must Have:

β€’ 3+ years of experience in Data Engineering

β€’ Strong proficiency in Python

β€’ Experience with Spark/PySpark for streaming, batch, and asynchronous data processing

β€’ Data modeling

β€’ Distributed data processing

β€’ SQL

β€’ Data warehouse/lakehouse architecture

β€’ Hands-on experience with Databricks, GCP, or AWS

β€’ Terraform

β€’ Designing data access and governance solutions

β€’ Understanding of data products and governance controls

✨ Hard Skills / Nice to Have:

β€’ Willingness to learn new technologies for integration purposes

πŸ“Œ Responsibilities and Tasks:

β€’ Develop, deploy, and maintain data pipelines and data governance systems on Databricks (Unity Catalog, Delta Lake, Workflows)

β€’ Conduct in-depth data analysis, profiling, and processing to classify data by domain and detect personal data (PII)

β€’ Contribute to the design of data access systems, focusing on data contracts, catalog access, and grant/rollback automation managed as Infrastructure-as-Code with Terraform

β€’ Review access architectures and contracts to ensure flexibility and reusability

β€’ Ensure that data products and access controls are deployed according to contracts and operate without unintended side effects

β€’ Maintain documentation for data contracts, access models, and governance processes

β€’ Monitor and support deployed pipelines and quality checks to ensure they meet data quality and performance expectations

β€’ Actively seek out information and internal solutions to ensure reusability and adoption of common data platform technologies

πŸ§ͺ Technology Stack:Python for streaming, batch, and asynchronous data, MLOps tools

πŸ“ Additional notes:

The work will be carried out either on client's equipment or via a virtual workstation.

πŸ“© Ready to Join?
We look forward to receiving your application and welcoming you to our team!

Bonapolia

About Bonapolia

BONAPOLIA is a staffing company offering augmentation and recruitment services to place the right people with the right jobs in the USA, Europe, and Scandinavia. Whether you are looking to hire new staff or find a new job, we’re happy to offer you our services. Contact us up to arrange an appointment. We’ll have your hiring or job-seeking needs met in no time by one of our professional team members.

Industry
IT & Software
Company Size
1-10 employees
Headquarters
Lisbon , PT
Year Founded
2018
Social Media