Job Description
Senior Python Data Engineer (AI-Assisted Data Migration)
We are looking for a Senior Python Data Engineer to support the migration of legacy SAS-based ETL processes to a modern Python data platform using Parquet, PyArrow, Pandas, Polars, and Apache Spark You will play a key role in developing AI-assisted migration solutions, optimizing agent-driven workflows, and ensuring high-quality, scalable data transformation processes.
Key Responsibilities
Design, develop, and validate Python-based ETL and data transformation solutions.
Review and optimize AI-generated Python code for performance, quality, and maintainability.
Build and enhance data pipelines using Pandas, Polars, PyArrow, Parquet, and PySpark
Improve ETL/ELT processes, data quality, schema management, and performance.
Contribute to AI-assisted software development and multi-agent orchestration workflows.
Enhance workflow automation, validation processes, and human-in-the-loop quality assurance.
Collaborate with architects, data engineers, and SAS experts to support complex migration scenarios.
Ensure robust testing, documentation, and operational reliability of migration solutions.
Required Skills & Experience
-
5+ years of experience in Python Data Engineering.
Strong expertise in Python, Pandas, Polars, PyArrow, Parquet, Apache Spark/PySpark, and Python performance tuning.
Experience with ETL/ELT, data engineering, data quality, schema management, and testing frameworks.
Experience using AI-assisted development tools (e.g., GitHub Copilot or similar).
Knowledge of agentic workflows, multi-agent systems, workflow orchestration, and AI-driven automation.
Familiarity with SAS Base (DATA Step, PROC SQL, Macros, ETL patterns) is a strong advantage.
Languages
Active knowledge of Dutch, French, and English
Location
-
Brussels, Belgium
-
Hybrid working model.