Archer Integrated Risk Management

Full-stack Data Engineer II

Archer Integrated Risk Management  •  Cairo, EG (Remote)  •  1 month ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

FULL-STACK DATA ENGINEER II

Location: Cairo, Egypt

Experience: 2–4 Years

Stack: DataBricks & Agentic AI

The Role

We are looking for a forward-thinking Full-Stack Data Engineer II to join our team in Egypt. This is not a traditional ETL role; you will be at the forefront of the Data + AI era, leveraging DataBricks to build intelligent data products. You will be responsible for the end-to-end lifecycle of data, from ingestion and Lakehouse architecture to developing agentic AI workflows that allow our business systems to act autonomously based on data insights.

AI & Agentic Focus

Build and deploy LLM-based agents that utilize data tools to solve complex tasks, including implementing Retrieval-Augmented Generation (RAG) patterns and autonomous chains-of-thought for decision-making.

Key Responsibilities

  • Design and optimize Delta Lake tables within DataBricks using Unity Catalog for governance.
  • Develop and deploy agentic workflows using LangChain, AutoGen, or DataBricks Mosaic AI.
  • Build Python-based backend services (FastAPI) to expose AI-driven insights.
  • Manage data pipelines using DataBricks Workflows and Delta Live Tables (DLT).
  • Implement monitoring frameworks to ensure agent accuracy, safety, and performance.

Technical Requirements

  • 2–4 years experience with PySpark and SQL
  • Strong experience with DataBricks (Unity Catalog, DLT, Notebooks)
  • Understanding of Lakehouse architecture
  • Hands-on experience with LLMs and prompt engineering
  • Experience building AI agents using APIs and tools
  • Backend development in Python and Docker

Preferred Experience

  • MLflow for model tracking and deployment
  • Vector databases (Pinecone, Weaviate, DataBricks Vector Search)
  • Familiarity with Egyptian data localization requirements

What We Offer

  • Work on cutting-edge Agentic AI projects
  • Competitive compensation in EGP with bonuses
  • Hybrid work environment in New Cairo

Updated Version: DataBricks & Agentic AI Focused – Egypt

Archer Integrated Risk Management

About Archer Integrated Risk Management

For more than 20 years, Archer has pioneered holistic integrated risk management solutions that empower enterprise organizations to more effectively manage risk, ensure compliance, and address emerging challenges. Leveraging advanced technology like artificial intelligence (AI) and risk quantification, Archer’s broad range of solutions and services provide our clients with a clear understanding of risk that drives strategic decision-making and operational resilience. Visit www.ArcherIRM.com.

Industry
IT & Software
Company Size
501-1,000 employees
Headquarters
Overland Park, Kansas
Year Founded
Unknown
Social Media