Black Pearl Consult

Product Manager – Data & ML Evaluation (Enterprise) [UAEN]

Black Pearl Consult  •  Abu Dhabi, AE (Onsite)  •  2 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description


Our client is seeking a highly analytical and
technically strong
Product Manager – Data & ML Evaluation

to lead
the strategy and execution of product data, experimentation, and machine
learning evaluation.


In this role, you will act as the product owner for
data and evaluation frameworks, ensuring that AI-driven products are
measurable, reliable, and continuously improving. You will work
cross-functionally with Product, Engineering, Data Science, and business
stakeholders to deliver high-impact, data-driven solutions.


Key Responsibilities:


·

Product Data & Analytics


Ø

Own and manage the
end-to-end product
data ecosystem

, including telemetry, tracking plans, event schemas, data
quality, and warehousing


Ø

Define and implement a
product metrics
framework

(north star metrics, leading indicators, input metrics)


Ø

Enable stakeholders with
accessible
dashboards and actionable insights

across products and platforms


·

ML Evaluation & Experimentation


Ø

Design and own
machine learning
evaluation frameworks

, including test set curation and KPI definition
(quality, safety, bias, latency, cost)


Ø

Run and optimize
offline and online
evaluations

for AI models and features


Ø

Build scalable and reproducible
evaluation
pipelines integrated with CI/CD workflows


Ø

Lead
A/B testing and experimentation
strategies

, including designing, analyzing, and scaling testing frameworks


·

Strategy & Governance


Ø

Drive
data-informed pricing strategies

by analyzing usage patterns, feature value, and cost structures


Ø

Establish and enforce
data governance
standards

, including event naming, privacy, PII handling, and data
retention policies


Ø

Collaborate with Security, Legal, and
business teams to ensure compliance and best practices.


Requirements


·

5–8+ years of experience

in Product Management with a strong background in
data, analytics, or engineering

·

Proven
experience owning
product analytics, instrumentation, and experimentation
frameworks

·

Strong
proficiency in
SQL and data analysis

, with the ability to validate and
interpret experiments independently

·

Hands-on
experience working with
machine learning products

, including model
evaluation and monitoring

·

Strong
understanding of
A/B testing methodologies and statistical concepts

(e.g., power, MDE, guardrail metrics)

·

Excellent
stakeholder management and communication skills across technical and business
teams

·

Ability to operate effectively in
fast-paced,
cross-functional environments

.


Preferred Qualifications


·

Experience with product analytics tools
(e.g.,
Amplitude

or similar) and experiment tracking platforms (e.g.,
MLflow

)

·

Exposure
to
LLM / RAG evaluation frameworks

, safety metrics, and AI model testing
methodologies

·

Familiarity
with data modeling tools (e.g., dbt), feature stores, and observability
platforms

·

Experience
working in
regulated or privacy-sensitive environments

·

Comfort leveraging AI tools to prototype
analyses, dashboards, or lightweight data utilities


Work Location


·

Abu Dhabi


To view other
vacancies we have, please check our website

(

www.blackpearlconsult.com

)

and follow us on our
social media accounts

-

LinkedIn

/

Instagram


Follow the

Black
Pearl channel on WhatsApp.


Disclaimer: Black
Pearl will never ask for money or any form of charge our candidates just to
process or consider their application for any of our available vacancies. If
you happen to receive such a request from any members of our staff or other
individuals claiming to be part of Black Pearl, please do call our office at
+9712 622 55 03 or drop us a message on our website

-

www.blackpearlconsult.com

.

Black Pearl Consult

About Black Pearl Consult

Struggling to attract qualified candidates, retain top talent, or align your workforce with business goals?

Black Pearl is a recruitment and human resources consultancy that provides tailored talent acquisition, HR advisory, and workforce planning solutions for companies across the UAE, Saudi Arabia, and the wider GCC.

We partner with organizations to address key challenges like high turnover, skills gaps, employee engagement, and organizational restructuring. Whether you're looking for executive search services, Emiratization support, onboarding strategies, or outsourced HR solutions—we can help.

Our team brings deep expertise across healthcare recruitment, engineering and construction hiring, tech and digital talent sourcing, and hospitality staffing. We also support clients with employer branding, compensation benchmarking, and HR compliance advisory.

Ready to transform your people strategy? Let’s talk.

📞 +971 58 125 7276

📩 bibin@blackpearlconsult.com

🌐 www.blackpearlconsult.com

talent acquisition | executive search | workforce planning | HR consultancy UAE | recruitment agency in GCC | Emiratization support | outsourced HR services | employee engagement strategies | compensation benchmarking | onboarding and retention | staffing solutions | healthcare recruitment | engineering hiring | hospitality talent sourcing | tech recruitment | team building

Industry
HR & Recruiting
Company Size
11-50 employees
Headquarters
Abu Dhabi, AE
Year Founded
Unknown
Social Media