Job Description

This role is for one of our clients

Compensation: $150-$160 per hour

We are seeking experienced in-house legal counsel based in France to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving French law.

As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional judgment will help establish reliable benchmarks for the quality and accuracy of AI-generated legal work.

Requirements

Key Responsibilities

• Run identical legal prompts across two AI/LLM platforms.
• Review and compare AI-generated legal responses side by side.
• Evaluate responses against a standardized assessment rubric.
• Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
• Identify material differences, omissions, inconsistencies, or inaccuracies between responses.
• Provide concise, clear, and well-supported written feedback for each evaluation.
• Apply the evaluation criteria consistently and objectively across all assigned tasks.
• Complete assignments independently while adhering to project guidelines and deadlines.

Requirements

• 5+ years of experience as in-house legal counsel practicing in France.
• Strong command of French law, particularly commercial and contract law.
• Practical experience advising businesses on legal matters and evaluating real-world legal risk.
• Excellent attention to detail and strong analytical judgment.
• Exceptional written communication skills, with the ability to explain legal conclusions clearly and concisely.
• Comfortable reviewing AI-generated content and distinguishing legally sound analysis from plausible but incorrect reasoning.
• Ability to work independently, follow structured evaluation rubrics, and meet established deadlines.
• Professional proficiency in written English is preferred for working with project instructions and evaluation materials.

Engagement Details

• Initial Commitment: Approximately 10 hours
• Potential: Strong opportunity for additional work based on project requirements and performance
• Work Arrangement: Fully remote
• Confidentiality: All project work is subject to applicable confidentiality requirements and NDA obligations.
• Engagement Type: Independent contractor

Equal Employment Opportunity

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• The engagement is fully remote and can be completed on a flexible schedule.
• Projects may be extended, shortened, or concluded early depending on project needs and performance.
• Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
• Payments are made weekly based on services rendered through supported payment platforms.
• H-1B and STEM OPT candidates are not eligible for this opportunity at this time.