Job Description

This role is for one of our clients

Compensation: $150-$160 per hour

We are seeking experienced in-house legal counsel based in the United Kingdom to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving UK law.

As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional expertise will help establish reliable benchmarks for the quality, accuracy, and practical relevance of AI-generated legal work.

Requirements

Key Responsibilities

• Run identical legal prompts across two AI/LLM platforms.
• Review and compare AI-generated legal responses side by side.
• Evaluate each response against a standardized assessment rubric.
• Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
• Identify material differences, omissions, inconsistencies, and potential legal inaccuracies.
• Provide concise, precise, and well-reasoned written feedback for every evaluation.
• Apply evaluation criteria consistently and objectively across assigned tasks.
• Complete assignments independently while adhering to project guidelines and deadlines.

Requirements

• 5+ years of experience as in-house legal counsel practicing in the United Kingdom.
• Strong command of UK law, particularly commercial and contract matters.
• Practical experience advising businesses and assessing real-world legal and commercial risks.
• Excellent attention to detail and strong analytical judgment.
• Exceptional written English and the ability to communicate complex legal concepts clearly and concisely.
• Ability to distinguish legally accurate analysis from plausible but incorrect or incomplete reasoning.
• Comfortable working independently with structured evaluation rubrics.
• Strong ability to manage deadlines and consistently deliver high-quality assessments.

Engagement Details

• Initial Commitment: Approximately 10 hours
• Potential: Strong possibility of additional work based on project requirements and performance
• Work Arrangement: Fully remote
• Confidentiality: All project work will be subject to applicable confidentiality requirements and NDA obligations.
• Engagement Type: Independent contractor

Equal Employment Opportunity

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• This is a fully remote engagement that can be completed on a flexible schedule.
• Projects may be extended, shortened, or concluded early depending on project requirements and performance.
• Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
• Payments are made weekly based on services rendered through supported payment platforms.