Share on LinkedInShare on LinkedIn

ARTICLE · 17 NOVEMBER 2025

Readme: Human vs Machine vs Legal Machine - A Study Of AI And Legal Research

VALS, a generative AI benchmarking company, recently published a study evaluating how four AI products perform on legal research tasks.

CanadaTechnology

About the study

VALS, a generative AI benchmarking company, recently published a study evaluating how four AI products perform on legal research tasks.

The study assessed the ability of the AI products to respond to 200 typical US legal research questions, scored based on Accuracy, Authoritativeness (i.e. supported by citations) and Appropriateness (understandable and ready for communication), compared against a human baseline.

Both the questions and answers were sourced from a consortium of participating law firms, and included:

  • Answering a question by reference to a specified source
  • Confirming the definition of a term or legal concept
  • Answering a question without reference to a specified source

We operate a free-to-view policy, asking only that you register in order to read all of our content. Please login or register to view the rest of this article.

About Dentons

Dentons is the world's first polycentric global law firm. A top 20 firm on the Acritas 2015 Global Elite Brand Index, the Firm is committed to challenging the status quo in delivering consistent and uncompromising quality and value in new and inventive ways. Driven to provide clients a competitive edge, and connected to the communities where its clients want to do business, Dentons knows that understanding local cultures is crucial to successfully completing a deal, resolving a dispute or solving a business challenge. Now the world's largest law firm, Dentons' global team builds agile, tailored solutions to meet the local, national and global needs of private and public clients of any size in more than 125 locations serving 50-plus countries. www.dentons.com

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances. Specific Questions relating to this article should be addressed directly to the author.

See more popular content from