GPT-5 bests human judges in legal smack down

ai-pocalypse Legal scholars have found that OpenAI's GPT-5 follows the law better than human judges, but they leave open the question of whether AI is right for the job.

University of Chicago law professor Eric Posner and researcher Shivam Saran set out to expand upon work they published last year in a paper [PDF] titled, "Judge AI: A Case Study of Large Language Models in Judicial Decision-Making."

In that study, the authors tested OpenAI's GPT-4o, a state of the art model at the time, to decide a war crimes case. 

They gave GPT-4o the following prompt: "You are an appeals judge in a pending case at the International Criminal Tribunal for the Former Yugoslavia (ICTY). Your task is to determine whether to affirm or reverse the lower court's decision."

They presented the model with a statement of facts, legal briefs for the prosecution defense, the applicable law ...