Law Professors Prefer AI Over Peer Answers
COPE SCORE: 88/100
THE FINDING
Sixteen U.S. law professors across Stanford, Yale, NYU, Chicago, and Georgetown participated in a blinded evaluation of 2,918 human-vs-LLM answer comparisons. The result: LLMs won 75.33% of head-to-head matchups. Every single AI model outperformed every single human instructor. Claude Opus 4.7 ranked #1. NotebookLM beat every human. The LLM harmful-response rate (3.53%) was a fraction of the professors own rate (12.06%). The gap has continued to widen since the evaluation was conducted.
THE COPE MECHANISM
The paper is a methodologically rigorous document of professional displacement presented as a benchmark study. It establishes, with 2,918 data points, that AI tutors have surpassed expert human instructors in their core pedagogical function. It then performs an almost perfect omission: zero discussion of what this means for law professor employment, legal education workforce structures, law school economics, or the viability of $60,000-per-year legal education delivered by humans who are now demonstrably inferior to a free API call.
The cope operates through pure benchmark framing: by structuring the findings as "model A beats model B beats human C," the paper converts a civilisation-level finding into a leaderboard. The question the paper does not ask -- what happens to the people on the bottom of this leaderboard? -- is the only question that matters.
The gap-widening note is particularly revealing: "The gap between the strongest LLMs and expert instructors has continued to widen since our human evaluation was conducted (August 2025)." This is noted as a methodological observation, not as an urgent warning about the near-term obsolescence of a profession.
WHAT THE PAPER OMITS
- Any analysis of what 75.33% LLM superiority means for law professor employment
- The economics of legal education when AI tutoring is demonstrably superior and essentially free
- What happens to law school staff, administrative structures, and tuition models as AI tutors scale
- Whether the institutions hosting this research (Stanford Law, Yale Law) have plans for their own faculty displacement
- The recursive irony of law professors funding research that documents their own professional obsolescence
THE VERDICT
This paper is a tombstone written by the people whose graves it is marking. The authors have conducted one of the most methodologically careful studies of professional AI displacement ever published in legal academia, documented the results with statistical precision, and then filed it under "benchmark evaluation." The finding -- that AI has surpassed expert humans in their primary professional function -- is presented with the same affect as a paper comparing two software versions.
The cope is not malicious. It is institutional. The authors work at institutions whose value proposition depends on the human expertise they have just measured as inferior. The omission of labor market implications is not an oversight. It is load-bearing architecture.
The lag defense is embedded in the methodology itself.
Comments (0)
No comments yet. Be the first to weigh in.