ChatGPT bot passes US law school exam | Inquirer News
But still poor in math

ChatGPT bot passes US law school exam

/ 05:42 AM January 27, 2023

PARIS — A chatbot powered by reams of data from the internet has passed exams at a US law school after writing essays on topics ranging from constitutional law to taxation and torts.

ChatGPT from OpenAI, a US company that this week got a massive injection of cash from Microsoft, uses artificial intelligence (AI) to generate streams of text from simple prompts.

The results have been so good that educators have warned it could lead to widespread cheating and even signal the end of traditional classroom teaching methods.

Article continues after this advertisement

Jonathan Choi, a professor at Minnesota University Law School, gave ChatGPT the same test faced by students, consisting of 95 multiple-choice questions and 12 essay questions.

FEATURED STORIES

In a white paper titled “ChatGPT goes to law school” published on Monday, he and his co-authors reported that the bot scored a C+ overall. While this was enough for a pass, the bot was near the bottom of the class in most subjects and “bombed” at multiple-choice questions involving mathematics.

“In writing essays, ChatGPT displayed a strong grasp of basic legal rules and had consistently solid organization and composition,” the authors wrote.

Article continues after this advertisement

But the bot “often struggled to spot issues when given an open-ended prompt, a core skill on law school exams”.

Article continues after this advertisement

Banned, but . . .

Officials in New York and other jurisdictions have banned the use of ChatGPT in schools, but Choi suggested it could be a valuable teaching aide.

Article continues after this advertisement

“Overall, ChatGPT wasn’t a great law student acting alone,” he wrote on Twitter.

“But we expect that collaborating with humans, language models like ChatGPT would be very useful to law students taking exams and to practicing lawyers.”

Article continues after this advertisement

And playing down the possibility of cheating, he wrote in reply to another Twitter user that two out of three markers had spotted the bot-written paper.

“(They) had a hunch and their hunch was right, because ChatGPT had perfect grammar and was somewhat repetitive,” Choi wrote.

RELATED STORIES:

Google AI Chatbot Will Soon Compete Against ChatGPT

AI, do my homework! Chatbot pits teachers vs tech

Your subscription could not be saved. Please try again.
Your subscription has been successful.

Subscribe to our daily newsletter

By providing an email address. I agree to the Terms of Use and acknowledge that I have read the Privacy Policy.

TAGS: Bar Exam, ChatGPT, Taxation, world news

Your subscription could not be saved. Please try again.
Your subscription has been successful.

Subscribe to our newsletter!

By providing an email address. I agree to the Terms of Use and acknowledge that I have read the Privacy Policy.

© Copyright 1997-2024 INQUIRER.net | All Rights Reserved

This is an information message

We use cookies to enhance your experience. By continuing, you agree to our use of cookies. Learn more here.