Bear in mind earlier this yr when two authorized students and scientists had GPT 3.5 take the multiple-choice portion of the bar exam and it didn’t go? Effectively, the second time’s a appeal, as GPT has now handed not solely the multiple-choice portion, but in addition the essay portion, and scored across the high 10% of check takers.
Solely this time, it was the just-released GPT-4 taking the examination, the newest AI mannequin from OpenAI that the corporate says “displays human-level efficiency on numerous skilled and educational benchmarks.”
For this newest check, these two authorized students and scientists, Daniel Martin Katz and Michael Bommarito, collaborated with the authorized AI firm Casetext, which just lately launched the AI authorized assistant CoCounsel, which Casetext has now confirmed is powered by GPT-4.
“GPT-4 leaps previous the facility of earlier language fashions,” mentioned Pablo Arredondo, co-founder and chief innovation officer for Casetext. “The mannequin’s skill not simply to generate textual content, however to interpret it, heralds nothing wanting a brand new age within the observe of legislation.”
Of their prior paper, GPT Takes the Bar Exam, Katz and Bommarito described how they’d put the GPT model launched in late 2022 to the check of the bar examination, solely to have it fail to go any portion.
In a forthcoming paper, they are going to element how GPT-4 handed the multiple-choice portion and each parts of the written portion, exceeding not solely all prior giant language fashions’ scores, but in addition the common rating of real-life bar examination check takers.
The implications of all this, Casetext mentioned in a press launch right now, “go far past passing the bar examination.”
Casetext’s CoCounsel product, as I explained when it launched March 1, performs seven core features, or “abilities”, utilizing GPT-4. Legal professionals can use it to go looking a database, assessment paperwork, summarize paperwork, and assessment contracts for coverage compliance.
They will additionally use it to extract knowledge from contracts, draft a authorized analysis memo, and put together for a deposition.
Look ahead to LawNext interview subsequent week with Casetext about this newest information.