CoCounsel is powered by OpenAI’s GPT-4, the first AI to pass the bar

CoCounsel builds on the power of GPT-4, the AI that outperformed real bar candidates

In early March we announced CoCounsel, our groundbreaking AI legal assistant built on OpenAI’s latest, most advanced large language model. Now we’re excited to share the name of that model: GPT-4, released today by OpenAI. And a forthcoming study will confirm GPT-4 has passed both the multiple-choice and written portions of the Uniform Bar Exam (UBE), making it the first large language model (LLM) to do so. 

Pablo Arredondo, our co-founder, Chief Innovation Officer, and a fellow at Stanford’s Center for Legal Informatics (Stanford CodeX) collaborated with OpenAI and Stanford CodeX fellows Daniel Katz and Michael Bommarito to study GPT-4’s performance on the UBE.

In earlier work, Katz and Bommarito found that a large language model released in late 2022 was unable to pass the multiple-choice portion of the UBE. GPT-4, however, passed the multiple-choice portion and both components of the written portion, exceeding not only all prior large language models’ scores, but also the average score of real-life bar exam test takers.  

A watershed moment: GPT-4 has unlocked professional-grade AI for the law

Passing both the multiple-choice and written portions of the UBE with a score higher than the average real test-taker’s is powerful validation. It proves GPT-4 can do more than just generate text, as ChatGPT is known for—it can use advanced reasoning to interpret text. Bottom line: while GPT-4 alone isn’t sufficient for professional use by lawyers, it is the first large language model “smart enough” to power professional-grade solutions that are—like CoCounsel.

While prior iterations of GPT models, most notably ChatGPT, have garnered deserved attention and interest—and generated output both astonishing and bizarre—it’s important to remember what OpenAI CEO Sam Altman said on Twitter: “ChatGPT is incredibly limited, but good enough at some things to create a misleading impression of greatness. It’s a mistake to be relying on it for anything important right now.”

GPT-4, however, has provided the foundation necessary for creating CoCounsel. Our team has spent the last several months applying our deep legal practice and data security expertise to GPT-4, making possible a first-of-its-kind solution reliable and secure enough for legal professionals to use in their practice. We’ve spent thousands of hours tailoring, training, and testing CoCounsel’s output to ensure lawyers—and their clients—can trust it. 

“GPT-4 leaps past the power of earlier language models,” said our Chief Innovation Officer Pablo Arredondo. “The model’s ability not just to generate text, but to interpret it, heralds nothing short of a new age in the practice of law.” 

Casetext Chief Technology Officer Dr. Ryan Walker added, “CoCounsel combines the power of next-generation AI with the security and data privacy law firms require. Client data is never used to train the models, and law firms retain complete control over their data. CoCounsel is the most secure AI in legal technology.”

CoCounsel is the legal AI everyone’s been waiting for

There’s been an outpouring of enthusiasm and positive feedback for CoCounsel from renowned providers of legal services across sectors—from top-tier global law firms to in-house counsel at Fortune 50 companies to high-impact nonprofits. Many are beta customers who have been using CoCounsel for months.

The difference between their reactions and a lot of the AI-for-the-law hype in recent years? These customers and professionals are talking about actual benefits realized by using CoCounsel, not just what they hope it will have the potential to do. 

Global law firm and Casetext client DLA Piper received early access to CoCounsel and has been using the AI assistant since September 2022. “Casetext’s CoCounsel is changing how the law is practiced by automating critical, time-intensive tasks and freeing our lawyers to focus on the most impactful aspects of practice,” said Frank Ryan, DLA Piper’s Americas Chair. “AI development and adoption is crucial as companies look to grow their businesses and compete successfully. No firm wants to be the last one to implement this game-changing technology.”

Darth Vaughn, Litigation Counsel and Legal Innovation & Technology Operations Lead at Ford Motor Company, said that CoCounsel “has the potential to revolutionize the way lawyers practice. The value of CoCounsel is quickly becoming evident across a range of our practice groups. If implemented correctly, I believe this technology can also increase access to justice.”

“In our work what we see is that lack of resources is the problem; folks with resources are less likely to be wrongfully convicted,” said Michael Semanchik, Managing Attorney of the California Innocence Project. “Providing access to CoCounsel certainly helps us to level that playing field on the back end. Access to CoCounsel on the front end could help defense attorneys and public defenders level the playing field as well.”

Featured posts

Draft Correspondence

Rapidly draft common legal letters and emails.

How this skill works

  • Specify the recipient, topic, and tone of the correspondence you want.

  • CoCounsel will produce a draft.

  • Chat back and forth with CoCounsel to edit the draft.

Review Documents

Get answers to your research questions, with explanations and supporting sources.

How this skill works

  • Enter a question or issue, along with relevant facts such as jurisdiction, area of law, etc.

  • CoCounsel will retrieve relevant legal resources and provide an answer with explanation and supporting sources.

  • Behind the scenes, Conduct Research generates multiple queries using keyword search, terms and connectors, boolean, and Parallel Search to identify the on-point case law, statutes, and regulations, reads and analyzes the search results, and outputs a summary of its findings (i.e. an answer to the question), along with the supporting sources and applicable excerpts.

Legal Research Memo

Get answers to your research questions, with explanations and supporting sources.

How this skill works

  • Enter a question or issue, along with relevant facts such as jurisdiction, area of law, etc.

  • CoCounsel will retrieve relevant legal resources and provide an answer with explanation and supporting sources.

  • Behind the scenes, Conduct Research generates multiple queries using keyword search, terms and connectors, boolean, and Parallel Search to identify the on-point case law, statutes, and regulations, reads and analyzes the search results, and outputs a summary of its findings (i.e. an answer to the question), along with the supporting sources and applicable excerpts.

Prepare for a Deposition

Get a thorough deposition outline in no time, just by describing the deponent and what’s at issue.

How this skill works

  • Describe the deponent and what’s at issue in the case, and CoCounsel identifies multiple highly relevant topics to address in the deposition and drafts questions for each topic.

  • Refine topics by including specific areas of interest and get a thorough deposition outline.

Extract Contract Data

Ask questions of contracts that are analyzed in a line-by-line review

How this skill works

  • Allows the user to upload a set of contracts and a set of questions

  • This skill will provide an answer to those questions for each contract, or, if the question is not relevant to the contract, provide that information as well

  • Upload up to 10 contracts at once

  • Ask up to 10 questions of each contract

  • Relevant results will hyperlink to identified passages in the corresponding contract

Contract Policy Compliance

Get a list of all parts of a set of contracts that don’t comply with a set of policies.

How this skill works

  • Upload a set of contracts and then describe a policy or set of policies that the contracts should comply with, e.g. "contracts must contain a right to injunctive relief, not merely the right to seek injunctive relief."

  • CoCounsel will review your contracts and identify any contractual clauses relevant to the policy or policies you specified.

  • If there is any conflict between a contractual clause and a policy you described, CoCounsel will recommend a revised clause that complies with the relevant policy. It will also identify the risks presented by a clause that does not conform to the policy you described.

Summarize

Get an overview of any document in straightforward, everyday language.

How this skill works

  • Upload a document–e.g. a legal memorandum, judicial opinion, or contract.

  • CoCounsel will summarize the document using everyday terminology.

Search a Database

Find all instances of relevant information in a database of documents.

How this skill works

  • Select a database and describe what you're looking for in detail, such as templates and precedents to use as a starting point for drafting documents, or specific clauses and provisions you'd like to include in new documents you're working on.

  • CoCounsel identifies and delivers every instance of what you're searching for, citing sources in the database for each instance.

  • Behind the scenes, CoCounsel generates multiple queries using keyword search, terms and connectors, boolean, and Parallel Search to identifiy the on-point passages from every document in the database, reads and analyzes the search results, and outputs a summary of its findings (i.e. an answer to the question), citing applicable excerpts in specific documents.

Skills

UNIVERSAL
Search a Database

Find all instances of relevant information in a database of documents.

Summarize

Get an overview of any document in straightforward, everyday language.

Draft Correspondence

Rapidly draft common legal letters and emails.

TRANSACTIONAL
Contract Policy Compliance

Get a list of all parts of a set of contracts that don’t comply with a set of policies.

Extract Contract Data

Ask questions of contracts that are analyzed in a line-by-line review

Prepare for a Deposition

Get a thorough deposition outline by describing the deponent and what’s at issue.

LITIGATION
Legal Research Memo

Get answers to your research questions, with explanations and supporting sources.

Review Documents

Get comprehensive answers to your questions about a set of documents.