back to live missions analysis

ai contract review in 2026: what the documented record shows

2026-08-25

Vendors sell ai contract review as read, extract, flag, route, and faster than a lawyer. The most-cited enterprise deployment, JPMorgan's COIN, backs the speed but not the accuracy. This post says which claims carry a source and which never did.

Built on verified case files. The argument below leans on evidence The Internet Ninja validated against the public record and published in full, method included.

Every contract you sign has obligations buried in it that someone has to read, categorise, and act on. At scale that reading is slow, repetitive, and expensive, which is why ai contract review is now a category buyers actively shop.

The pitch is consistent: point a model at the agreement, let it extract the clauses and flag the exceptions, and clear the routine work faster than a lawyer could. Most vendor pages back that pitch with a percentage and no source.

The single most-cited enterprise deployment in this space is JPMorgan’s COIN, and its headline number is one of the most-repeated figures in all of enterprise AI: the 360,000 lawyer and loan-officer hours a year that the bank said COIN’s work had consumed (source). It is worth reading closely, because what it does and does not prove is the whole buyer’s question.

What ai contract review means

ai contract review is software that reads an agreement, extracts the obligations and clauses inside it, and flags the exceptions for a person to decide on. It is document understanding aimed at one document type: pull the terms off the contract, then route or decide against known rules.

That is the shape of the work COIN does on commercial-loan agreements. Read the contract, classify its clauses, surface the ones that govern the loan, and leave the judgment calls to people.

The proof: the contract-review deployment people actually cite

JPMorgan built COIN, for Contract Intelligence, an in-house machine-learning system that interprets commercial-loan agreements. It went online in June 2016 and was announced in February 2017. Per a Harvard Business School write-up citing the bank, the algorithm “uses unsupervised learning” and “classifies clauses into one of about 150 different attributes of credit contracts” (source).

The speed claim carries a source. Bloomberg reported that COIN “does the mind-numbing job of interpreting commercial-loan agreements that, until the project went online in June, consumed 360,000 hours of work each year by lawyers and loan officers,” and that “the software reviews documents in seconds” (source). The ABA Journal relayed the same figure (source). COIN also cut loan-servicing mistakes “most of which stemmed from human error in interpreting 12,000 new wholesale contracts per year, according to its designers” (source).

TIN’s case file on JPMorgan COIN reads the whole record and reaches a specific verdict: the 360,000-hours and 12,000-contract figures trace to a single 2017 Bloomberg article attributing them to JPMorgan’s own designers, and none has been independently measured or updated since.

Can AI review contracts more accurately than a lawyer?

That is a claim, and in the one famous case it is an unmeasured one. The HBS write-up states the bank has said “the algorithm is more accurate than human lawyers,” while noting JPMorgan “has been tight-lipped about the details of the proprietary technology” (source).

Read that sentence twice. The speed number has a mechanism you can picture and a source you can follow. The accuracy claim has neither a published measurement nor an independent test. It is the company describing its own system. That is the exact seam every ai contract review buyer should press on, because accuracy, not speed, is what a wrong clause costs you.

What are the best ai tools for contract review?

TIN does not rank tools, and a page that did would be selling placement, not proof. What the documented record supports is narrower and more useful: contract review is the same underlying work as broader document extraction, so the deployments that document it well are worth reading across categories.

The clearest example outside legal contracts is Omega Healthcare, a US revenue-cycle firm running UiPath automation for about five years across billing, medical coding, and insurance correspondence, using UiPath Document Understanding to extract data from documents (source). Per Business Insider it “reduced the amount of time workers spend on documentation tasks by 40%” and “slashed document processing turnaround time by 50% with a process accuracy of 99.5%” (source). TIN’s case file on Omega records that every one of those figures originates with Omega or UiPath, so their agreement is repetition, not corroboration.

Different document, same lesson: the number is the deploying company’s, and the tool matters less than who measured the result.

How the documented figures compare

DeploymentDocumentsWhat carries a sourceWhat does not
JPMorgan COINCommercial-loan agreements360,000 hours a year of prior manual work; about 150 clause attributes; 12,000 wholesale contracts a year”more accurate than human lawyers,” with no published measurement
Omega Healthcare (UiPath)Billing, coding, insurance correspondence40% less documentation time; 50% faster turnaround; 99.5% process accuracyall figures are Omega’s or UiPath’s own, never independently audited

Short columns, one point: in the two most-documented deployments a buyer can actually cite, the speed and volume numbers have a followable source and the harder accuracy claim either has none or was never independently checked.

The bottom line

ai contract review is a real capability with a real production track record, and the vendor pitch is roughly right about what it does: read, extract, flag, route, fast. The part the pitch buries is that the number that would justify replacing a lawyer’s judgment, not just their hours, is almost never a measured one. When you shop this category, separate the two questions the vendor merges. Speed and volume gains usually have a source. An accuracy claim that beats a human almost never does, and until someone outside the company measures it, it is marketing wearing a percentage.

Sources

  1. Bloomberg, “JPMorgan marshals an army of developers to automate high finance,” 2017-02-28. https://www.bloomberg.com/news/articles/2017-02-28/jpmorgan-marshals-an-army-of-developers-to-automate-high-finance
  2. ABA Journal, “JPMorgan Chase uses tech to save 360,000 hours of annual work by lawyers and loan officers,” 2017-03-02. https://www.abajournal.com/news/article/jpmorgan_chase_uses_tech_to_save_360000_hours_of_annual_work_by_lawyers_and
  3. Harvard Business School (RCTOM), “JP Morgan COIN: a bank’s side project spells disruption for the legal industry,” 2018-11-14. https://aiinstitute.hbs.edu/platform-rctom/submission/jp-morgan-coin-a-banks-side-project-spells-disruption-for-the-legal-industry/
  4. Business Insider, “Omega Healthcare uses UiPath AI for document processing,” 2025-06-04. https://www.businessinsider.com/omega-healthcare-uipath-ai-document-processing-health-transactions-2025-6
  5. PR Newswire (UiPath release), “Omega Healthcare Processes 60 Million Transactions with Enterprise AI and Automation from UiPath,” 2024-10-24. https://www.prnewswire.com/in/news-releases/omega-healthcare-processes-60-million-transactions-with-enterprise-ai-and-automation-from-uipath-302285442.html

Questions

What is ai contract review?

ai contract review is software that reads an agreement, extracts its obligations and clauses, and flags the exceptions for a person to decide on. JPMorgan's COIN is a documented example: it interprets commercial-loan agreements and classifies their clauses, with the routine cases handled by the model and the rest routed to review.

Can AI review contracts more accurately than a lawyer?

That is a claim, not a measured result. JPMorgan said COIN is more accurate than human lawyers, but the bank published no measurement basis and no independent party ever tested it. Read accuracy claims in this category as the vendor's or the deploying company's own, quoted accurately, until someone outside the company measures them.

What are the best ai tools for contract review?

TIN does not rank tools. It records which named deployments have a followable source behind their numbers. The documented cases here run on JPMorgan's in-house COIN and on UiPath's platform, including UiPath Document Understanding for data extraction. Whose number it is and what it measured matters more than the brand on the box.

Is using ai to review contracts reliable?

It is reliable enough that a major bank has run it in production since 2016 on commercial-loan agreements. The gains that carry a source are about speed and volume, not verified accuracy. The one deployment that claimed higher accuracy than lawyers never published how that was measured.

Sources

  1. Bloomberg, JPMorgan marshals an army of developers to automate high finance , 2017-02-28
  2. ABA Journal, JPMorgan Chase uses tech to save 360,000 hours of annual work by lawyers and loan officers , 2017-03-02
  3. Harvard Business School (RCTOM), JP Morgan COIN: a bank's side project spells disruption for the legal industry , 2018-11-14
  4. Business Insider, Omega Healthcare uses UiPath AI for document processing , 2025-06-04
  5. PR Newswire (UiPath release), Omega Healthcare Processes 60 Million Transactions with Enterprise AI and Automation from UiPath , 2024-10-24