← Back to Blog
AI Risk in Legal Practice

Why Law Firms Can't Use ChatGPT and Why They Still Do

28 May, 2026

Why Law Firms Can't Use ChatGPT and Why They Still Do

AI is transforming legal work. But the tools most lawyers reach for first are quietly creating the biggest data risk the industry has ever seen.

Picture this. A senior associate at a Dubai law firm is working late on a high-stakes merger deal. The client is a listed company. The documents are confidential. The deadline is tomorrow morning. She opens ChatGPT, pastes in a 40-page confidential brief, and types: “Summarise the key risks in this document.” In 30 seconds, she has her summary. She closes the tab, finishes the memo, and goes home. What she doesn't know — what almost no one tells lawyers — is that those 40 pages of sensitive client information may now sit on OpenAI's servers. The firm's data didn't just leave the building. It potentially left the country, crossed multiple jurisdictions, and became input that could train a model used by millions of people worldwide. This is not a hypothetical. It is happening in law firms right now, every single day.

79%

Of lawyers were using AI in their practice in 2024

10%

Of firms had any policy governing that AI use

$5.08M

Average cost of a data breach for law firms in 2024

The promise and the problem

Nobody is saying lawyers should not use AI. The efficiency gains are real. Document review that took three associates two weeks can be done in hours. Contract analysis that required a senior partner's eye can be handled at scale. Research that used to mean late nights in the library is now a conversation. The problem is not AI. The problem is where that AI lives and what it does with your data when you're not looking. Tools like ChatGPT, Claude, Gemini, and Copilot are what's called cloud-based AI. When you upload a document or type a query, that data travels from your device to servers owned by a tech company — usually in the United States — gets processed there, and a response gets sent back to you. For most industries, this is fine. For law firms, it is a fundamental problem.

When you paste a confidential document into ChatGPT, you're not just getting an output — you're potentially contributing to the model's training data.

What actually happens to the data

Most lawyers assume that once they close the browser tab, the data is gone. It is not that simple. Cloud AI providers process data across multiple jurisdictions. A query submitted from a Dubai office might be processed on servers in Ireland, Singapore, and Virginia simultaneously. Each of those jurisdictions has different data protection laws. Your client data is now subject to all of them. More concerning: many AI tools store prompt histories by default. The associate who pasted the confidential brief? That brief may be stored, reviewed for safety purposes, or used to improve the model — unless the firm has enterprise agreements explicitly preventing this. Most firms do not.

Real Case | 2024

Orrick, Herrington & Sutcliffe, a prominent US law firm, paid $8 million to settle a class action lawsuit after a data breach compromised the personal data of over 600,000 people. The breach exposed names, addresses, birth dates, and Social Security numbers from the firm's files. This is what a single breach costs. Not a hypothetical. A real firm, real clients, real consequences.

3D illustration of a stack of cash with a large dollar sign and coin

The shadow AI problem

The most dangerous use of cloud AI in law firms is not the sanctioned use. It is the unsanctioned use — what security professionals call shadow AI. Associates use ChatGPT on personal devices. Partners experiment with AI writing tools on their laptops. Paralegals run confidential memos through online spell-checkers powered by AI. None of this is malicious. Most of it is well-intentioned. All of it is a data risk.

The gap between how much AI is being used and how much oversight firms have over that use is staggering. And it is growing every year as AI tools become easier to access, cheaper to use, and more deeply embedded in daily workflows.

How law firms are exposed to shadow AI

81%

Using unapproved AI tools

57%

Unable to track external data trends

68%

Breaches involving human error

90%

Firms with no AI usage policy

The attorney-client privilege question nobody is asking

There is a legal dimension to this that goes beyond data security. Attorney-client privilege — the fundamental principle that communications between a lawyer and their client are protected from disclosure — can be waived when those communications are shared with a third party. In traditional law, this is well understood. You do not forward privileged emails to people outside the firm. But what about uploading a privileged document to ChatGPT? The answer is legally unsettled — and that is itself the problem. In one documented UK case, a litigation team uploaded privileged strategies to an AI tool. Opposing counsel successfully argued that privilege had been lost. Years of protected communications became discoverable. This is not a theoretical risk. It has already happened.

Cloud AI tools

  • Data leaves firm servers immediately
  • Processed in foreign jurisdictions
  • May train future AI models
  • Privilege potentially waived
  • No audit trail for compliance

On-premise AI

  • Data never leaves the building
  • Single jurisdiction, your servers
  • No external training on your data
  • Privilege fully maintained
  • Complete audit trail

What PDPL means for Dubai law firms specifically

For law firms operating in the UAE, there is an added layer of urgency. Dubai's Personal Data Protection Law (PDPL) imposes strict requirements on how personal data is collected, stored, and transferred. Using a cloud AI tool that processes client data on servers outside the UAE creates an automatic compliance issue — regardless of whether a breach actually occurs. The question is not whether a breach will happen. The question is whether your firm is already non-compliant right now, today, because of the AI tools your team is using. For most firms in the region, the honest answer is: probably yes.

The solution is not to avoid AI

Firms that respond to this risk by banning AI entirely will lose ground fast. The competitive advantage that AI provides — in speed, depth of research, contract analysis, document review — is too significant to ignore. Firms that adopt it intelligently will outperform those that do not. The solution is to bring AI inside. On-premise AI means the model runs entirely within the firm's own servers. No data leaves the building. No third-party processes it. No external jurisdiction touches it. The firm gets the full benefit of AI — faster work, better research, automated review — without any of the data risk. This is not a futuristic concept. Firms are deploying it today, typically in six to eight weeks, with full integration into existing systems. 37% of legal clients in 2025 said they would pay a premium to work with law firms that have stronger data security practices. AI safety is becoming a competitive differentiator.

What to do right now

Conduct an audit

Find out which AI tools are being used, by whom, and for what. Most firms will be surprised by the answer.

Create a policy

Define clearly what tools are permitted, what data can be used with them, and what the consequences of non-compliance are. The American Bar Association's Formal Opinion 512, issued in 2024, provides a useful framework.

Evaluate on-premise alternatives

Cloud AI is not the only option. Firms that want the efficiency without the exposure have a clear alternative — and it is more accessible than most managing partners realise.

Continue reading

Junior associates spend 60% of their time on tasks AI completes in minutes.

Junior associates spend 60% of their time on tasks AI completes in minutes.

A practical look at where junior associate hours actually go, and how AI can remove repetitive reading, reviewing, formatting, and summarising work.

Read Blog ↗
Your client just asked if you use AI. What do you say?

Your client just asked if you use AI. What do you say?

Clients across Dubai and Abu Dhabi are asking how their law firms use AI. Here is how partners can answer with confidence, control, and clarity.

Read Blog ↗

Hire AI for your firm.

Book a 30-minute call. We will show you what it does on a real file from your practice area. If it does not save you hours, we will not waste yours.

Partners meeting around a laptop