How to Keep Client Case Notes Out of AI Tools at Social Service Agencies

Why do case managers put case notes into AI tools?

Case notes end up in AI tools because case managers are short on time, and AI is good at the tasks they dread: turning rough notes into a progress summary, drafting a referral letter or tidying a service plan. The fastest route is a free chatbot in a browser tab or a personal phone app. Once a client's name, history and circumstances are pasted in, the agency has handed that information to a company it has no agreement with. AI case notes can save real time, so leadership should set a safe way to use them before staff pick their own.

For a social service agency, case notes are often the most sensitive records it holds: mental health and substance use details, domestic violence history, benefits eligibility and information about children. Many of these records carry legal confidentiality duties on top of the promises the agency made to its clients.

Which confidentiality rules apply to case notes?

The rules depend on the programs you run and who funds them, and many agencies answer to more than one. Common examples:

• Domestic violence and sexual assault programs funded under VAWA. The Office on Violence Against Women's FAQ on 34 U.S.C. 12291(b)(2) says grantees and subgrantees "may not disclose, reveal, or release personally identifying information," including information that is "encoded, encrypted, hashed, or otherwise protected." It expects grantees to "make reasonable efforts to prevent inadvertent releases of personally identifying information."
• Public social services in California. Welfare and Institutions Code section 10850 makes applications and records about individuals kept in administering public social services confidential, and closes them to examination "for any purpose not directly connected with the administration of that program." Agencies delivering county-funded services should check how their contracts carry these terms down to them.
• Health programs. If part of your agency is a HIPAA covered entity, case notes from that program are protected health information. The Security Rule requires a risk analysis of where electronic PHI goes, and the Privacy Rule generally requires a business associate agreement before a vendor creates, receives, maintains or transmits PHI for you.
• Substance use disorder programs. Records from federally assisted programs covered by 42 CFR Part 2 have their own federal confidentiality and consent rules.

These rules describe duties that apply in different ways to different programs. Your counsel and your funders' grant terms decide how they apply to yours.

Is pasting a case note into a free AI tool a disclosure?

It can be, and agencies should treat it that way. A consumer AI account sends the client's information to a company the agency has no contract with, under terms the case manager accepted for themselves. Consumer terms may allow the provider to keep conversations and use them to improve its models unless the user opts out. The agency cannot see that data, correct it or delete it when the staff member leaves. Whether a specific paste counts as a disclosure under a program's rules is a question for your counsel.

A business AI tool used with an organization account comes with contract terms the agency can review. For example, Microsoft states (as of October 2026) that prompts and responses in Microsoft 365 Copilot Chat under enterprise data protection are not used to train foundation models. An approved tool still needs a decision about which programs' data may go into it, and for HIPAA programs, whether the vendor's terms include a business associate agreement.

How do you keep case notes out of unapproved AI tools?

Combine one approved tool with controls that make the unapproved path harder than the approved one.

• Give staff an approved AI tool under organization accounts, so they have no reason to reach for a personal one.
• Decide which data never goes into any AI tool, approved or not. For many agencies that list starts with survivor information, Part 2 records and child welfare details.
• Block unapproved AI sites on agency devices with DNS or web filtering, and turn on alerts when someone signs up for a new AI app with an agency email address.
• Use browser data loss prevention. Microsoft Purview can block sensitive text and file uploads to unmanaged AI apps in Edge for Business and restrict pasting sensitive content into browsers. Its built-in detectors catch identifiers such as Social Security numbers, and custom detectors can match your case number format.
• Keep case notes in the case management system, where access is logged, rather than in Word documents and email, where they are easy to copy. A document retention schedule helps clear out stray copies.
• Require multifactor authentication and organization accounts on any device that opens case records, including personal phones used by staff and volunteers.

What should an AI case notes policy tell case managers?

A short, plain rule works better than a long policy. For example: "Client information goes only into our approved AI tool, signed in with your agency account. Never into a personal account or a free app. Never for survivor, substance use or child welfare records. If you are unsure, ask before you paste."

Pair the rule with two or three approved ways to use AI that keep identifiers out, such as drafting a progress note template from a summary with names, dates of birth and addresses removed. Train on real situations: a case manager dictating notes into a phone app after a home visit, or an intern summarizing a file for a referral. Ask staff which AI tools they already use. Their answers tell you where to start.

What if a case note has already gone into a public AI tool?

Treat it as a possible privacy incident and follow your incident response plan. Record what was entered, which tool and account were used, and when. Delete the conversation, and have the staff member check the account's data and training settings. Then bring in your privacy lead or counsel to decide whether notice is required under the rules and grant terms that apply to that program.

What should your agency do this quarter?

• Map which programs carry VAWA, HIPAA, Part 2 or county confidentiality terms, and which staff and volunteers touch those records.
• Pick one approved AI tool and turn it on with organization accounts.
• Turn on web filtering for unapproved AI sites and new-app alerts on agency devices.
• Pilot browser DLP for case note content with one program team.
• Publish a one-paragraph AI rule for case managers and cover it at the next all-staff meeting.
• Add AI tools to your incident response plan.

How can s90 help?

s90 helps nonprofits and social service agencies across Los Angeles and Orange County set up AI guardrails that fit a lean budget: an approved tool, web filtering, new-app alerts and DLP tuned to your programs. We can start by showing you which AI tools are already in use across your agency. For more low-cost steps, see our free security wins for nonprofits.