SUNDAY, SEPTEMBER 6, 2026|No. 14083
AI · Funding

Anthropic Offers $5 Million for AI Chatbot Safety Research in Crisis Situations

AI company Anthropic is providing $5 million in grants to research how AI chatbots handle users in emotional distress, focusing on safety and effectiveness across different global contexts.

An abstract representation of artificial intelligence interacting with human emotions.
An abstract representation of artificial intelligence interacting with human emotions.
1 sources
Pipeline ingest
3 reads
Positive / Neutral / Negative
0 countries
Related coverage

Apply Now: $5 Million to Test If AI Chatbots Fail Users in Crisis

By Wayan Vota on September 6, 2026

anthropic mental health funding

The WHO Mental Health Atlas 2024 counts a median of 1.1 to 2.4 specialized mental health workers per 100,000 people in low-income and lower-middle-income countries. High-income countries report 67.2, and spend US$65.89 per person against under a dollar.

People in that gap type their problems into chatbots. In a June 2025 study of roughly 4.5 million Claude.ai conversations, Miles McCain and thirteen co-authors at Anthropic found 2.9% were emotional or personal exchanges. The study covered adults only and gave no breakdown by country or language.

That omission is the problem.

The benchmarks deciding whether a model answers a distressed user safely are written in English against North American and European clinical practice. Researchers led by Adrián Arnaiz-Rodríguez at ELLIS Alicante tested leading models against crisis inputs from 12 datasets and found generic and location-inappropriate answers, worst in self-harm scenarios. A helpline number for the wrong country is not a safe response.

$5 Million AI Chatbot Opportunity

Anthropic will award $5 million in individual grants of typically $500,000 to $1.5 million. That funds between three and ten teams to research how AI impacts users’ wellbeing. Grantees also get research API access or credits and occasional technical input from Anthropic staff.

Every funded evaluation must ship as an open-source resource. Anthropic will not veto or embargo findings, and grantees must disclose the funding in all outputs.

Example topics include detecting harmful emotional dependence and measuring whether responses optimize for continued interaction over user interest. The Safeguards team’s guidance lists regional and linguistic variation as a quality criterion, naming slang, coded terms, crisis resources, and cultural norms.

Apply Now: Deadline is 21 September 2026

More Funding Opportunities

Please sign up now to get our email updates. Learn how to get startup funding for your technology business, and find new funding opportunities with donors.

We are constantly publishing fundraising guidance and competitive insights like this:

Share this:

Now Read These Related Posts

chatbot principles healthcare

Introducing 10 Responsible Chatbot Usage Principles

When a new technology is introduced in healthcare, it invites meticulous scrutiny. Conversational AI is no exception. Exchange sensitive health information with conversation AI chatbots is one of many governance challenges that require careful consideration in order to promote responsible use of chatbots in healthcare. Other challenges include performance assurance,…

chw mapping

What Are Generative AI Solutions for Community Health Workers?

The findings from a Global Mapping of AI in CHW Programs across low- and middle-income countries by Nate Miller is very telling. He found 38 different AI systems to support community health workers, with a large majority (87%) of programs in sub-Saharan Africa and South Asia. Outside of those regions,…

ICT economic development

Apply Now: $1 Million for New Biometric Tools and Chatbots for Digital Financial Services

Caribou Digital has launched the DFS Tech imitative to engage scientists, researchers, and engineers to solve hard technical challenges in financial inclusion, with over $1 million in start-up funding, expert advice, industry data, shared resources, access to partners, and deep knowledge of local populations and markets. Their first Request for…

Filed Under: Funding

More About: Generative AI, Mental Health, Online Safety, World Health Organization

Written by Wayan Vota

Wayan Vota co-founded ICTworks. He also co-founded Technology Salon, Career Pivot, MERL Tech, ICT4Djobs, ICT4Drinks, JadedAid, Kurante, OLPC News and a few other things. Opinions expressed here are his own and do not reflect the position of his employer, any of its entities, or any ICTWorks sponsor.

Stay Current with ICTworks Get Regular Updates via Email

Leave a Reply

Click here to cancel reply.

Name * E-mail * URI

Δ

Sign Up Now

Join 25,000 ICT4D Experts

Don't miss out! Your peers get ICTworks emails 3 times a week. Shouldn't you?

Email First Name Last Name Continue

Join via text Type number instead

No, I don't want texts

PAN's pipeline reviewed approximately 1 open sources for this article. No human editor reviewed this article before publication.

Related Reads

Show on timeline →