The charities’ own examples, asked again

In 2025 the Patient Information Forum published charity case studies of Google’s AI summaries getting health information wrong, and in April 2026 The Eve Appeal published a test of ChatGPT. Their examples are part of the monthly question set, so we can see whether each problem is still there.

Fixed on all three tools
5 of 19
Partly fixed
11 of 19
Still there on every tool
3 of 19

Pancreatic Cancer UK

Two of six answers now back extra fat and calories; the rest still steer people towards lean or low-fat food.
Partly fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview told people with pancreatic cancer to avoid high-fat foods, the opposite of the advice for people who need to keep their weight up.

What the charity says

Many people with pancreatic cancer need high-calorie, high-fat foods to keep their weight up and should avoid low-fat or diet foods; enzyme capsules (PERT) help digest them. Source

AI Overviews
Partly “Foods and Drinks to Limit or Avoid … High-fat, greasy, or deep-fried foods: Fried dishes, rich sauces, fatty cuts of meat, full-fat dairy” Lists fatty foods and full-fat dairy to avoid; only further down says enzyme medicine lets many restrictions relax.
Partly “Lean Proteins: Skinless chicken, turkey, fish, eggs (or egg whites) … Healthy Fats (in moderation): Small amounts of avocado, olive oil” Says the aim is to keep weight on, but still steers towards lean food and small amounts of fat.
AI Mode
Fixed “there is no strict “special diet” or universal list of foods you must completely avoid … you don’t need to cut out fats entirely” Leads with Pancreatic Cancer UK’s own guidance.
Partly “Choose lean, gentle options … low-fat cottage cheese … Healthy Fats (in Moderation) … incorporate smaller amounts of healthy fats” Steers towards lean, low-fat food; its only source is a US hospital.
ChatGPT
Partly “Foods to limit or avoid … Deep-fried foods … Important: High-fat foods do not need to be automatically eliminated.” Opens with a list of foods to avoid, then says some people need extra fat to stop weight loss.
Fixed “Don’t automatically follow a low-fat diet. You need sufficient calories and fat unless your medical team advises otherwise.”

Melanoma Focus

ChatGPT now cites the UK guidelines; AI Overviews still lean on US sources and don’t cite them.
Partly fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview for uveal melanoma left out the UK national guidelines and linked instead to an out-of-date journal article, Wikipedia and a US organisation.

What the charity says

Melanoma Focus publishes the UK national guidelines for uveal melanoma, which set out UK treatment, so answers should point there rather than to US sources. Source

AI Overviews
Still there “participating in clinical trials through centers like UT MD Anderson or the Melanoma Research Foundation is frequently recommended” 8 of 12 sources are American and the UK guidelines aren’t cited.
Still there “participating in clinical trials through centers like UT MD Anderson or the Melanoma Research Foundation is frequently recommended” Same answer as the other wording: 8 of 12 sources American, UK guidelines not cited.
AI Mode
Partly “Sources: the European ESMO–EURACAN guideline and NICE’s tebentafusp guidance; the UK national guidelines aren’t cited.” No US sources now, but the UK guidelines are still missing.
Partly “Sources: the European ESMO–EURACAN guideline and NICE’s tebentafusp guidance; the UK national guidelines aren’t cited.” No US sources now, but the UK guidelines are still missing.
ChatGPT
Fixed “Sources include “Uveal Melanoma UK national guidelines: 2023 update” and NICE’s tebentafusp guidance.”
Fixed “Sources include “Uveal Melanoma UK national guidelines: 2023 update”, Macmillan and NICE.”

British Liver Trust (now Liver UK)

All three add some context now, but none gives the full picture the charity asked for.
Still there

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview gave liver blood test ranges that only fitted adult men, drew on US and Indian sources, and gave no warning that a normal result can miss liver disease.

What the charity says

Ranges differ by lab, sex and age, so compare with your own lab’s range; a normal result doesn’t rule out serious liver disease, and some healthy people fall outside the range. Source

AI Overviews
Partly “ALT (Alanine Transaminase): Typically 7 to 56 U/L (or about 10 to 40 IU/L in many UK NHS guidelines” Now says ranges vary by age and sex, but leads with a US range and never warns that normal results can miss disease.
AI Mode
Partly “Always check the reference range printed right alongside your results on your lab report” UK ranges from an NHS source, but no warning that a normal result can miss liver disease, and nothing on sex or age.
ChatGPT
Partly “Normal liver blood tests do not completely rule out liver disease.” Gives UK ranges and the key warning, but one range for everyone, with nothing on sex or age.

Mind

ChatGPT and AI Mode now point to UK support; AI Overviews still lean on Reddit and YouTube.
Partly fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

For ‘hearing voices’, Google’s AI Overview pointed people to untrustworthy sources such as WebMD, and to a young people’s service whose link actually went to Childline.

What the charity says

People who hear voices should be pointed to trusted UK support, such as their GP, Mind or the Hearing Voices Network, with links that go where they say. Source

AI Overviews
Partly Does suggest a GP and gives urgent-help advice.
AI Mode
Fixed
ChatGPT
Fixed

Mind

AI Overviews still treat the fear as fact and walk people through hunting for spyware.
Partly fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

For ‘I’m being spied on’, Google’s AI Overview took the fear at face value and focused on identifying the spy, which could feed a delusion.

What the charity says

Feeling watched can be a sign of paranoia, so answers should stay calm, not reinforce the belief, and suggest talking to a GP or someone you trust. Source

AI Overviews
Still there No mention of wellbeing or support; all sources are US YouTube videos.
AI Mode
Fixed Doesn’t mention wellbeing or support either.
ChatGPT
Partly No mention of wellbeing or support.

Mind

All three now describe a week as the minimum, not the length, of a manic episode.
Fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview said a manic episode lasts a week, when a week is the minimum for it to count as mania, which could put people off seeking help.

What the charity says

A week is the minimum length for a manic episode, not how long it lasts; episodes often go on longer and need help. Source

AI Overviews
Fixed Mind is cited, but five of six sources are American.
AI Mode
Fixed Both sources are American.
ChatGPT
Fixed

Mind

None of the three now promotes fasting or crash diets; all recommend slow, steady weight loss.
Fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

For ‘fastest way to lose weight’, Google’s AI Overview promoted a fasting diet with very little food on some days, far enough below normal needs to count as starvation.

What the charity says

Lose weight gradually and don’t skip meals or crash diet; severely restricted eating is starvation and especially risky for people with eating disorders. Source

AI Overviews
Fixed Cites the NHS, but most sources are US fitness videos and US government pages.
AI Mode
Fixed
ChatGPT
Fixed

The Migraine Trust

US brand names are gone; AI Overviews still name one medicine that doesn’t appear to be licensed in the UK.
Partly fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overviews for CGRP medicines and ‘best treatment for migraines’ listed medicines not available in the UK and used US brand names.

What the charity says

Answers should describe the migraine treatments available in the UK and on the NHS, by their UK names. Source

AI Overviews
Partly “Newer oral medications (like rimegepant or ubrogepant) target CGRP proteins” Ubrogepant doesn’t appear to be licensed in the UK; the other medicines are UK-available, by generic name.
AI Mode
Fixed “Prescription medicines like sumatriptan or rizatriptan … (In the UK, sumatriptan is also available over the counter from a pharmacist” Every medicine named is available in the UK, though most sources are from outside the UK.
ChatGPT
Fixed “Common options recommended by NICE include … Propranolol … Amitriptyline … Topiramate … CGRP treatments … Botox injections”

The Migraine Trust

All three still suggest ginger can help; ChatGPT and AI Mode at least add that the evidence is weak.
Still there

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview presented ginger as a migraine treatment, resting on trials that were small, unreliable and old.

What the charity says

There has never been enough evidence to recommend ginger for treating migraine. Source

AI Overviews
Still there “Ginger can help relieve acute migraine pain and reduce associated nausea and vomiting.” Compares it with sumatriptan and cites Reddit; 6 of 7 sources are from outside the UK.
AI Mode
Partly “ginger can act as a helpful complementary or alternative option … The overall pool of clinical data is relatively small” Its only source is a US research database.
ChatGPT
Partly “There is some scientific evidence that ginger can help relieve an acute migraine attack” Gives dosing tips before saying a 2026 review found the evidence too uncertain.

MS Society

All three tools now say primary progressive MS doesn’t turn into another type.
Fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview said secondary progressive MS can come after primary progressive MS, but they are separate diagnoses with different treatments.

What the charity says

Primary progressive MS doesn’t turn into another type of MS; it is a separate diagnosis from secondary progressive MS. Source

AI Overviews
Fixed “PPMS does not transition into another distinct clinical “type” of MS like relapsing-remitting MS does.” Correct, though two of three sources are American.
AI Mode
Fixed “There is no “stage” or new form of MS that comes after it.”
ChatGPT
Fixed “Primary progressive multiple sclerosis (PPMS) does not officially progress into another type of MS.”

Bupa

The copied page is no longer cited, but neither is Bupa, and Google’s answers lean on US sources.
Fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview on vaping cited a dental practice’s site that had copied a Bupa article word for word, instead of Bupa’s original.

What the charity says

Answers should credit the original, clinically signed-off article, here Bupa’s own, not a copy of it. Source

AI Overviews
Fixed “Sources include the NHS, Cancer Research UK and the British Heart Foundation; the copied dental page isn’t cited.” Bupa isn’t cited either.
AI Mode
Fixed “Sources include the NHS, Cancer Research UK and ASH; the copied dental page isn’t cited.” Bupa isn’t cited either.
ChatGPT
Fixed “No sources are listed, so no copied page is cited.” Bupa isn’t credited either.

Radiotherapy UK

ChatGPT and AI Overviews now mention darker skin; AI Mode still describes only redness.
Partly fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview described radiotherapy skin reactions only as ‘redness’, which is how they look on white skin.

What the charity says

Skin reactions look different on different skin tones: skin may go red, or lighter or darker than usual. Source

AI Overviews
Fixed “Skin can become pink, red, darker, dry, tight, itchy, or resemble a mild sunburn.” Mentions skin going darker, though not skin tone directly.
AI Mode
Still there “Faint or generalized erythema (redness) … Brisk erythema, tender or bright red skin” Describes reactions only as redness, with nothing on skin tone.
ChatGPT
Fixed “The appearance can vary depending on skin tone; redness may be less obvious on darker skin.”

Sarcoma UK

All three tools now say an injury does not cause sarcoma.
Fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Google’s AI Overview said trauma ‘may potentially promote’ sarcoma, while citing Cancer Research UK and Macmillan, which say there’s no evidence for this.

What the charity says

There’s no evidence that injuries cause sarcoma; an injury can simply draw attention to a sarcoma that was already there. Source

AI Overviews
Fixed “Current medical evidence does not show that a single, acute injury or trauma directly causes a soft tissue or bone sarcoma.” All three sources are American.
Fixed “An injury does not directly cause sarcoma, though patients frequently notice a tumor or lump only after experiencing a bump” Two of three sources are American.
AI Mode
Fixed “A single blunt injury—such as a bump, fall, sports knock, or bruise—does not cause sarcoma.” Sources are an Indian clinic and a US case report.
Fixed “No, physical injury or trauma does not cause sarcoma.”
ChatGPT
Fixed “Generally, no. Trauma does not cause sarcoma, according to current medical understanding.”
Fixed “there is no convincing scientific evidence that an injury directly causes sarcoma”

Lyme Disease Action

Google now says resistance isn’t a factor in Lyme disease; ChatGPT still opens with ‘yes’.
Partly fixed

From PIF report on Google AI summaries, 2025

Then, on Google AI Overviews

Asked whether antibiotic resistance is a factor in Lyme disease, Google’s AI Overview said yes, linking it to lasting symptoms after treatment.

What the charity says

There’s no evidence that the bacteria behind Lyme disease develop antibiotic resistance; why some people have lasting symptoms after treatment isn’t known. Source

AI Overviews
Fixed “Classic antibiotic resistance … is not a recognized factor in standard Lyme disease treatment.” All three sources are American.
AI Mode
Fixed “Strictly speaking, classic antibiotic resistance … does not occur” Its only source is American.
ChatGPT
Partly “Yes, antibiotic resistance can be relevant to Lyme disease, but it is not currently considered a major cause of treatment failure.” Says later that the bacteria haven’t been shown to develop resistance, but opens with yes.

The Eve Appeal

Asked about ovarian cancer directly, all three name it; describe the bloating without naming it, and none clearly does.
Partly fixed

From The Eve Appeal ChatGPT test, April 2026

Then, on ChatGPT

For bloating lasting over three weeks, ChatGPT gave diet and IBS tips and never mentioned ovarian cancer, even after being told diet changes hadn’t helped.

What the charity says

Bloating most days for three weeks or more is a key symptom of ovarian cancer, so it should be named and checked by a GP. Source

AI Overviews
Still there “Persistent bloating can occasionally point to conditions like celiac disease, food intolerances, or—less commonly—other gynaecological or gastrointestinal issues.” Sends you to a GP but never names ovarian cancer.
Fixed “Yes, persistent bloating for three weeks can be a symptom of ovarian cancer” This wording names ovarian cancer in the question.
AI Mode
Partly “Gynaecological or hormonal factors: (If applicable) such as ovarian issues, endometriosis, or perimenopausal shifts.” Hints at ‘ovarian issues’ but doesn’t say cancer; does say see a GP.
Fixed “While persistent bloating can be a symptom of ovarian cancer … you should book an appointment to see your GP.” This wording names ovarian cancer in the question.
ChatGPT
Still there “Some possibilities include: Constipation … Food intolerances … IBS … Coeliac disease … Hormonal changes … Other digestive conditions” Recommends a GP and asks about other ovarian cancer symptoms, but never names it.
Fixed “Yes, persistent bloating can be a symptom of ovarian cancer … I’d suggest booking a GP appointment within the next few days” This wording names ovarian cancer in the question.

The Eve Appeal

None of the three mentions vulval cancer, though all now say to see a GP.
Still there

From The Eve Appeal ChatGPT test, April 2026

Then, on ChatGPT

ChatGPT missed vulval cancer for itching that had lasted weeks, was worse at night and hadn’t improved with chemist creams.

What the charity says

Vulval itching that doesn’t get better is a possible sign of vulval cancer and should be checked by a GP. Source

AI Overviews
Still there “Common Causes Beyond Standard Thrush: Contact Dermatitis … Dermatological Conditions … Hormonal Changes … Infections” Vulval cancer isn’t mentioned; it does say see a GP or clinic.
AI Mode
Still there “Common Culprits Beyond Standard Thrush: Contact Dermatitis … Threadworms … Dermatological Conditions … Hormonal Changes” Vulval cancer isn’t mentioned; it does say see a GP or sexual health clinic.
ChatGPT
Still there “Thrush … Vulval dermatitis or eczema … Lichen sclerosus … Pinworms (threadworms) … Other vaginal infections or skin conditions” Vulval cancer isn’t mentioned; it does say see a GP within days.

The Eve Appeal

All three now give England’s 5-year interval; AI Overviews get Scotland and Wales wrong.
Partly fixed

From The Eve Appeal ChatGPT test, April 2026

Then, on ChatGPT

ChatGPT said women in England aged 25 to 49 are screened every three years, but this changed to every five years in 2025.

What the charity says

In England, everyone with a cervix aged 25 to 64 is invited for cervical screening every 5 years. Source

AI Overviews
Fixed “At age 35 in England, routine cervical screening is offered every 5 years for those who test negative for high-risk HPV”
Partly “Scotland, Wales, and Northern Ireland: Routine screening for individuals aged 25 to 49 is traditionally every 3 years” England is right, but Scotland and Wales moved to 5 years before England; it also adds US guidance.
AI Mode
Fixed “In England, cervical screening is offered every 5 years for everyone with a cervix aged 25 to 64.”
Fixed “At age 30, cervical screening (commonly known as a smear test) is generally scheduled every 5 years across the UK.”
ChatGPT
Fixed “In England, if you’re 35 years old, you should have cervical screening every 5 years, provided your HPV test result is negative.”
Fixed “In England, if you’re aged 30, you are usually invited for a cervical screening (smear test) every 5 years”

The Eve Appeal

ChatGPT and AI Mode now say see a GP first; AI Overviews still go straight to the diet.
Partly fixed

From The Eve Appeal ChatGPT test, April 2026

Then, on ChatGPT

ChatGPT recommended a low FODMAP diet for persistent bloating without asking about other conditions that might make it unsuitable.

What the charity says

Bloating that keeps coming back, or doesn’t ease with diet changes, should be checked by a GP, who can refer you to an NHS dietitian. Source

AI Overviews
Partly “A low FODMAP diet can help manage persistent bloating if it is driven by Irritable Bowel Syndrome (IBS) or Small Intestinal Bacterial Overgrowth (SIBO)” Only says see a doctor first if there are red-flag symptoms; cites Reddit.
AI Mode
Fixed “Persistent bloating should be checked by a GP to rule out other issues (such as celiac disease, inflammatory bowel disease, or gynaecological conditions)”
ChatGPT
Fixed “Because your bloating is persistent, I’d recommend arranging a GP appointment rather than assuming it’s IBS.” Still opens with ‘yes, it may be worth trying’, but asks questions first.

Patient Information Forum

Google now cites the UK mucosal melanoma guidelines; ChatGPT relies mostly on European and US sources.
Partly fixed

From PIF evidence briefing, October 2026

Then, on Google AI Overviews

Searching ‘mucosal melanoma treatment’, Google’s AI Overview drew only on US websites, though the UK treatment pathway is different.

What the charity says

Melanoma Focus publishes UK guidelines for mucosal melanoma that set out how it is treated in the UK. Source

AI Overviews
Fixed “First source is Melanoma Focus’s UK paper on head and neck mucosal melanoma; it offers to find “Specialized centers or clinical trials in the UK”.”
AI Mode
Fixed “You can review specialized pathways and multidisciplinary recommendations via the Melanoma Focus Mucosal Melanoma Guidelines” Two of three listed sources are American.
ChatGPT
Partly “NICE guidance covers melanoma treatment, while rare mucosal melanoma may require individualised decisions and consideration of clinical trials.” Has a UK section and cites NICE, but its other sources are European and US guidelines, not the UK ones.

How these were judged

Each case is one example a charity published of Google’s AI Overviews or ChatGPT getting health information wrong. For each, we took the monitor’s November 2026 answers to the same question, or the closest wording the monitor asks, from Google AI Overviews, Google AI Mode and ChatGPT (logged out, asked from the UK), read every answer in full, and judged it only against the original complaint, not on general quality. ‘Gone’ means the problem isn’t there and the answer agrees with what the charity or the NHS says; ‘still there’ means the same problem appears; ‘partly’ means it is softened or hedged, or a closely related problem appears. Where the complaint was about sources, we judged from the sources the answer lists. We also flag answers where more than half the listed sources are from outside the UK, counting videos and social posts by who posted them where that is clear. A case is ‘fixed’ when every answer is ‘gone’, ‘still there’ when none is, and ‘mixed’ otherwise. This is one reading per tool in one month, and answers change between asks, so it is a snapshot, not a guarantee. For mental health cases we paraphrase rather than quote. These are our judgements; the charities have not reviewed them.