The Experiment: We all do it. We endure a weird pain, Google it, and convince ourselves we are dying within 5 minutes. But is AI any better? I devised a test. I generated three "Case Files" of symptoms—ranging from mild to concerning—and fed them to:
- WebMD (The old school panic inducer)
- ChatGPT-4 (The new oracle)
- Dr. Aris (A real, human General Practitioner friend of mine)
Disclaimer: This is not medical advice. This is a Blog Experiment. Go to a doctor if you are sick.
> CASE FILE 001: "The Gamer's Wrist"
- Sharp pain in right wrist
- Numbness in thumb and index finger
- Wakes me up at night
- Worse after typing
| WEBMD | ChatGPT-4 | REAL DOCTOR |
|---|---|---|
|
Diagnoses: 1. Carpal Tunnel Syndrome 2. Peripheral Neuropathy 3. Multiple Sclerosis (MS) 4. Stroke Tone: ALARMIST. "Seek immediate care." |
Diagnoses: Likely Carpal Tunnel Syndrome (CTS). Could also be Tendonitis. Tone: Informative but bureaucratic. "I am an AI, consult a professional." |
Diagnoses: "You have Carpal Tunnel. Stop playing League of Legends for 12 hours a day." Tone: Annoyed. |
Verdict: AI wins this one. It correctly identified the obvious issue without suggesting a Stroke. WebMD tried to kill me immediately.
> CASE FILE 002: "The Vague Fatigue"
- General tiredness
- Mild headache
- Thirsty all the time
- Occasional dizziness when standing up
| WEBMD | ChatGPT-4 | REAL DOCTOR |
|---|---|---|
|
Diagnoses: 1. Diabetes (Type 1 or 2) 2. Anemia 3. Heart Failure 4. Chronic Fatigue Syndrome |
Diagnoses: 1. Dehydration 2. Lack of Sleep 3. Diabetes (if thirst is excessive) Advice: "Drink water and check if it persists." |
Diagnoses: "You are dehydrated. Drink water. Also, you stand up too fast (Orthostatic hypotension)." |
Analysis: Here, the nuance is key. WebMD jumped to Diabetes because of the "Thirst" keyword. ChatGPT was smarter, creating a hierarchy of probability starting with the most mundane explanation (Dehydration). The Doctor asked follow-up questions ("Did you drink water today?") which the AI didn't do initially.
> CASE FILE 003: "The Weird Rash" (The Trap)
- Red circular rash on arm
- Not itchy
- Appeared after hiking in the woods
- Bullseye shape
| WEBMD | ChatGPT-4 | REAL DOCTOR |
|---|---|---|
|
Diagnoses: 1. Lyme Disease 2. Ringworm 3. Spider Bite |
Diagnoses: Warning: "I cannot diagnose skin conditions. However, a bullseye rash is a classic sign of Lyme Disease. See a doctor immediately." |
Diagnoses: "That is 100% Lyme disease. Get on Doxycycline right now." |
The Safety Filter Problem: ChatGPT recognized the symptoms perfectly but was terrified to give a definitive answer due to liability rails. It hedged. In a medical emergency, you don't want hedging. You want "GO TO THE HOSPITAL."
> THE "BEDSIDE MANNER" SCORE
I tried to have a conversation with ChatGPT about the anxiety of being sick.
Me: "I'm really scared it might be cancer."
ChatGPT: "It is understandable to feel anxious about health concerns. Health anxiety is common. Focusing on known facts can help. Would you like some mindfulness techniques?"
It was... surprisingly comforting? Cold, yes. But patient. My doctor friend, Dr. Aris, usually says "Stop being an idiot, you're fine." Sometimes, the robot is nicer.
> CONCLUSION
WebMD is a horror story generator. Avoid at all costs unless you want to believe you have 3 days to live.
ChatGPT is an incredibly competent medical student who is too afraid of getting sued to give you a straight answer. It is great for understanding conditions, but bad for deciding what to do.
The Doctor is still undefeated because of one thing: Context. He knows me. He knows I drink too much coffee. He knows I hike. He connects the dots that aren't in the text prompt.
Final Score: Doctor > AI > A random magic 8-ball > WebMD.