Warning - perplexity may report contr... - Advanced Prostate...

Advanced Prostate Cancer

23,631 members28,964 posts

Warning - perplexity may report contradictory info.

kainasar profile image
20 Replies

When query asked for least harm to heart of anxiety drugs, perplexity showed lexapro among the most harmful in first entry, but when question was asked about Ssri's in comparison, lexapro was listed with sertraline as least harmful. Go figure.

Written by
kainasar profile image
kainasar
To view profiles and participate in discussions please or .
Read more about...
20 Replies
petabyte profile image
petabyte

Not surprising, all AIs may give incorrect or contradictory responses although some are worse than others (deepseek). I use various AI models professionally and see errors daily.

I suspect an oncologist would find a lot of errors that we just accept.

You should never rely on the responses in a life or death situation.

AI is useful for learning, research and it can suggest things you may not have thought of.

It can be a great tool but people need to learn to use it effectively and to understand the limitations.

What model did you use and what were your exact "prompts"? Try with "pro" and/or "deep research".

Justfor_ profile image
Justfor_ in reply topetabyte

You may have a look here:

healthunlocked.com/fight-pr...

DeepSeek proved the least bad of ChatGPT, Gemini and Perplexity, in that order.

What will be interesting to find out is whether you or anyone else, (not me as they may be keeping chat archives per IP) posed the same question the answer would be again wrong vs corrected, indicating that they are capable of quick learning after being trained.

petabyte profile image
petabyte in reply toJustfor_

You can't extrapolate performance in one domain (or problem) to another. And this is a sample size of one.

"Chatgpt" is not one thing. The default in thevfree version is gpt4 or a variant. Gpt4 is an older model that has been superceded by o3 and o1 reasoning models.

You get o3-mini in the free version when you select "reason".

O3 and O1 are paid versions and take quite a bit of time to respond.

CavScout profile image
CavScout in reply topetabyte

And Perplexity is not an LLM. Perplexity is an umbrella search engine that employs various LLMs to find answers to search queries. Today Ive learned Perplexity isnt a good source of health information and Health Unlocked is not a good source of information about AI.

kainasar profile image
kainasar

Seems the sources used are the problem, such as popular press vs pubmed studies. Pubmed studies also need scrutiny, as you know.

petabyte profile image
petabyte in reply tokainasar

Yeah! Garbage in , Garbage out.

Perplexity does allow you to restrict sources and it does list what it has used so if the response is important to you, check them all.

Tall_Allen profile image
Tall_Allen

AI is just a way to become agnorant faster. Your skepticism about all its output is warranted.

petabyte profile image
petabyte in reply toTall_Allen

It is a tool.

A colleague of mine has always said "a fool with a tool is still a fool". This was well before AI but it applies here.

All tools have limitations and it takes time and effort to learn to use any tool effectively.

Tall_Allen profile image
Tall_Allen in reply topetabyte

💯 I find it annoying because it provides so many "false positives" that have to be eliminated. In the end it takes me more time to use it than not to use it.

Tall_Allen profile image
Tall_Allen in reply toTall_Allen

I just learned there is a term for that: Brandolini's Law. The law states:

"The amount of energy needed to refute bullshit is an order of magnitude bigger than that needed to produce it."

petabyte profile image
petabyte in reply toTall_Allen

I learned about Brandolini's law in this book which I highly recommend to anyone.

goodreads.com/book/show/488...

Bullshit isn’t what it used to be. Now, two science professors give us the tools to dismantle misinformation and think clearly in a world of fake news and bad data.

They also give a course as well but I haven't done it.

callingbullshit.org/FAQ.html

j-o-h-n profile image
j-o-h-n in reply topetabyte

Reply to petabyte,

How true..... Many a time I was a fool with my tool....ask those women, they'll gladly confirm it..

Good Luck, Good Health and Good Humor.

j-o-h-n

petabyte profile image
petabyte in reply toj-o-h-n

😂😮

T911 profile image
T911

I suggest anyone to try this experiment with your preferred AI model. Ask it a question regarding something you personally consider yourself an expert in. I find the answers to my questions are either A) A demonstration of understanding at a Middle school or High school level at best. B) A regurtatation of the question back to you in various ways. C) Just plain wrong. I would never trust it about a subject I knew little about.

Teufelshunde profile image
Teufelshunde

I find Grok pretty accurate. It gives links to most items it says so we can look it up ourselves. Put my sisters blood test results in it and it caught a UTI and said she needed to get to the doc. Did this AFTER she was at her doc on blood test results and the doc missed it. She went to ER and got treated. I will take Grok over Doc in many cases, especially the busy, see a patient every 15-minute type. I even asked a question and made a statement based on a study I have used for sulforaphane without mentioning a study at all. In the response, it gave me the cite to the BROK study. Perplexity is not even close and cannot search as needed.

SsgCulldelight profile image
SsgCulldelight

Hey the best is the or a derivative there of, All synthesized drugs are processed using petroleum. It's a known fact what carcinogens roll with that. Try Gummi or other low impact edible, you'll be surprised.

Tjc1 profile image
Tjc1

Ai is programmed on propaganda. The same propaganda that, to give one example is the theory someone ate a bat in a wet market in China that spread covid. Unless your living under a rock you should know it's not true. Now, it may be perceived it was just a accidental leak in a lab in China. Ha! Actually Fauci and friends sent funds and the ability to do gain of function research in China because it was illegal to do so here in the US. Using chatgpt is like watching the TV set.

Scientist and medical influencers writing papers can be bought cheaper than politicians.

Good thing to remember.

-Columbo profile image
-Columbo

May I make a suggestion, Ai is in the early innings so use it with some trepidation and caution. Compare it's results on multiple platforms, Grok3-beta, Anthropic's Claude, Gemini etc Here in Canada we have been left hanging without a G.P. (over 6 million of us!) so Ai has been extremely useful by translating pages of highly technical papers from sites like PubMed. Again i'll simply copy/paste into various Ai's and ask the same question..."please translate for a luddite laymen" or whatever lol. These Ai's have been tested and in some cases are PHD levels in select benchmarks. Don't be afraid to swing for the fences, but just understand that what you may be pitched are a few change ups. Cheers

j-o-h-n profile image
j-o-h-n

I use it........... but I always wonder about the A.

Does Artificial mean not real?

not produced by natural forces; artificial or fake. fake, false, faux, imitation, simulated. not genuine or real; being an imitation of the genuine article. man-made, semisynthetic, synthetic. not of natural origin; prepared or made artificially.

Sounds like it's a description of my ex-wife.

Good Luck, Good Health and Good Humor.

j-o-h-n

kainasar profile image
kainasar

Platforms seem to compete over which information can be provided. Perp seems ok for consumer reviews ingredients basics of meds. I got a fairly good rundown if 18.4 upgrade will work for my old iphone. ChatGpt has been much better for science and medicine. I would like to find one that can identify a skin disease from a photo. Or the name of a composition from a sound file. Havent tried putting in blood labs into one to calculate NLR,PLR, and so forth. Cheers!

Not what you're looking for?

You may also like...

Maddening Contradictory Advice

Latest update on my still hormone sensitive lymph nodes-only but widespread metastatic cancer is...
SeattleDan profile image

Good Report

Hello Brothers, just got my six month scans reports back. There was no progression to any vital...
leo2634 profile image

Lynparza - warning!

I'm writing this in pure agony in hopes, that it might help someone in the future. My father is...
MyDad76 profile image

Info

I'm 51, had gleason of 4+4 and 4+3 in two cores. Treated with IMRT and brachy, which didn't work....
GeorgeGlass profile image

Enlarged Prostate advice needed

This is my first post, and I hope I am in the correct forum. I have a greatly enlarged prostate,...

Moderation team

Bethishere profile image
BethishereAdministrator
Number6 profile image
Number6Administrator
Darryl profile image
DarrylPartner

Content on HealthUnlocked does not replace the relationship between you and doctors or other healthcare professionals nor the advice you receive from them.

Never delay seeking advice or dialling emergency services because of something that you have read on HealthUnlocked.