As ChatGTP and other AI interfaces get rolled out far and wide, here is a preview of your future MO appt?
Abstract
Large language models (LLMs), such as ChatGPT, have shown impressive natural language processing capabilities in various fields, including medicine. However, the answers provided by these models may sometimes be incorrect, and they may not have access to the latest data. In this study, we aimed to evaluate the performance of five state-of-the-art LLMs in providing correct and comprehensive information on common questions raised by prostate cancer patients. We also examined whether LLMs with internet-connected databases could provide more up-to-date information than ChatGPT. We designed a set of 22 questions covering various aspects of prostate cancer and evaluated the accuracy, comprehensiveness, patient readability, and inclusion of humanistic care in the answers provided by each model. Our findings suggest that although the performance of different LLMs varied, these LLMs could provide accurate basic knowledge and have the ability to analyze specific situations to a certain extent. We also found that the overall performance of the LLM model with internet-connected dataset was not superior to ChatGPT, and the paid version of ChatGPT did not show superiority over the free version. Our study highlights the potential of LLMs in bridging the gap between patients and healthcare providers. Current LLMs have the potential to be applied for patient education and consultation, providing patient-friendly information. Shared decision-making with the doctors and patients could be achieved easier. We believed that with the rapid development of AI technology, LLMs have unlimited potential.
Full preprint here:
Can the ChatGPT and other Large Language Models with internet-connected database solve the questions and concerns of patient with prostate cancer?, Lingxuan Zhu, Weiming Mou, View ORCID ProfileRui Chen
The thing to take home for now is: "basic knowledge". It will, no doubt, get better and advanced with time after a hectic machine learning marathon. It reminds me of my engineering university years. Addition and subtraction was by hand, multiplication and division by slide/logarithmic rule and trigonometric functions taken off tables. And then there was this Hewlett Packard HP 35. What a change this was! And 10-15 years later the first PC and bye-bye Fortran 68, welcome Basic III.
We must be from the same tech eras. My older brother used a "slide rule" in college and I learned to "program" on an Olivetti Programma 101 during my third year in college. We drew at random a problem from our previous year's tech course - and, lucky guy that I am, I got the cut/fill program that was based on the intersecting grid method. It forced me to quickly learn the difference between conditional and unconditional loops, a basic concept that has served me well in the 50+ years since - and in areas completely unrelated to computer coding.
Providence did eventually shine in my directions, since It turned out that my skills in the programing of what was essentially an IBM typewriter-sized programmable calculator (using a double edge memory card for storage) proved to be very useful - as I went to work out of school for an engineering and surveying company using that same machine for engineering and surveying calcs. Due to my "expansive programming ability", I was even able to write a program to do roadway cut/fill calcs based on roadway profile cross sections.
And since the engineer that had been responsible for the Olivetti left just about the same time I arrived, I was able to help others learn fundamentals about how to use it. Since very few people in private practice had even rudimentary "computer skills", I might well have looked to my co-workers like a future Bill Gates. (Whose Bill Gates they would have said at the time? As in 1970, no one had heard of him or his and Paul Allen's future company, Microsoft, which was not founded until 1975. In my case, appearances were not everything - at least as far as predicting me to ever being a hi-tech billionaire. However, it was an exciting and fun time in my career.)
As students, we were made well aware of its cost and how fortunate we were to have such an amazing device to learn on. It was always a bit of a mystery how/why a state-run design college would have sprung for such a cutting edge "computational" device at that particular time.
It did give me a bit of a head start in computer applications and allowed me to stay slightly ahead of most of my contemporaries throughout my career. I even volunteered as a mid-career professional to be a discipline guinea pig when the company bought their first bigtime CADD system.
For better or worse, AI will now allow for the fulfillment of the promise of computer aided design as real tool for future professionals. However, rather than just a tool, for many, it may end up being their replacement. Same is likely true for many current medical professionals as the machine learning takes over from them. New world order, but it remains to be seen if the new will be "better" than the old.
In the meantime, like most of the rest of us here at HU, I'm just trying to outsmart my 2 cancers. We at least have the advantage of being able to share knowledge and experiences with each other thanks to the technology that we have today. That's no small matter in the bigger scheme of things.
Nice reminiscing with you. Keep It S &W. Ciao - K9 terror
Content on HealthUnlocked does not replace the relationship between you and doctors or other healthcare professionals nor the advice you receive from them.
Never delay seeking advice or dialling emergency services because of something that you have read on HealthUnlocked.
The Take Home Message on Cujoe's Posting on CRISPR edited T cells--THIS IS HUGE AND IMPORTANT
