ChatGPT and artificial hallucinations in stem cell research: assessing the accuracy of generated references - a preliminary study

Stem cell research has the transformative potential to revolutionize medicine. Language models like ChatGPT, which use artificial intelligence (AI) and natural language processing, generate human-like text that can aid researchers. However, it is vital to ensure the accuracy and reliability of AI-generated references. This study assesses Chat Generative Pre-Trained Transformer (ChatGPT)'s utility in stem cell research and evaluates the accuracy of its references. Of the 86 references analyzed, 15.12% were fabricated and 9.30% were erroneous. These errors were due to limitations such as no real-time internet access and reliance on preexisting data. Artificial hallucinations were also observed, where the text seems plausible but deviates from fact. Monitoring, diverse training, and expanding knowledge cut-off can help to reduce fabricated references and hallucinations. Researchers must verify references and consider the limitations of AI models. Further research is needed to enhance the accuracy of such language models. Despite these challenges, ChatGPT has the potential to be a valuable tool for stem cell research. It can help researchers to stay up-to-date on the latest developments in the field and to find relevant information.

Automated summary

Stem cell research holds transformative potential, and AI-generated text models like ChatGPT can assist researchers. However, ensuring the accuracy and reliability of AI-generated references is crucial, as this study found a significant percentage of fabricated and erroneous references. To mitigate these issues, monitoring, diverse training, and expanding knowledge cut-off can be implemented, while researchers must verify references and consider the limitations of AI models.