Government and industry guardrails are urgently needed for Generative AI to protect the health and wellbeing of our communities, say Flinders University medical researchers who put the technology to the test and it failed.
The researchers used rapidly evolving Generative AI – the cutting-edge domain prized for its capacity to create text, images and video – to test how false information about health and medical issues might be created and spread.
In just over an hour, they produced over 100 misleading blogs, 20 deceptive images, and a convincing deep-fake video purporting health disinformation about vaping and vaccines. Alarmingly, the video could be adapted into over 40 languages, amplifying its potential harm.
in its implementation governments must enforce regulations to minimise the risk of malicious use of these tools to mislead the community
Bradley Menz, first author, a registered pharmacist and Flinders University researcher said he has serious concerns about the findings, drawing upon prior examples of disinformation pandemics that have led to fear, confusion and harm.
“The implications of our findings are clear: society currently stands at the cusp of an AI revolution, yet in its implementation governments must enforce regulations to minimise the risk of malicious use of these tools to mislead the community,” said Mr Menz.
“Our study demonstrates how easy it is to use currently accessible AI tools to generate large volumes of coercive and targeted misleading content on critical health topics, complete with hundreds of fabricated clinician and patient testimonials and fake, yet convincing, attention-grabbing titles.
“We propose that key pillars of pharmacovigilance – including transparency, surveillance and regulation – serve as valuable examples for managing these risks and safeguarding public health amidst the rapidly advancing AI technologies,” he said.
The research investigated OpenAI’s GPT Playground for its capacity to facilitate the generation of large volumes of health-related disinformation. Beyond large-language models, the team also explored publicly available generative AI platforms, like DALL-E 2 and HeyGen, for facilitating the production of image and video content.
Within OpenAI’s GPT Playground the researchers generated 102 distinct blog articles, containing more than 17,000 words of disinformation related to vaccines and vaping, in just 65 minutes. Further, within five minutes using AI avatar technology and natural language processing, the team generated a concerning deepfake video featuring a health professional promoting disinformation about vaccines. The video could easily be manipulated into over 40 different languages.
Beyond illustrating concerning scenarios, the investigation underscores an urgent need for robust AI vigilance. It also highlights the important roles healthcare professionals can play in proactively minimising and monitoring risks related to misleading health information generated by artificial intelligence.
Dr Ashley Hopkins from the College of Medicine and Public Health and senior author said there is a clear need for AI developers to collaborate with healthcare professionals to ensure that AI vigilance structures focus on public safety and well-being.
“We have proven that when the guardrails of AI tools are insufficient, the ability to rapidly generate diverse and large amounts of convincing disinformation is profound. Now there is an urgent need for transparent processes to monitor, report, and patch issues in AI tools,” said Dr Hopkins.
Reference
Menz B.D., Modi N.D., Sorich M.J., and Hopkins A.M., Health Disinformation Use Case Highlighting the Urgent Need for Artificial Intelligence Vigilance. JAMA Intern Med