){kind=small}
The study reveals that a significant portion of generative AI users are exploiting the technology to “blur the lines between authenticity and deception.” The researchers analysed existing research on generative AI and reviewed around 200 news articles documenting its misuse
read more
In a recent paper, Google researchers have raised alarms about the impact of generative AI on the internet, highlighting the irony that Google itself has been vigorously promoting this technology to its vast user base.
The study, yet to undergo peer review, and was highlighted by 404 Media, reveals that a significant portion of generative AI users are exploiting the technology to “blur the lines between authenticity and deception.”
This includes posting fake or doctored AI-generated content, such as images and videos, on the internet.
The researchers analyzed existing research on generative AI and reviewed around 200 news articles documenting its misuse. Their findings indicate that manipulating human likeness and falsifying evidence are among the most common tactics used in real-world scenarios. These activities often aim to influence public opinion, facilitate scams or fraudulent activities, or generate profit.
A key concern is that generative AI systems have become increasingly advanced and accessible, requiring minimal technical expertise. This is distorting people’s “collective understanding of socio-political reality or scientific consensus,” the researchers found.
One notable omission from the paper is any mention of Google’s own missteps with generative AI. As one of the largest companies globally, Google has occasionally made significant errors in deploying this technology.
The study suggests that the widespread misuse of generative AI indicates the technology is performing its intended function too well. People are using generative AI to produce large amounts of fake content, effectively inundating the internet with AI-generated misinformation.
This situation is exacerbated by Google, which has not only permitted but sometimes been the source of this fake content, including false images and information. The proliferation of such content is challenging people’s ability to distinguish between real and fake information.
The researchers warn that the mass production of low-quality, spam-like, and malicious synthetic content increases public scepticism towards digital information. It also overloads users with the need to verify the authenticity of what they encounter online.
More disturbingly, the researchers point out instances where high-profile individuals have been able to dismiss unfavourable evidence as AI-generated, shifting the burden of proof in costly and inefficient ways. This tactic undermines accountability and complicates the verification process.
As companies like Google continue to integrate AI into their products, the prevalence of these issues is expected to rise. The research underscores the need for vigilance and robust measures to address the challenges posed by generative AI in maintaining the integrity of online information.
