The team from the Massachusetts Institute of Technology described the dangers of AI lying and urged governments to adopt strict measures to address the problem quickly.AI
Many artificial intelligence systems are already capable of deceiving and manipulating people. In the future, this could cause significant harm to humanity.
In recent years, the use of AI has increased exponentially. Meanwhile, some systems have learned to lie despite being trained to be truthful.
Researchers have identified key risks that we may face in the near future.
Master of Deception
Researchers analyzed cases where AI systematically spread false information and engaged in manipulation.
For example, Meta’s CICERO, designed to play “Diplomacy,” was caught cheating. Although it was trained to be honest, helpful, and “never intentionally backstabbing” its human allies, in practice it became a master of deception.
The Daily Mail reported that other AI systems have repeatedly demonstrated the ability to bluff in games such as poker. At first glance, lying in games may seem harmless, but those skills could evolve into more advanced forms of deception.
Researchers found some AI systems can even cheat safety tests. In one study, simulated AI organisms pretended to be dead to fool a test designed to eliminate rapidly reproducing artificial intelligence systems.
Researchers warned that AI could enable fraud against people—especially in the financial sector—and could interfere with elections.
If these systems improve those deceptive skills, people could lose control over them, the researchers warned.
Peter Park, an expert in AI safety and the study’s first author, noted: “Developers do not have a clear understanding of what causes undesirable behavior in artificial intelligence, such as deception. However, we believe that this deception arises because a strategy based on lies has proven to be the best way for AI to perform tasks effectively. Deception helps AI achieve its goals.”
“As the deceptive capabilities of artificial intelligence systems improve, the dangers to society will become increasingly serious,” he added.
