A false intelligence report generated using artificial intelligence nearly led to military action by the United States against a Chinese ship in the Middle East. This incident occurred as tensions in the region had escalated due to the war with Iran.
Details of the Incident
According to obtained information, the ship was accused of carrying components related to a nuclear weapons program, prompting U.S. military forces to prepare to counter this threat. U.S. armed forces were preparing to board the ship, and military aircraft were also put on standby. However, this operation was halted only after a re-evaluation of the information and identification of the error in the report.
Read more: Analysis of Foreign Tanker Movements in U.S. Waters by MARAD
The analyst who prepared this information had used an AI chatbot that combined information about the ship's cargo with public and classified data, leading to an incorrect conclusion. According to a source, this intelligence report was "completely inaccurate" and nearly led to the start of a war.
Consequences of Using AI in Intelligence Analysis
This incident illustrates how errors caused by AI can quickly propagate through the intelligence system and be presented as credible reports. Currently, the U.S. Department of Defense is moving towards the rapid integration of AI into its military operations. The AI acceleration strategy introduced by U.S. Secretary of Defense Pete Hegseth includes AI-based battle management and decision support.
This strategy also includes an intelligence initiative designed to expedite the process of converting information into military capabilities. However, reports indicate that the adoption of AI within the U.S. military and intelligence community is still being done in a decentralized manner, with different organizations using varying safety systems and procedures.
The fact that errors caused by AI can quickly become credible reports raises serious questions about the acceptance of AI and the need for safeguards to human-verify information.
Last week, a report was released indicating that an actor linked to Iran had used AI models to gather information on U.S. naval forces. This information included identifying and tracking naval positions and vulnerabilities in ship communication systems. These instances demonstrate that AI can significantly accelerate the collection and processing of maritime information.
Read more: Research Shows 29 Percent of Ships Cause 70 Percent of Maritime Accidents
