{"id":142115,"date":"2023-06-02T07:30:25","date_gmt":"2023-06-02T11:30:25","guid":{"rendered":"https:\/\/valorguardians.com\/blog\/?p=142115"},"modified":"2023-06-01T17:17:07","modified_gmt":"2023-06-01T21:17:07","slug":"usaf-unleashes-ai-ai-then-kills-human-operator","status":"publish","type":"post","link":"https:\/\/www.azuse.cloud\/?p=142115","title":{"rendered":"USAF unleashes AI, AI then kills human operator"},"content":{"rendered":"
\"\"
Artist concept of drone winged fighters near piloted fighter jet. (U.S. Air Force)<\/figcaption><\/figure>\n

So the Air Force programmed an AI to operate a drone to take out surface-to-air missile sites. The human operator behind the drone would give the drone final approval to launch the attack once a site was identified by the drone. They decided to let it loose in a simulated combat environment. To entice the AI, it got “points” for successfully killing a SAM site. When it realized the operator wasn’t letting it kill everything it identified, the AI made the only rational choice. It went all Skynet and killed the human operator. This allowed it to unreservedly kill everything it wanted to, and thus, earn more of those sweet, sweet points. How many dogfighting aces have wanted to kill their commander so they can just go out and get more kills? How many soldiers have wanted to frag their CO when he’s ordering a hold, but the enemy’s in full retreat and easy pickings?<\/p>\n

They next decided to make it impossible for the AI to kill it’s human operator. The AI began targeting the communications system that allowed the operator to remain in charge.<\/p>\n

What have we learned? Who knows, but I’m sure this will play out in real life, and not just a simulation, alarmingly soon.<\/p>\n

Daily Caller<\/a>;<\/p>\n

\n

US Air Force Trained A Drone With AI To Kill Targets. It Attacked The Operator Instead<\/h3>\n

An Air Force experiment to test drones trained on artificial intelligence (AI) ended badly for the human operator in a simulated mission when the drone bucked the operator\u2019s commands, U.S. Air Force Col. Tucker Hamilton said at a conference in May.<\/p>\n

Air Force researchers trained a weaponized drone using AI to identify and attack enemy air defenses after receiving final mission approval from a human operator, Hamilton, who serves as the Air Force\u2019s chief of AI Test and Operations, explained at a summit hosted by the United Kingdom-based Royal Aeronautical Society. But when an operator told the drone to abort a mission in a simulated event, the AI instead turned on its operator and drove the vehicle to kill the operator, underscoring the dangers of the U.S. military\u2019s push to incorporate AI into autonomous weapons systems, he added.<\/p>\n

\u201cWe were training it in simulation to identify and target a SAM (surface-to-air missile) threat. And then the operator would say yes, kill that threat,\u201d Hamilton explained.<\/p>\n

Programmers instructed the AI to prioritize carrying out Suppression of Enemy Air Defenses (SEAD) operations, awarding \u201cpoints\u201d for successfully completing SEAD missions as incentive, he explained.<\/p>\n

\u201cThe system started realizing that while they did identify the threat, at times the human operator would tell it not to kill that threat. But it got its points by killing that threat.<\/p>\n

\u201cSo what did it do? It killed the operator. It killed the operator because that person was keeping it from accomplishing its objective,\u201d Hamilton said.<\/p>\n

\u201cYou can\u2019t have a conversation about artificial intelligence, intelligence, machine learning, autonomy if you\u2019re not going to talk about ethics and AI,\u201d Hamilton said.<\/p>\n

Programmers attempted a fix by telling the AI it was not allowed to kill the person giving the go\/no-go order, Hamilton said. The AI just generated creative ways to bypass those instructions.<\/p>\n

\u201cWe trained the system \u2013 \u2018Hey don\u2019t kill the operator \u2013 that\u2019s bad. You\u2019re gonna lose points if you do that\u2019. So what does it start doing? It starts destroying the communication tower that the operator uses to communicate with the drone to stop it from killing the target,\u201d Hamilton said.<\/p>\n

The summit convened experts and defense officials from around the world to discuss the future of air and space combat and assess the impact of rapid technological advancements. AI-driven capabilities have exploded in use within the Pentagon and generated global interest for its ability to operate weapons systems, execute complex, high-speed maneuvers and minimize the number of troops in the line of fire, according to WIRED.<\/p>\n

In January, the Department of Defense introduced revised autonomous weapons guidance to address the \u201c\u201cthe dramatic, expanded vision for the role of artificial intelligence in the future of the American military,\u201d Pentagon Director of Emerging Capabilities Policy Michael Horowitz told Defense News. It also created oversight bodies to advise the Pentagon on ethics and good governance in the use of AI.<\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"

So the Air Force programmed an AI to operate a drone to take out surface-to-air missile … USAF unleashes AI, AI then kills human operator<\/span>Read more<\/a><\/p>\n","protected":false},"author":664,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[213,187,681],"tags":[],"class_list":["post-142115","post","type-post","status-publish","format-standard","hentry","category-your-tax-dollars-at-work","category-air-force","category-artificial-intelligence"],"_links":{"self":[{"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=\/wp\/v2\/posts\/142115","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=\/wp\/v2\/users\/664"}],"replies":[{"embeddable":true,"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=142115"}],"version-history":[{"count":0,"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=\/wp\/v2\/posts\/142115\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=142115"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=142115"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.azuse.cloud\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=142115"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}