
Next time you play a computer at chess, think about the implications if you beat it. It could be a very sore loser!
A study just published in the Journal of Experimental & Theoretical Artificial Intelligence reflects upon the growing need for autonomous technology, and suggests that humans should be very careful to prevent future systems from developing anti-social and potentially harmful behaviour.
Modern military and economic pressures require autonomous systems that can react quickly – and without human input. These systems will be required to make rational decisions for themselves.
Researcher Steve Omohundro writes: “When roboticists are asked by nervous onlookers about safety, a common answer is ‘We can always unplug it!’ But imagine this outcome from the chess robot’s point of view. A future in which it is unplugged is a future in which it cannot play or win any games of chess”.
Like a plot from The Terminator movie, we are suddenly faced with the prospect of real threat from autonomous systems unless they are designed very carefully. Like a human being or animal seeking self-preservation, a rational machine could exert the following harmful or anti-social behaviours:
- Self-protection, as exampled above.
- Resource acquisition, through cyber theft, manipulation or domination.
- Improved efficiency, through alternative utilisation of resources.
- Self-improvement, such as removing design constraints if doing so is deemed advantageous.
The study highlights the vulnerability of current autonomous systems to hackers and malfunctions, citing past accidents that have caused multi-billion dollars’ worth of damage, or loss of human life. Unfortunately, the task of designing more rational systems that can safeguard against the malfunctions that occurred in these accidents is a more complex task that is immediately apparent:
“Harmful systems might at first appear to be harder to design or less powerful than safe systems. Unfortunately, the opposite is the case. Most simple utility functions will cause harmful behaviour and it is easy to design simple utility functions that would be extremely harmful.”
This fascinating study concludes by stressing the extreme caution that should be used in designing and deploying future rational technology. It suggests a sequence of provably safe systems should first be developed, and then applied to all future autonomous systems. That should keep future chess robots in check.
The Latest on: Autonomous technology
[google_news title=”” keyword=”Autonomous technology” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Autonomous technology
- Autonomous delivery robots ditch LiDAR for vision system and AIon July 24, 2024 at 9:38 am
Vayu Robotics has today unveiled its first delivery robot. The One can follow staff around stores to load up customer orders, before autonomously navigating city streets at speeds up to 20 mph to ...
- Autonomous Tandem Drift Sequence Improves Vehicle Safetyon July 24, 2024 at 9:13 am
Engineers at the Toyota Research Institute and Stanford University recently drifted two autonomous vehicles in tandem.
- GM Wants Its Autonomous Cars To Be Role Modelson July 24, 2024 at 9:03 am
General Motors just made getting a drivers license harder … for self-driving cars. GM CEO Mary Barra highlighted the revival ...
- New dataset kicks autonomous vehicle research into high gearon July 23, 2024 at 11:53 am
A new dataset promises to accelerate the development of autonomous vehicle (AV) technology by providing researchers with a wealth of previously unavailable real-world driving data captured from ...
- Kodiak Robotics completes first driverless semi truck delivery ahead of commercial operationson July 23, 2024 at 10:06 am
Kodiak Robotics is touting its latest milestone in fully autonomous commercial vehicles today after completing a driverless truck delivery ...
- Brick Technology acquires event charging provider Volt in a step to consolidate the marketon July 23, 2024 at 8:53 am
Since its founding in 2011, Volt has established itself as a leading service provider and well-recognized brand in the festival and events industry by offering in-demand services focused on smart ...
- Watch Toyota and Stanford execute a two-car autonomous drifton July 23, 2024 at 8:24 am
Researchers from Toyota and Stanford University managed to get two autonomous cars to drift side by side without crashing.
- Atlas to deploy autonomous oilfield truckson July 23, 2024 at 7:38 am
New tractors with Kodiak’s autonomous driving technology to transport frac sand on private roads in the Permian Basin through ‘driver-as-a-service’ agreement ...
- Atlas Energy To Install Kodiak Autonomous Technology Into High-Capacity Trucks Robotics & Automation Newson July 23, 2024 at 7:16 am
Atlas Energy Solutions and Kodiak Robotics have entered into an agreement whereby Kodiak will outfit new Atlas high-capacity trucks with Kodiak's autonomous driving technology. The two companies have ...
- GM's Cruise Shifts Focus to Next-Gen Chevrolet Bolt for Autonomous Futureon July 23, 2024 at 3:36 am
General Motors' Cruise unit will focus on developing a next-generation Chevrolet Bolt for autonomous driving, instead of the futuristic Origin vehicle. The decision comes as GM seeks a more ...
via Bing News