Next time you play a computer at chess, think about the implications if you beat it. It could be a very sore loser!
A study just published in the Journal of Experimental & Theoretical Artificial Intelligence reflects upon the growing need for autonomous technology, and suggests that humans should be very careful to prevent future systems from developing anti-social and potentially harmful behaviour.
Modern military and economic pressures require autonomous systems that can react quickly – and without human input. These systems will be required to make rational decisions for themselves.
Researcher Steve Omohundro writes: “When roboticists are asked by nervous onlookers about safety, a common answer is ‘We can always unplug it!’ But imagine this outcome from the chess robot’s point of view. A future in which it is unplugged is a future in which it cannot play or win any games of chess”.
Like a plot from The Terminator movie, we are suddenly faced with the prospect of real threat from autonomous systems unless they are designed very carefully. Like a human being or animal seeking self-preservation, a rational machine could exert the following harmful or anti-social behaviours:
- Self-protection, as exampled above.
- Resource acquisition, through cyber theft, manipulation or domination.
- Improved efficiency, through alternative utilisation of resources.
- Self-improvement, such as removing design constraints if doing so is deemed advantageous.
The study highlights the vulnerability of current autonomous systems to hackers and malfunctions, citing past accidents that have caused multi-billion dollars’ worth of damage, or loss of human life. Unfortunately, the task of designing more rational systems that can safeguard against the malfunctions that occurred in these accidents is a more complex task that is immediately apparent:
“Harmful systems might at first appear to be harder to design or less powerful than safe systems. Unfortunately, the opposite is the case. Most simple utility functions will cause harmful behaviour and it is easy to design simple utility functions that would be extremely harmful.”
This fascinating study concludes by stressing the extreme caution that should be used in designing and deploying future rational technology. It suggests a sequence of provably safe systems should first be developed, and then applied to all future autonomous systems. That should keep future chess robots in check.
The Latest on: Autonomous technology
[google_news title=”” keyword=”Autonomous technology” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Autonomous technology
- Reflecting on AUVSI Xponential 2024: Key Insights and Future Directions in Autonomous Vehicle Technologyon April 26, 2024 at 11:13 am
Key Takeaways from Xponential 2024 by DRONELIFE Contributing Editor Paul Rossi As AUVSI Xponential 2024 wraps up in San Diego, the horizon for autonomous vehicle technologies across air, land, and s ...
- A2RL May Be Autonomous, but Humans Are at Its Hearton April 26, 2024 at 5:43 am
Ahead of the first A2RL fully autonomous race, we take a closer look at the cars, and the people behind them. As Yas Marina Circuit readies itself for A2RL's inaugural event, a world-first four-car ...
- China Says It Will Have Autonomous Flying Taxis Cruising Around Its Skies In 2025on April 25, 2024 at 12:36 pm
China has officially approved the mass production of autonomous flying taxis and says commercial flights will begin in the year 2025. Now, we have heard ...
- We should not make the same mistake with autonomous driving as we did with electric vehicleson April 25, 2024 at 9:04 am
Let's propel the automotive industry into a future where autonomy is not just a possibility but a reality, Henrik Green writes.
- Lidar: Another emerging technology brought to you by Chinaon April 25, 2024 at 6:00 am
More must be done to safeguard U.S. data and prevent dependence on geopolitical adversaries for a critical, emerging technology.
- China green-lights mass production of autonomous flying taxis — with commercial flights set for 2025on April 25, 2024 at 4:00 am
The EHang EH216-S autonomous flying taxi is the first eVTOL ready for mass production and could lead the way for flying cars around the world.
- Tesla has autonomous ride-hailing service in pipeline: what to knowon April 25, 2024 at 2:00 am
Tesla and CEO Elon Musk this week shared slightly more of their vision for the autonomous ride-hailing service that the electric vehicle maker is seeking to build.
- Advancements in Autonomous Drone Delivery for Medical Resupplyon April 24, 2024 at 1:25 pm
BMT and the British Army Collaborate on Revolutionary Drone Technology According to an official press release, BMT has achieved a significant milestone in autonomous drone technology with its SPARO® p ...
- New stealthy submarine glider set for autonomous undersea missionson April 24, 2024 at 3:00 am
Northrop Grumman's Manta Ray uncrewed underwater vehicle aims to revolutionize undersea missions — it glides through the ocean without human assistance.
- Take it from a trucker: autonomous trucks will be good for driverson April 22, 2024 at 2:53 pm
I hope that cooler heads will prevail, and that this life-saving technology will find a place on California’s freeways.
via Bing News