A weapons system that identifies, selects and employs force against targets
without meaningful human control should be considered a lethal autonomous weapons system.
It is time for experts from governments to make explicit where they draw the line in increasing autonomy in weapon systems and determine how to
retain meaningful human control over weapons systems.
As weapons increasingly rely on AI, this project provides an interdisciplinary framework for how such weapons systems might be
under meaningful human control.
These and other systems with high degrees of autonomy must be examined in order to understand
how meaningful human control is exercised and how civilians can be afforded adequate and lasting protections.
It will work to foster greater international and regional cooperation to convince governments concerned about
retaining meaningful human control of future weapons systems to agree to an international ban.
The talks could and should result in a new CCW protocol
requiring meaningful human control over attacks and prohibiting lethal autonomous weapons systems (systems that do not allow for that human control).
The letter states [quote] «Lethal autonomous weapons systems that
remove meaningful human control from determining the legitimacy of targets and deploying lethal force sit on the wrong side of a clear moral line.»
The CCW should articulate first and foremost a legal commitment to
ensuring meaningful human control and a constraint on the development of autonomy in the critical functions of weapons systems.
In July 2015, thousands of AI researchers from around the world signed an open letter to the UN calling for a ban on offensive autonomous weapons
beyond meaningful human control.
Project: Artificial Intelligence, Autonomous Weapons, and
Meaningful Human Control by Arizona State University Global Security Initiative's Autonomy, Robotics & Collective Systems, October 2016.
As was the case at the two previous meeting, the need
for meaningful human control of weapons systems was a central feature of the meeting, raised throughout by multiple states, expert presenters, the ICRC and the Campaign to Stop Killer Robots.
Weapons reviews must be grounded in new and robust international law that clearly and deliberately
puts meaningful human control at the centre of all weapons development.
The Campaign to Stop Killer Robots and its concerns over the prospect of weapons systems that would be able to select and engage targets without
meaningful human control features this week in a Newsweek Japan special edition on robotics.
An letter signed by 122 faculty members working in AI and robotics in Australia says that lethal autonomous weapons lacking
meaningful human control sit on the wrong side of a clear moral line.
Campaign representative Richard Moyes from Article 36 spoke
about meaningful human control of autonomous weapons at a side event on 16 October hosted by UNIDIR and the governments of the Netherlands and Switzerland.
Elaborate the key characteristics for a working definition of lethal autonomous weapons systems, which the campaign views as systems operating
without meaningful human control in the «critical functions» of identifying, selecting and applying force to targets;
It supports the recommendation to create a Group of Governmental Experts and urges states to identify an ambitious outcome for such a «GGE» to work towards by aiming to negotiate a new CCW protocol
retaining meaningful human control of weapons systems and individual attacks.
Members of the Artificial Intelligence research community exhort the Prime Minister of Canada to join the international call to ban lethal autonomous weapons that remove
meaningful human control in the deployment of lethal force.
The U.S. Department of Defense's Directive on Autonomous Weapons permits under - secretaries of defense, in certain cases, to bend its rule that weapons remain
under meaningful human control.
Lethal autonomous weapons systems that
remove meaningful human control from determining the legitimacy of targets and deploying lethal force sit on the wrong side of a clear moral line.»
It marks the beginning of a process that the campaign believes should lead to an international ban on these weapons to ensure there is
always meaningful human control over targeting decisions and the use of violent force.
Toby Walsh, the Australian organizer of the boycott, told Reuters that he's pleased with the statement put out by KAIST pledging, «not to develop autonomous weapons and to
ensure meaningful human control.»
«While fully autonomous weapons are a concern of the future, existing technologies already press the boundaries of autonomy, demonstrating the urgent need to establish a legal obligation
for meaningful human control of robot weapons.»
A Tuesday afternoon panel on «characteristics» considered the concept
of meaningful human control over targeting and attack decisions and saw presentations by five experts including the ICRC's Dr. Neil Davison, Prof. Nehal Bhuta, and Ms. Maya Brehm.
The letter to the US secretaries of defense and state proposes a new CCW protocol that «should require
meaningful human control over target selection and engagement for each individual attack.»
They should also explore how to maintain «
meaningful human control» over intelligent machines, in order to avoid «undesired consequences».
«We therefore publicly declare that we will boycott all collaborations with any part of KAIST until such time as the President of KAIST provides assurances, which we have sought but not received, that the Center will not develop autonomous weapons lacking
meaningful human control.»
We therefore publicly declare that we will boycott all collaborations with any part of KAIST until such time as the President of KAIST provides assurances, which we have sought but not received, that the Center will not develop autonomous weapons lacking
meaningful human control.
«I reaffirm once again that KAIST will not conduct any research activities counter to human dignity including autonomous weapons lacking
meaningful human control.»
The concept of «
meaningful human control» is something that my delegation is supportive of.
The campaign aims to engage at the regional level to build awareness and support for a collective response and it continues to explore other avenues that could lead states to adopt a new international instrument to retain
meaningful human control over the critical functions of weapons systems.
Given the development of greater autonomy in weapon systems, states should make it explicit that
meaningful human control is required over individual attacks and that weapon systems that operate without meaningful human control should be prohibited.
For example we have to further deepen our understanding of what we exactly mean by «
meaningful human control» when we talk about these weapon systems.
Meaningful Human Control could be a very relevant subject of our CCW - meeting on topic in 2015.
There is a need to ensure appropriate or
meaningful human control or judgement over the use of force, including the use of lethal force against human targets.
The campaign urges states to participate in the CCW Group of Governmental Experts meeting, which opens at the United Nations (UN) on Monday, 9 April, and to commit to retain
meaningful human control of weapons systems and over individual attacks.