About Me

My photo
Australian philosopher, literary critic, legal scholar, and professional writer. Based in Newcastle, NSW. My latest books are THE TYRANNY OF OPINION: CONFORMITY AND THE FUTURE OF LIBERALISM (2019); AT THE DAWN OF A GREAT TRANSITION: THE QUESTION OF RADICAL ENHANCEMENT (2021); and HOW WE BECAME POST-LIBERAL: THE RISE AND FALL OF TOLERATION (2024).

Saturday, May 23, 2009

Robot warriors to get a guide to ethics


Thanks to Mike Treder for blogging about this over at the IEET Ethical Technology blog.

According to this MSNBC story:

Ronald Arkin, a professor of computer science at Georgia Tech, is in the first stages of developing an "ethical governor," a package of software and hardware that tells robots when and what to fire. His book on the subject, "Governing Lethal Behavior in Autonomous Robots," comes out this month.

He argues not only can robots be programmed to behave more ethically on the battlefield, they may actually be able to respond better than human soldiers.


It will be interesting to see what Arkin says in his book. Is anyone sufficiently interested in this subject to get hold of a copy and review it for JET?

Western forces engaged in operations in the Middle East already use robots of various kinds, but always with a human in the decision-making loop. The question that confronts us in the future is what happens when we develop robots that are capable of making their own decisions - and, indeed, whether we should be doing this at all:

No matter where the robots are deployed however, there is always a human involved in the decision-making, directing where a robot should fly and what munitions the robot should use if it encounters resistance.

Humans aren't expected to be removed any time soon. Arkin's ethical governor is designed for a more traditional war where civilians have evacuated the war zone and anyone pointing a weapon at U.S. troops can be considered a target.

Arkin's challenge is to translate the 150-plus years of codified, written military law into terms that robots can understand and interpret themselves. In many ways, creating an independent war robot is easier than many other types of artificial intelligence because the laws of war have existed for over 150 years and are clearly stated in numerous treaties.


I notice that this involves a relatively low level of sophistication, since Arkin is thinking of situations where there are no civilians in the area to complicate things. Even if his software is effective, it's a long way from software that will enable an "autonomous" fighter bot to discriminate between combatants and non-combatants in the sorts of unconventional wars that are likely to be typical in the twenty-first century.

6 comments:

Steve Zara said...

Arkin's ethical governor is designed for a more traditional war where civilians have evacuated the war zone and anyone pointing a weapon at U.S. troops can be considered a target.Who says that civilians have left the war zone?

What happens when a child soldier is holding a rifle?

RichardW said...

Quote: "In many ways, creating an independent war robot is easier than many other types of artificial intelligence because the laws of war have existed for over 150 years and are clearly stated in numerous treaties."

This is remarkably naive. There's a big difference between knowing the laws of war and being able to apply them. First of all, to apply such laws you need to have a thorough understanding of the given situation, and that's far beyond the capability of any existing AI. Second, the laws themselves involve all sorts of notions, such as "proportionality", that are not precisely defined and can only be evaluated by what we would usually call "subjective" judgements.

MosesZD said...

And for the Sci-Fi nuts that frequent your blog: Bolo!

And, for those who aren't:

http://en.wikipedia.org/wiki/Bolo_(tank)

Go Democrats said...

Look at the most recent Israel-Gaza conflict for an example of the degree to which advanced states may have their own, controversial ideas about proportionality. Garbage in, garbage out.

Coathangrrr said...

If this is meant for "traditional" war zones then it will be useless, those don't exist anymore, and hardly did historically. They always have been and always will be a tiny minority of combat situations.

sailor1031 said...

Just where would this battlefield be that has been cleared of civilians? Iraq? Afghanistan? Iran? Pakistan? Gaza? Israel? India? the USA? The days of "conventional" warfare, so beloved of our military types, where there are only enemy combatants (north african desert, plains of Kursk etc) are long gone. The premise for today's wars is that there WILL be civilians in the way. But so what? when did these types ever let reality get in the way of a good hypothesis and an opportunity to squander more public cash on their pet projects?