My Lords, I apologise again for not speaking in Committee due to being at COP. I offer support and regret that I did not attach my name to this amendment. What the noble Lord, Lord Browne, said about public consultation in this process is really important, as is what the noble and gallant Lord, Lord Houghton, said about parliamentary scrutiny. Those two things very much fit together.
I am very aware that the Minister started this day, many hours ago now, promising to read a book, so I will refer to a book but not ask her to read it. It is entitled Exponential: How Accelerating Technology is Leaving Us Behind and What to Do About It, and it is by Azeem Azhar. The thesis is that there is an exponential gap: technologies are taking off at an exponential rate, but society is only evolving incrementally. In terms of society, we can of course look at institutions like politics and the military.
Another book is very interesting in this area. Its co-author, Kai-Fu Lee, has described it as a scientific fiction book, and it posits the possibility of, within the next couple of decades, large quantities of drones learning to form swarms, with teamwork and redundancy. A swarm of 10,000 drones could wipe out half a city and theoretically cost as little as $10 million.
It is worth quoting the UN Secretary-General, António Guterres, who said:
“The prospect of machines with the discretion and power to take human life is morally repugnant.”
That relates to some of the words in the podcast that the noble Lord, Lord Browne, referred to; I have not listened to it, but I will.
Fittingly, given what the Secretary-General said, the United Nations Association of the UK has very much been working on this issue, and communicating with the Government on it. In February, the Government told it that UK weapons systems
“will always be under human control”.
What we have heard from other noble Lords in this debate about how that language seems to have gone backwards is very concerning.
This is very pressing because the Convention on Certain Conventional Weapons will hold an expert meeting on 2 December, I believe, which will look at controls on lethal autonomous weapons systems—LAWS, as they are known. It would be very encouraging to hear from the Minister, now or at some future point, what the Government plan to do if there are no positive outcomes from that—or, indeed, whatever the outcomes are. While the Government have ruled out an independent process, both the mine ban convention and the Convention on Cluster Munitions were ultimately negotiated outside the CCW.
Finally and very briefly, I will address proposed new subsection (2)(d) and how individual members of the Armed Forces might be held responsible. There is an interesting parallel here with the question on deploying autonomous vehicles—the issue of insurance and who will be held responsible if something goes wrong. Of course, the same issues of personal responsibility and how it is laid will face military personnel. This may sound like a distant thing, talking about decades, but I note that a report from Drone Wars UK notes that Protector, the new weaponised drone, is “autonomy enabled”. I think Drone Wars UK says it has been unable to establish what that means and what the Government intend to do with that autonomy-enabled capability, but the first of an initial batch of 16 Protectors is scheduled to arrive between 2021 and 2024, and the Protector is scheduled to enter service with the RAF in mid-2024.
So I think this is an urgent amendment, and I commend the noble Lord, Lord Browne, and the others on this, and I would hope to continue to work with them on the issue.