The addition of automation and AI to weapons systems presents the possibility for unexpected bugs that could cause devastating destruction, including the launch of nuclear weapons, without requiring much intelligence. This development is alarming and calls for careful consideration of the ethical implications of autonomous weapons.