I wonder why we're treating self-driving vehicle safety so much more strictly than AI safety? Maybe because we've got long experience with people-driven vehicles? Maybe because the failure cases are mangles bodies and vehicles? In general, we've been extremely lax about software safely, between hackers and malware and selling defective products.