The AI control gap: Who gets to say ‘It’s safe’?

We see a control gap between what artificial intelligence can do and what the evidence supports trusting it to do. A great demo doesn’t prove that a system will stay within the limits of an intended deployment’s goals. The question is: Who gets to decide when the evidence is sufficient to declare AI is safe?