The existential risk of AI isn’t bad actors, it’s our own arrogance.
Assuming that intent matters depends on being able to first predict the outcome.
We still can’t even say how or why existing AI do what they do, we definitely can’t predict the outcome of new changes.