I believe after using the steering wheel control to get the system announce, say list users. Write em down or record then. End the call.
Hit SW control to announce again. Say delete user and it should ask for user name. You’ll have to remove them one by one. It’s a little creepy because it announces the previous users in their own voice.