I was going to suggest filing it but looks like you got it figured out.I guess it's hard to tell by the pic, but the area in the circle looked rough and not uniform so I thought a piece had chipped off in that gap area. It's been awhile since mine was removed so I forgot exactly what it looked like.
View attachment 459342