Typical, the paint that is exposed ages faster compared to the non-exposed paint behind the molding, so after removal they do not match.
It is normal debadging ghosting, which is when the moldings still exert there presence fter removal since they are mad you took them off. Haha ghosting is really when from sone reason the part debadges still kind of looks like its there due to the reason above.
To get it to match, get some ICE liquid clay bar and clay down that whole door as long as you can, also try some glaze and polish on the door when you are done.