Hi. I see this is an older post, so apologies if you've sorted it already. Catching up with a few things on this forum.
Yes, remove the old one with pliers or a sharpened nail to pierce the leather and flip it out. The polymer seals will fit just as well, but you may need to sand down the back evenly, as sometimes they can be a little on the thick side.
If ever you get a leather/brass seal again, don't attempt to fit it without the correct tool (available from the likes of John Knibbs), nor before soaking it in something like Neatsfoot oil or Abbey SM50 for a few hours.