Check this out: How to Take Apart Splices - Gear*Talk - Forums - Skiing's Online Community - Newschoolers.com
Scroll down about half way and it shows an example.
The piece was too hard to push out from the back with a bare finger, so if you take a flat screw driver and pry it out the front at the same time, it comes out relatively easily. Just try not to scratch the lens! Remove the lens first if you want to be sure.