Thanks for the help guys, I finally got the gel inserts.
First, they were tough to find, everyone said "yeah, we have them.... oh, we are out of stock." D'oh. Finally I found them at my Verizon store for about $3, nice!
You do have to wiggle them on, but that just means that they
stay on.
I tried taking the hanger off, the ear piece stays in "ok", but it feels like its going to fall off, so I put the hanger back on. With the gels on securely its much easier to put the unit on with the hanger.
My inserts don't look at all like the photo that kjo posted. The gels that I got look just like the supplied plastic ones, except they are gel and they stay on.