I wouldn't use rubber it degrades to fast probably not so bad for gold coins but they also have a copper component. There are inlays of some kind of foam polymere like THIS just as a ring.
I had some luck adapting an old US quarter album (with slides) by adding a zip tie - cut off the head, trim to length and insert. The zip tie (many widths and sizes available) is springy enough to push out ward against the interior of the album slot effectively making the opening smaller. Maybe a similar strategy will work for your holder.