The wood panels appear to be adhered into the grips. Removal is not recommended.
I have purchased 5 sets the early version where you have to remove the panels in order to access the hold down screw. Given that, you simply take exacto knife with #11 blade, get behind it and gentley pop it up. These are high quality with close tolerances.