For the ones that have not been set yet, a bit of Gorilla Glue, Sika, JB Weld or your choice of adhesive on the frame, will help keep the insert from spinning.
Obviously you do not want to get this in/on the threads, so applying it 'around' the hole, prior to placing the Rivnut, is ideal.
The...