Do you have any thoughts about the RX100 M3 vs GM5? I've got the former, and wish I had interchangeable lenses (mostly for higher optical range), so the GM5 offering is intriguing.
I loved the The RX100 M3 I had before the GM5, I wouldn't have upgraded if it hadn't slipped out of my pocket and broken. The 3,4,5 versions are all great depending on which you can afford.
But I know what you say about wanting to change lenses. When there's some wildlife in the distance you just don't have the zoom capability to really get a good picture. You're limited to wide angle shots that work well from a scenic overlook, but you can't zoom in on any detail.
Plus the last two smalish cameras I had were ruined by things that could have been fixed on an interchangeable lens camera. The RX100m3 the lens assembly was damaged but the rest was still good, I could have just swapped out a new lens and kept the body. The camera before that got too much dust on the sensor and you have to completely dismantle these cameras to get access and clean it. On an interchangeable lens camera it's as easy as taking of the lens and blowing it out.
The GM5 fixes all those issues but it's just not quite a pocket camera anymore. To take it to a concert in my jeans pocket I have to split the lens and body and carry them separately. There is a loss in convenience but on the other hand I feel like it was a major increase in capabilities being able to swap out a tiny zoom lens onto the camera.