Not to dispute what you're saying, but the bumpers on the Wilderness are slightly shorter, ever so slightly improving approach and departure angles. Not saying its ALL the difference, but with the additional ride height, it helps. I have a friend with an Onyx XT who banged that little aluminum skid plate on everything we went over, so there is definitely some difference.
I mean ABSOLUTELY to each their own. If you don't want to buy or drive your Subaru off-road, don't. I do, and I find it super capable. I've ordered the LP brush guard, I'm in contact with the fellas on the rear locker, and I'll likely put either Methods or LP Wheels on the 23, with 255s. Otherwise, I'll leave it alone. My cruiser has well over three times its purchase price in mods and is supremely capable for it. But it gets 14 mpg on a good day, weighs 7000lbs plus, and can get a bit unwieldy. That being said, I've got a fridge, bike slides, etc. in it, and it's a major part (maybe still THE major part) of my Overlanding plans. I just really like having a very capable vehicle that I can drive into town after a day on the trails for a nice dinner, or to pick up supplies, etc. I foresee using it for bigger trips next year as a "chase" vehicle. We'll drive the cruiser out and set up base camp. The wife can drive the Subbie, and it's available to take for supply runs, dinner, etc.
For smaller trips, fly fishing with my son and daughters, small bike trips, gravel races, and such, the smaller, lighter, and easier to maneuver in town vehicle makes more sense. We can cruise around Denver before or after a trip without looking like we just arrived from the Serengeti and attracting all the attention from folks (good and bad) that comes with that. Knowing I can still get us WAY into the backcountry in it seals the deal for me.