I'm very biased towards old vehicles. I actually was going to PM you so as to not fully hijack this thread (which we've all kinda done anyway, my apologies for my role in that). I have a 2004 GX470 that I looked for, and my offroad rig is a 1999 Amigo filled with offroad and overland shenanigans.
You need to establish what matters to you the most. There are some Subies I would seek out, and for very specific reasons. I also prefer a manual, and as long as I can I will have something I have to manually shift. At 48 years old...I hope that's a very long time indeed.
So, "what matters to you" includes how much you want to have to spend to upgrade, how many choices do you want to have available to you when you upgrade, what mileage do you want, and how much space, and so on. With my Amigo, I wanted a stick and the V-6, which are working well. If and when the engine dies, I will upgrade to a Lexus V-8.
There are absolutely trustworthy Subie models of olden days you could use as a platform. I can't say as I've seen a lot of built-up older RAVs but I have seen enough built-up older 1st and 2nd-gen CRVs to know it can be done. If you wanted body-on-frame, you have choices...but most of them older.
If you want new, and with a warranty, that's where it gets funky. A very good friend of mine who works for a new Subie dealership is very interested to see their new off-road trim. No one (NOOOOOO ONNNNNNNNNE) trusts the Subie CVT. Just like what owners seem to know, if you don't mind going slow, it's fine. Anything technical, it grenades. You will again and again see a comment like "if Subie made a 'regular' automatic again, or even a stick, I'd buy one right now." I would also add that I had head gasket problems in one even after that problem had been solved.
If you want new, with a warranty, you really have to decide how much you need. The Ford Maverick, about to be introduced next week, is one lots of people are watching. What will its (supposed) off road equipment include? The rear diff from the Bronco sport overheats, so that's "a thing" that happens. With the (larger) Bronco coming out, they clearly have been listening to what people want, at least a little. Would they allow for a better diff to cater to the few that need it? If you had one of those Honda Elements, you could bolt in a CRV diff in the rear to make yours less likely to fail. Will someone develop a DIY hack for their Bronco Sport as they start to come out of warranty? Time will tell.
How old ya wanna go?