I have both a FJ-60 for 20 years and a FJ-40 for 13 years . Both great vehicles and driving them is a labor of love, especially the FJ-40.
This is not to say I don't drive them . My wife and I finished a summer trip in the FJ-60 to Alaska that covered 13,000 miles and three months with two trip to the Arctic Ocean . I've taken 500 mile trips in the FJ-40 ,topless.
My feeling is if you don't have the disposable income to get a vehicle repaired or maintenance done right away then you are going to have a driveway queen that always be second to your financial priorities. Then you have a vehicle you can't even enjoy.
Also with a child , the safety features of a FJ-40 are nonexistent .