Go to any big parking lot and tell me how many 2 door cars you see.
There aren't going to be many and there's a reason for that.
The Baja was a victim of poor timing and weak commitment on the part of Subaru. It was brought out when fuel prices were dropping and nobody really had a reason to choose a Subaru over a bigger (and thirstier) truck. If they had waited about 3 years to introduce the Baja (when fuel prices started to shoot up around 2008) I think it would have been a success but it was one of those things where Subaru wasn't really committed to the platform and as soon as it failed to catch on they dropped it like a hot potato.
I also think the Baja was too small and underpowered to pull a trailer and that removed another potential segment of the market - compare with the Ridgeline, one of the favorite tow vehicles for small trailers.