I have a Baja rack on mine but I havent driven it enough to see any real difference. I'll be criss-crossing the state in the next month or so, but then of course, it will be loaded down with crap.
I usually remove mine when I'm not using it, though. That, and it won't fit in the garage with it...