I'd swap them out if you enjoys music that much. The factory speakers are sufficient for me but i think you'd want something more...especially since you already have all the stuff in your current truck. Just my .02.
If you're happy with your current set up in the F150, keep it. Chances are the factory doesn't sound as good as your kit. If you part with your current sound system and you find the TE lacking, you'll have to spend money on sound instead of lift, tires, bumpers, winch, sliders, fridge, skids, snorkel, rtt, awning, aux gas tank, dual battery system, drawers, maxtrax, roof rack, etc.