I'd suggest getting used to it, even better embrace the attention, because its not going to go away any time soon. The problem stems from the fact that you've made a reality of what happens to be many people's fantasy. They see your rig and wonder "Wow, how'd he do it? Is it comfortable? Maybe if I save up I can make one too? Wonder where that rig has been? Where is he headed? Who has he met along the way?"
On a trip back in 2006 my 4Runner was parked in a lot getting some groceries to stock up the fridge before heading up to the next camp and paragliding site in Oregon. When I came out there were two full minivans of family clustered around my truck. They huddled around my rig for a good while and I just stood off in the distance and let them wonder for a bit because it was actually interesting to see what they were up to. During that time no one even touched my truck, but a number of photos were taken.
When I finally came back to my truck a woman in the group actually had a short list of questions to ask me. After this I started making business sized cards with answers to some of the more routine questions. And when I go out on tour (bike or vehicle) I like to carry a small box of these which explain what I'm up to and invite curious people to follow my journey. Have some fun with it!