It all depends on what you want to do on your trip. Sometimes the very young ones are easier to camp with than kids that are slightly older. When my son was one, we took him camping in Joshua Tree National Park. We went on all kinds of hikes with him on my back. Once they are able to get around on their own and too heavy to carry on your back all day, then you have to adapt your activities to their abilities, interests and attention span.
I have found that very young children love camping! I have camped with two year olds and they really enjoyed the whole campsite experience: setting up the tent, building the fire, roasting marshmallows etc. You just have to be very vigilant in a new environment with them since they are no longer confined by the walls of your home!
As usual with small children, be realistic about how much time you want to spend and how much you want to cover.