if you can tolerate the heat of the summer, i'd recommend may or june. by then the Valley has much more rainfall and the river is a bit deeper. of course, let the river get to deep and you may as well bring some inner tubes and just float it with a few beers.
the river is certainly navigable even at its lowest stages, but then it becomes class IV and V and even class VI in certain parts of the Upper Gorge.