For aluminum to be strong it requires numerous points of welding, with steel the span is much greater normally. On a trailer that is only 8 foot long with tongue it becomes a very rigid platform due to cross members and the like. With steel tubing you can spread those cross members out allowing it to roll and flex as it traverses obstacles. The aluminum built trailers are more massive in the amounts of cross members bracing than a steel trailer normally, or at least the ones that I have seen, Featherlite in Oklahoma for example. I would assume scientifically you are correct, but actual use in a like sport has proven the opposite. Frame life time on off road motorcycles at the top level is normally 4 to 5 races, due to frame fatigue, mountain bike manufacturers normally do not have more than a year warranty on the frames some as little as 60 days. There are reasons for that. I am sure you can overbuild the frame to last, but by then the weight and the cost are of conern.
Now as you have stated it might be due to the number of flexing motions on these products.
I have seen many motorcycle frames break and mountian bikes. And honestly most have had the heck ridden out of them. In the bicycle industry in the past mild steel was a favorite due to price and ride, titainium has surpassed the mild steel, and carbon fiber is taking over on road bikes, mountian still uses aluminum due to the weight, titainium offers the best ride due to its ability to asbord impact for some reason, or at least that is the feelin get while riding one.
I just do not feel that a aluminum framed trailer on our level would survive if used regurlarly. I think the upper walls can, but there is a possibility that they won't, that is the reason I am physically testing them.