I think some of the problem is that the generator has to suck fuel from the RV fuel tank. My generator is just behind the driver door, and the fuel tank is behind the rear axle... quite a distance for a little primer pump to suck fuel from.
After sitting for even a few hours, I'm guessing the fuel in the line has drained back to the tank.
If it starts within 30 seconds, and seems to run okay, I wouldn't be concerned. I'd prefer to prime longer than hammer the starter, but that's just me.
Now - if it's surging, running rough, etc. that's a problem. But if all maintenance, oil, filter changes, etc. are kept current... I'm not losing sleep... just the other people trying to sleep listening to my generator at 1:00 a.m.