If you pay attention to the game, you'll see the Empire is winning despite Tullius not even having a fully mobilized Legion. He's been using local conscripts and he almost won the Civil War at the very start of the game.
Stormcloaks don't stand a chance without a literal demigod like the LDB helping them.