Except they kind of were? The entire build up to Churchill's "Never Surrender Speech" was filled with party members threatening to leave so they could trigger a vote of no-confidence and enstate someone who -wanted- to back the peace deal.
They had been arming up since the end of WW1, albeit...