The Wookie enslavement will do it. He fought alongside them. They were his battle buddies for a time. Seeing them being treated as slaves. When he himself use to be one will eat away at him.
This could lead to him turning on the Empire some time before Episode 4. As time passes and he sees just how draconian the Empire really is he will regret being a part of it. Leading him to eventually switching sides.
