What we don't see is the myriad indignities that were imposed on worlds. Trade sanctions, heavy taxation, oppressive regimes, etc. It was a thousand small irritants that finally tipped the Rebellion over the brink.