We employ x-ray scattering on sheared colloidal suspensions and mode coupling theory to study structure factor distortions of glass-forming systems under shear. We find a transition from quadrupolar elastic distortion at small strains to quadrupolar and hexadecupolar modes in the stationary state. The latter are interpreted as signatures of plastic rearrangements in homogeneous, thermalized systems. From their transient evolution with strain, we identify characteristic strain and length-scale values where these plastic rearrangements dominate. This characteristic strain coincides with the maximum of the shear stress versus strain curve, indicating the proliferation of plastic flow. The hexadecupolar modes dominate at the wavevector of the principal peak of the equilibrium structure factor that is related to the cage-effect in mode coupling theory. We hence identify the structural signature of plastic flow of glasses.