Blizz should allow you to swap the gems tbh - it's insane that I now have to go through all my armour (AGAIN!) to sort the slot bonuses out.
