Surely ‘pushing your buttons’ produces a reaction that is predictable but may be for good or bad whereas something that ‘gets your goat’ is always annoying.