Thinking out loud here...
Seems to me that our friends in the UK have a taste for quince jelly. Could it be possible then, that to get on one's quince might refer to the annoyance of finding some kind of detritus or insect alighted on their morning toast?
That would certainly get on my quince... especially if I was late for work.