Although take umbrage at is more common, take umbrage with is not unknown in American English. It's practically unheard of in British English.