But there is a third pronunciation used in English-speaking countries, which is to pronounce Latin using the same rules as you would use for English.

Maybe it's a matter of personal taste, but it's never bothered me to hear regis or Ursa Major given the English pronunciation. My Latin is pretty shaky, but if we remained purists, wouldn't we have to say Kaiser for Caesar?