...they'll think you're Irish?

Nah, you don't have to go any further than Northamptonshire (where I live) to hear it pronounced like that. Funnily enough, the Derbyshire accent is pretty flat, as easy to understand as RP.