Boor originally just meant farmer. The negative connotations came from the lack of a city-dweller's manners. Poetically it could simply mean that your friend considers you to be an unstudied charmer, one who charms without the guile that might be expected of a more sophisticated person. Honestly charming rather than one who is being charming with an eye towards benefiting from the feelings invoked in the person charmed.