For UK usage of brownie points as a belittling term, see 
http://news.bbc.co.uk/hi/english/uk_politics/newsid_765000/765184.stm
yeahbut®
They were using this as an ironic pun on the politician's name, not, I think, as a derogatory usage.
The way I would define typical UK usage of this term is neutral in itself, but sometimes with an ironic context.  In a similar fashion with another neutral term I might say:
"Margaret is very pretty" (neutral descriptive phrase)
or:
"Margaret is very pretty....!" (subtext: "but she's a complete airhead!"
The context will convey your attitude as to whether the brownie points in question are admirable or pathetically egregious.