My sense of the word "portly" is that it comments on body size without being negatively critical. I think it arose at a time when a certain amount of extra weight was a sign of prosperity and thus a good thing, not a politically-incorrect bad thing, like it is today.