>By this reasoning this should be the 20th century we just entered and 1999 was the last year of the 19th.

ah, but the 1st 'century' *was 01 to 99, wasn't it; or, to put it another way, there was no 0th century!
(as opposed to the decade of the "naughties" ;-)