I'm always the one who is late, I'll try and listen to what's said to me next time. The only one who would be later than I would be my son, to him I'd say "Why are you so late (in getting here) ?" (That final arrival part is throwing me.)