Surely language must have been present in *some form when our first sapiens ancestors wandered off from Africa into Eurasia?

Yup. But I don't see anybody reconstructing a 45K plus old proto-language.