An important and, to my mind, true quality of languages in general is the arbitrary nature of the relationship between a word and the concept underlying it
Agreed, for the vast majority of cases. Since many word roots can be traced very far back, this historical aspect often tends to veil the essential arbitrariness. Persistence of a tradition appears as connection to the "thing itself".