Noted philologist AnnaS notes "to" belongs to "used" and not to the infinitive that follows it.

Interesting point AnnaS. Of course we all know that not all infinitives contain to. Is this a case of to being the particle of a phrasal verb? That interpretation would certainly clear up any nagging doubts as to the validity of many a construction.