no connection to verb "ficher"?
No, because the pp of ficher is fiché. The infinitive of fichu is fichtre which was also used as a swear word, in Corneille's days, if I am right