Allegations have swirled around Willie Brigitte ever since his discreet deportation from Australia and his much-publicised arrest in France in October 2003.