This is easy- I had it too- UNTIL I stopped using it. Liquid Fabric softener.
Now I only use dryer sheets in the dryer- and vinegar in the wash.
That is a nasty problem and I have lost a lot a nice clothing to it. Seems like they would just quit putting that blue oily color and chemicals in the liquid fabric