Fabric softener coats the fibres and reduces how much they can absorb, so a pair will not perform as well. Washing without it keeps the layers working properly.