Sounds like the unit was in regeneration when you put it in bypass. Likely you bypassed it when it was still either drawing salt or was in the “slow rinse” process. With the unit on line, open a soft cold water tap until the salty taste is gone. If it happens again without your bypassing it then some has failed. Could be a number of things.