CNN's article shows that they fact checked the stories of the 4 women who they spoke to, corroborated by other witnesses, screen shots, etc.

One of the women provided CNN a message from Swalwell that he'd sent to her before doing an on air interview on CNN (!) and he was wearing the same clothes.