Matt Rife has had a rough few weeks, with celebs and exes alike coming out of the woodwork with negative reactions to his jokes and behavior.