Elon Musk’s fortune plunges by more than $20 billion since his controversial SNL appearance