Crashing the USD would be its demise as the global reserve currency, which would evaporate all that speculative value overnight.

Sure, the oligarchs would still have their mansions, bunkers, and bullet-proof SUVs, but their primary source of leverage and influence would be gone. They would become irrelevant.