Not really. My home network doesn’t have any port forwarding so nothing is exposed. I have a VPS, but nothing really important is on there, and I pretty much exclusively use it from home. Anyway all those failed logins were just trying defaults like user admin password admin. If you have a strong password or ssh key it really doesn’t matter, but I just hated knowing people were trying to get in, even if it was just half-assed attempts to find a unsecured machine.

If I really needed to use IP4 to get in, I could always just log onto Vultr’s web console and enable IP4 again.

If you can disable IPv4 on sshd then it really isn’t an issue. I know, security through obscurity isn’t robust, but when I had sshd with IPv4 enabled, I was getting around 6 - 10 failed login attempts a minute. People iterate through all the IPv4 addresses since there are only 4,294,967,296 possible addresses. There are 340,282,366,920,938,463,463,374,607,431,768,211,456 possible IPv6 addresses, so the chance of someone randomly stumbling upon your address is fucking astronomically tiny. When I disabled IPv4 a couple years ago I’ve had exactly zero failed logins that weren’t me being a sloppy typist.