I think the bigger concern isn't someone cracking keys in real time but the harvest now, decrypt later angle. Collecting transactions today and breaking them when the hardware is ready. Reused addresses and dormant coins are the most exposed.