Are you saying that because there are still more complicated potential attacks hardware tokens offer zero benefits?

Anyway, what about the sshd server having this config line:

    sshd_config MaxSessions 1

could that help?