gpg: Avoid endless loop if a card's serial number can't be read.