ssh: Improve key lookup for many keys.