agent: Clean up pinentry access locking.