The speaker is contemplating whether to leave a hacker logged into a system to avoid missing out on information they need to catch the hacker, or to revoke their access immediately and eliminate the risk of further harm.