"People who knock on my front door really need to give up these unrealistic expectations that I'm going to answer"