After consuming caffeine, adenosine continues to build up in our system, which can lead to increased levels of fatigue once the caffeine wears off. Caffeine can also trick our brain into thinking we have not been awake for as long as we actually have.