Can Peter come when you're awake?

I've heard that he can only come when you're asleep but I've also heard that he's visited people when they're awake at night. So I was just wondering if you're supposed to be asleep when he comes или not.