Technically, yes. He didn’t realize it was Voldemort at the time, and presumably Quirrell was doing most of the talking, but Voldemort would have been there in the pub.