Well, I think you should just tell him you're tired of fighting to engage him in conversation, and he can contact you next time. If he's interested in your friendship, he will. If he's not, you've got other friends.