What did he want from me?

I think he sounds like a very cruel person. You need to make a clean break from him-no more contact of any kind, and if he contacts you again, just tell him you haven't the time yourself for anyone who clearly dislikes you so much.