Christian advice needed...?

I am friend with an unsaved man..I am 28 and he is 38. I am a Christian but never had an intimate relationship before. We hang out sometimes and though I don't think it's godly to hold hands, I found out that on several occasions we held hands. I have decided to stop hanging out and to keep communication limited to the phone, but I miss hanging out with him. What really gets me concern is that on several occasions he brings up scenarios about me getting pregnant for him and how I would handle it, or me having a baby out of wedlock. That is not the plan God has for my life, so I know it's the plans of the devil. I wish we could hang out and have fun without those threats. I am trying to think of all the reasons I don't need to hang out with him in order to feel better and to stop missing him. What are your suggestions for me?