Curvy,
I'd be quite offended, especially since he KEEPS bringing it up.
What could he be thinking?
Perhaps if he says it again, you could ask, kindly but firmly, "Why do you keep saying that? Have you adopted a child? Because if not, how could you possibly know what it involves emotionally?"
It would be interesting to see what his response is to that.