well, I think there are some people who would feel that way, but no one can tell you what's right for you and your family either.
If you adopt an infant, it's really not your decision though...meaning most of the time, an expectant parent picks the adoptive parents. If there's something about you personally they like more than all the other waiting parents, then that's their decision. kwim? So it's not something you have all that much control over anyway.
I'm not on that side of waiting parents so can't really say, but that's my take anyway!
