This is exactly how we felt. We adopted from Guatemala and while I thought my son was an awesome baby (happy, easygoing, etc.) we didn't fall in love immediately.
It took a couple of weeks for me to feel like he belonged to me and that someone wasn't going to come to the door and say: "okay, thanks for babysitting, we'll take him now."
These days, someone couldn't pry him away from us with a crowbar.
Give yourself time to bond with the baby and feel like parents. Everything in your life has just been upheaved and it takes time to adjust.
Kelley