First off I wan to say It is wonderful of you to ask for help an not wanting to devastate the little one . Try a few more visits at his home ,then do a small time frame of visits before doing all day.Try to spend as much time as you can with him in comfortable environment.