Be honest with her and let her know how you feel.
If he is a registered sex offender then there should be laws in place to keep him away from the children. You can always request supervised visitation when the father is there.
You are doing the right thing protecting your family.
