How do you handle this??

I love my boyfriend, we've been together for over 7 yrs. We have broken up periodically, (very small break-ups) Anyhow, about 6 months ago I was done...the break up lasted from the end of Apr. up until I lost my job, end of May and he tells me to let him move back in so that he can prove to me he has changed and can "hold my head over water" as I did for him for about 4 yrs. (I was the sole financial provider), I felt resigned to let him move back in...our children(2) were ecstatic, he was happy, for a bit of time I started thinking that we SHOULD stay together, but now the feelings are gone and I find myself fantasizing of how it was with just me and the kids...and I horrible for this or was it just a bad move to let him move in and should I tell him how I feel???? Or just wait I am so LOST!!