Hi
I don’t think your child would be taken off you just because you have concerns about your child’s care when they’re with their father and those concerns turn out to be unfounded. In my experience, they would only remove a child from either parent’s care if they had serious concerns about that parent.
Make sure that any concerns you raise with social services have a good basis for them e.g. If you’re going to say that you’re worried that they aren’t getting a bath while they’re there, it needs to be because they are regularly coming back after a few days filthy with unwashed hair – not just that they were there for one night and didn’t have a bath, that could just be different standards of cleanliness / different parenting styles. Does that make sense?