Can a parent request visits with only one child?

My ex-husband has refused to learn to deal with our children's disabilities, and got into a big blowup with our 11yo daughter last weekend. She has Asperger's and can be difficult at times, so he went on for hours about how he's no longer her parent and she blew it by pushing his buttons and he wants nothing more to do with the kids. He now claims he was hypoglycemic so we should forgive him and it's all good. He doesn't want to force our daughter into visits, especially since she's determined to torment him, so he wants visits with our autistic and epileptic son, who is too scared to push his buttons. Do you think he is likely to get visits with just one child? My daughter cares for our son during the visits, keeping him from running off and watching his over his meds, so I'm a bit worried about sending him over there alone. He's attempted suicide over visits to his dad in the past but the courts view his hospitalizations as evidence of manipulation on my part. In the last couple months things have gone downhill, with lots of canceled visits, a weekend he didn't feed them and told them to eat dirt, another weekend he wouldn't do anything, including feed them, until our daughter screamed at him as a way to teach her to be assertive, etc, etc. I can't prove anything and know there's no point in bringing it up, but will asking for just one kid reflect badly on him, or look like sensitivity to our daughter's needs?