Can children (ages 12, 9 and 5) choose to give sole custody to their father based on their ages?

The father of my children and I have been separated for 2 years and have been doing joint custody. Lately he’s been acting out because I didn’t agree to visitation at his residence where he stays with his mistress; I only accepted visitation at his family members’ homes or if he is staying alone. For the sake of my kids, who are 8, 6 and 3 respectively, can the children (or their ages) determine or give sole custody to their father?