I think the problem is that half the time when they do go with kids playing kids, people start criticizing them. (imo often without reason)

It's rare to find a series with young actors where reviewers won't start talking about how bad the younger actors are compared to the older ones.