San Diego County has seen its share of young residents, particularly children under the age of 5, declining over the past two decades, according to U.S. Census data.