I mean, hordes of clerks and ‘unskilled’ workers are still mostly necessary so that food and goods to feed, house and clothe the 20% are delivered properly. Otherwise it would be Ayn Rand’s utopia where geniuses make stuff all day while being supplied by magic.