That is not entirely correct. Look for example at Switzerland.

Sure, there are limits, you probably won’t have a train station at every farm 50 miles from everything else, but you also don’t need large cities to make it work at all.