They seem to have originated with respect to New York City, where the older business district--the historical core of the city--is at the southern tip of Manhattan island. On a map, that southern area was down (thus "downtown") and areas north of it were up (thus "uptown"). The usage of downtown as the historical core of a given city has been generalized to other cities, even those like Indianapolis which are growing outward from a central core. (Wikipedia)