At the intersection where Upper Main Street and Center St. merge, an uphill climb ahead past the Livery before descending into the harbor