Why is space travel always 'horizontal'?

When NASA or ESA or the bolsheviks go into space they always go horizontally across our solar system. Why don't they go 'up' or 'down', surely exploration involves venturing to areas that have been untouched?