Definitions of vertically:

• adverb:   in a vertical direction

  Example: "A gallery quite often is added to make use of space vertically as well as horizontally"