Why are letters referred to as “upper” and “lower” case?

Way back when, the letters were placed in cases in physical racks on the desk for typesetting. The capitals were in the upper rack and the others were in the lower one.

This usage entered the English language in 1588.

Letter case

Pictured is a Gutenberg Press.