Way back when, the letters were placed in cases in physical racks on the desk for typesetting. The capitals were in the upper rack and the others were in the lower one.
This usage entered the English language in 1588.
Pictured is a Gutenberg Press.