ref
Compound of down + side.
downside (n.)
also down side, 1680s, "underside;" see down (adv.) + side (n.). Meaning "drawback, negative aspect" is attested by 1995.