wiktionary
ref
From there + by. Compare the parallel formation of German dabei.
etymonline
ref
thereby (adv.)
Old English þærbig "thus, by means of or because of that;" see there + by. Similar formation in Old Frisian therbi, Middle Low German darbi, German dabei, Dutch daarbij.
