ref
From bay + berry.
bayberry (n.)
"fruit of the bay tree," 1570s, from bay (n.4) + berry. In Jamaica, the name given to a type of myrtle (Pimenta acris), 1680s, from which bay-rum (1832) is made.