Born in Charleston, Jacob Clavias Levy was the son of Polish emigrant Moses Clava Levy. In 1817 he traveled to Europe with his friend Joshua Lazarus, and while in Liverpool both men fell in love with same young woman—Fanny Yates, a great beauty from one of that English city’s most prominent Jewish families. Joshua, rather than compete with his friend for her affections, backed away, and Jacob and Fanny were married.

They sailed back to Charleston soon after the wedding. They were very active in Jewish life there, and Jacob wrote a book on Reform Judaism. The couple had seven children. Levy was known for his outspoken secessionist views, and was regarded by many as a prominent Southern patriot.