Moses Judah was the second of the nine children, and first-born son, of Esther Taylor and David Judah of Connecticut. The Judah family had ties to Norwalk dating back to 1760, when David’s father, Michael Judah, established his residence there. Moses Judah could also have claimed membership in the Sons of the American Revolution through his father: in 1776, David Judah joined the Continental Line for Connecticut, where he served in Captain Gregory’s Company. However, it seems that David Judah neither lived nor raised his children as Jews. His wife Esther was not Jewish, and when Moses Judah married in 1817, he chose a Christian wife, Hetty Sayres of Fairfield. Moses and Hetty did not have children.