The congregation formed on the East Side of St. Paul (near Payne Avenue) in the 1890s, meeting at the homes of Meyer and Jennie Silberstein and Elias and Libby Caminsky. The Sons of Abraham congregation was organized in 1903 when it purchased the large, Moorish-Style, Mount Zion synagogue at East 10th and Minnesota. The congregation incorporating on September 12, 1910, as an Orthodox congregation. In the early 1920s, the congregation organized another school in the Hill District at 655 Holly Avenue, purchasing the old Summit School for the purpose. The 10th and Minnesota site was closed during the Great Depression.
The women of this congregation, organized as the Daughters of Abraham, founded a home for the chronically ill, Shalom Residence, in 1947, at 45 South Albans.
In 1954, the Sons of Moses, Adath Yeshuran, and the Sons of Abraham congregations merged and purchased the former Mount Zion Temple at 798 Holly Avenue, The merged congregation took the name Congregation Gedaliah. The congregation dissolved in the early 1970s as members were moving out of the neighborhood.