Who Was Fanny Alger? Historians debate many details, but the historical record suggests that she had a secret sexual—and possibly marital—relationship with Mormonism's founder. New research suggests that the relationship between Joseph and Fanny may have begun as a father-daughter adoptive sealing.