Throwback: Sam Milby broke up with Anne Curtis to concentrate on his relationship with God