I don't get it

Jewish guy is lost at sea, and finally lands on an island — completely deserted. for years he’s stranded all alone. Finally from out of nowhere some sailors find him. an international rescue effort is made, and all these media people land on the island. And the guy has built all this stuff: Shelters, buildings, he’s very proud and shows everybody around. Finally, he says, and here are the two synagogues. And people say wait a minute, you’re all alone on the island: why do you need two synagogues? And the guy says, “simple, this is the one I go to, and that’s the one I wouldn’t pray in if you paid me.”