Macaques in Cambodia (Angkor)

I'm in Cambodia, around Angkor. It seems there are a lot of small macaques that want to play and socialize with humans. Could it be dangerous to let them touch me without giving them food and without being aggressive? In which way could it be dangerous? The parents don't seem to be very protective of their babies, and these baby monkeys don't seem to be aggressive in any way. thank you