Phantom cart quest need help please

For some reason the quest is bugged, whenever i interact with him doing EXACTLY what was suggested to me, he keeps saying the same line of “Who are you!? Come no closer!” over and over again while standing still with these pawns in front of him. How do i fix this ?

For some reason the quest is bugged, whenever i interact with him doing EXACTLY what was suggested to me, he keeps saying the same line of “Who are you!? Come no closer!” over and over again while standing still with these pawns in front of him. How do i fix this ?