They didn't want to team up with him because they didn't believe him.
Now he says he's not involved in the fight for the treasure, and if he doesn't leave, of course they won't believe it.
Hearing these people's words, the man's face naturally turned cold, glared...