Am I too stupid, or is the game really difficult?

This scenario is completely beatable even in the crazyness difficulty, maybe you are ‘‘stupid’’.
It would be a battle of attriction so if I were you, don’t use gold units against the priests Red have. One day they will resign.

You can convert yellow villager and build a base near them but a second conversion will trigger his villagers to kill your priest anyway.