How much harder? He stays motionless after teleporting. And he's just going to a preset area. When he fails to teleport, the game already spawns several minotaurs in the center of the room. Add an additional group: 2 supplicants at the pillar. This would make the pillar a big gamble, with a sudden dodge and intense coordination being necessary to avoid a very quick party wipe.