Why shouldn't he follow you into the crystal room? That's what RL would be like, you don't just have an enemy standing there looking at you from halfway across the map. Unless he teleported, which is of course a bug.