Warlocks are the very formal, unscathed city folk that practice wielding the travelers light in safety. Hunters are the ragged, experience hardened survivors of the wild that learned how to fight by being hunted down until they themselves can rise as the predators. Hunters probably think that Warlocks take their safety for granted and have never really struggled for survival. That may be why they have a slight prejudice.