Sounds like a personal issue. I've seen plenty of noobs with 2300-2400 Grimoire who just got ghosts, so if someone has over 2500 I know they've done more than just farm ghosts. Believe it or not, ghosts are not the magical thing that gives you a good grim score.