It's the latter. I've been playing since the beta. I've run into players with just as much grimoire as myself (maxed out which can only be obtained if you've done literally everything) yet they still can't do something like... swap sides on confluxes or run relic on Oryx.