That's annoying that it doesn't scale to the activity. I often play with certain item equipment equipped to attempt to level them up. It's kinda dumb I can't work on it without getting penalized. TBH I'm just salty that I've IMO gotten shafted so far with RNG. Either way you're facing RNG and that's the bitch of the whole thing.