I hear you, man. That's what happened to me too. I started strategically quitting the game if there were a bunch of good people. Stuck mainly with Control since I could at least kind of anticipate where they would be. Took quite awhile. I still haven't beat Xyor. :/