I hated that so much. Took me a while before I figured out you could just press Y then back out real quick, and it would be fine. I used to think you had to hover over all the perks to make the + signs go a way.