Pretty much people will stop noticing and calling it out when you're no longer using the vanguard level 31 armor. They can still look at your profile to see how long you've been playing but those people are just trolls.