I have a PS4 meaning there was more players on at once. The only time I ever lagged was in the mornings when the flood of people came in. After that it has been smooth sailing and I never lagged or got kicked. Maybe a couple times but not enough to say it happens often. Again, call your internet service provider or try calling MS or even 3Arch. I have had no problems on my end so it must be you.