The traveler didn't leave you. You left it. You became obsessed with the vault and beating it. You sacrificed everything including the memories of your fire team for your obsession.
English
-
not entirely true. I did not intentionally sacrifice my memories, and I was just trying to come up with a reason. maybe he discovered the traveler is evil, yet no one believes him still.