Read the Vault of Glass and Relic grimoire. Both hint at him being alone.
"Noone can open the vault alone. I opened the Vault. There was no one with me. But I was not alone.
English
-
It means he had a fireteam but he was the only survivor because they were erased from existance by the gorgons. Though he did go in alone the second time