Actually he's not. There are multiple grimoire cards, where Hideo is out of the tower. For example: The Lighthouse grimoire card (ToO) is a fireteam of Hideo, and two other guardians, who were exploring, likely looking for Osiris.