Only 2 problems with that are that even if his sword is gone, it doesn't mean he can come kill us all. Secondly, the sword disappears from our guardians hands, so he could have summoned it or something.