Except they weren't harmless. The Worms even say that they had been luring countless races to fundament for a long time to free them. If the hive didn't find them, another race would have.