Unfortunately, getting the Ghosts early keeps you from getting their respective cards. Cards trigger when the Ghost is picked up, and if you pick them up early, the card won't be added, and the Ghosts don't respawn after being collected.