Actually, lets look at that term. Sci-fi. It stands for Science Fiction so stories in this genre are grounded both in Science and Fiction. That means that while there can be fantasy elements, the world still has to be grounded in science. Therefore, having facts and ideals from the real universe inside of a science-fiction world actually help to make that world more believable and more successful as a concept. So, yeah. It does kinda matter.