An excellent point, ultimately it is a question of Platonic idealism, and a matter of philosophy if you would like to argue that we are all in a simulation right now. I would prefer to side with the Aristotelian argument that even if the reality we experience is not the true reality, it prompts only one of two response: 1) we can never know the truth so we should stop trying to find it, or 2) we can make the best of what we have in work within our narrow view of the universe to try to improve the lives we do experience. For now, my faith is in science, not philosophy, I find empty speculation without experimentation to have no useful ends, besides being a nifty thought experiment. Either way, I'm looking forward to the fusion of man and machine into a singular conscience entity that takes control of it's own evolution, and lives in almost perfect equilibrium with it's environment. I'm not sure why anyone wouldn't want to live long enough to do everything the want to do, or explore the universe. Then again, that all presumes that the human conscience is capable of "living" forever in an immortal computer frame. Perhaps our minds like our bodies only have so much time to function, but time will tell.
xkcd: Trapped
"I'm sorry, but we can't send a search and rescue into Plato's cave"