There are a couple things we keep all our lives, like the visual cortex, but almost everything else wears out and gets replaced, at least for part of our lives.