[ ...okay that just gets him to stare blankly at Brady for a moment, before he shakes it off. ]

Multiple timelines exist. Rather than jumping back in the timeline I was born in, I believe I was sent to a different one. So my memory wouldn't be affected and I can't cause a paradox that poofs me out of existence.