I always tell my students that if your friends, relatives or siblings remember an incident differently that you do, well, tell them that you are fascinated they remember the event in a different way. If they want to, they can write their own memoir. Have them sign up for one of my classes...
We remember incidents in our lives from our own point of view (POV). We don't remember anything in complete detail. I am going to say that again, in case you missed it: we don't remember anything in detail. What we do remember is the way an incident, experience, conflict, good luck etc. affected us.
So don't worry as you remember pivotal moments in your life. If someone tells you "that's not the way I remember it" just smile and keep writing YOUR memoir. It is your life, not theirs, and what matters is what is important to you.