The problem with memory is that it is not an exact recording of an event like people think it is. Memories can, and often do, change over time. Also what one person experiences and attributes to the paranormal maybe just be something that they are not familiar with or something they misidentified, etc.
And to add, there is no reason for belief in "spirit" outside of religion. It's not testable, observable, or even quantifiable.