Infinite doesn't account for the past or time gone. Another way to say that is, infinite is forward. Infinite is not the everything of one thing, infinite doesn't account for the past in equations of time.
I would think it better described as the unknown end, or never ending progression. I do agree we cannot say infinite equals everything!