That's exactly right. That's why I get tired of folks pulling the odds of life out of the air when they conveniently result a few dozen to a few hundred planets in the Milky Way with life on them.
We don't know, people! The odds could be good or they could be astronomically poor. There might be life in half the solar systems. There might not be life anywhere else in the Milky Way. From what little we know about life at this point these two possibilities are equally plausible.