Context is everything. As others noted. Aldrin was not asked if he really went to the moon. He was ask why we didn't continue to go to the moon. And he replied, basically we didn't (continue) and "we need to know why something stopped in the past that we wanted to keep (it, sic) going." We could neither stop nor continue something that was already accomplished. So, in context, it didn't happen that we continued to ho to the moon, which is a convulated way of saying "we stopped going back."