"I mean I have 60 years of memories in that house and three children... now [the loss is] hitting me," the elderly man shared ...