“He gave them to me and now he’s taken them away, if it had to happen, there is no better person than that,” the grieving father said of his estranged father-in-law