The killers want him dead so they can buy the house. They wouldn't want to do too much damage. They don't have access to inside, not without making things obvious. The garden is fair game. And he does leave the house to go shopping etc. Gaslighting him is possibility - send him to loony bin, home for the senile etc.