Well, he did buy the house (article says) not built it, so the sight of the house probably was there already for years if not for decades. They most probably didn't like that the house was bought by outsider.