If a guy falls off a roof building a nuclear plant, it doesn't poison the land for hundreds of years either. A more fair comparison would be if a PV manufacturing plant had an industrial accident and hundreds of thousands of gallons of nasty chemicals o to the land.
Yes I suppose it would. But if I had to choose (and I really hope I never do) I'd rather have silicon tetrachloride spilled in my town than nuclear waste.