This is addressed in the marginal note attached to the sentence you quoted.

The essential point is that we're considering classification problems, for which the output is intended to be 0 or 1. I address the more general case of regression problems (where y may take any value) in a later exercise.

Hope that helps!