The title is misleading. The website mentions all these -
We discuss the limitations and implications of this work in detail in the paper, however, it is important to re-state here that these findings:
1) Cannot be directly used to infer safety as a much larger dataset would be required for crash-based statistical analysis of risk,
2) May not be generalizable to a population of drivers nor Autopilot versions outside our dataset,
3) Do not include challenging scenarios that did not lead to Autopilot disengagement,
4) Are based on human-annotation of critical signals,
5) Do not imply that driver attention management systems are not potentially highly beneficial additions to the functional vigilance framework for the purpose of encouraging the driver to remain appropriately attentive to the road.
We discuss the limitations and implications of this work in detail in the paper, however, it is important to re-state here that these findings:
1) Cannot be directly used to infer safety as a much larger dataset would be required for crash-based statistical analysis of risk,
2) May not be generalizable to a population of drivers nor Autopilot versions outside our dataset,
3) Do not include challenging scenarios that did not lead to Autopilot disengagement,
4) Are based on human-annotation of critical signals,
5) Do not imply that driver attention management systems are not potentially highly beneficial additions to the functional vigilance framework for the purpose of encouraging the driver to remain appropriately attentive to the road.