In the US this would be true in many, many areas. It’s not true in some countries, even in some that could be classified as patriarchal, such as Japan.
Violence against women is very much a thing in Japan too. Heck, they invented the women-only train car to address the safety issue. I don’t know where you’re getting that idea from.
Looking at large countries, Japan has one of the lowest incidence of rape against females --compare it to North America, South America, Australia and Africa. There is no comparison. In Europe, Sweden and France are outliers with a very high incidence. In the Middle East, there are countries with low rates.
Lowest incidents of reported rape against women/girls does not mean the numbers are actually low. Japan has a lot of issues with police not doing their job on these cases, and a lot of social blowback from reporting (e.g. if it got in the news, the woman could lose her job with no recourse, or be expelled from school).
Trains aren't streets. Yes, they could work lots and lots on their groping culture. But the point is women in Japan feel safe walking at night on the streets, unlike many, many places in the US.