An important niche to consider might be face recognition. For example the "US Open" image on medium JXL is significantly distorted in the face. As the face area is critical to the overall image quality perception, that area would benefit from reduced compression.

edit: This is also the case in other images with faces (and especially the eyes).