It's very easy to distinguish. People indicating to the right and slowing down are probably picking up or dropping off a pedestrian. If they aren't indicating, you must assume there's a hazard in front of them, slow down, and proceed with caution.