In the context of a lyft/uber it's a bit different; it would not only be socially awkward but also usually make me late (and possibly even dangerous) to stop the ride halfway through and exit.

It's not the case (thankfully) that I've felt my safety is in danger in these situations... it's just annoying.