It's no less unnerving than going on a plane mostly piloted by computers that rockets through the sky at several hundred miles an hour. There will always be people that fear the loss of control but most people will realize that the convenience is worth giving such a thing up considering that once this technology is perfected you will ideally have a greater chance of getting struck by lightning than dying in a car accident.
It's a bit odd to compare self driving cars (which have to constantly evaluate their surroundings, change direction, and avoid obstacles such as parents and kids) to a machine that flies through the air with zero obstacles, has a minimum of three people at the helm, and they each have at least 1500 flight hours of training under their belt as an airline first officer first.
