The Federal Reserve is a pretty centralized banking system.

To your point, however, the US has had prosperous period of its history with free (I.e. no central/federal control) banking. See Rothbard's "The Mystery of Banking."