You are right.

Manufacturing fuel in space would be the way to go.

Or eg have giant solar panels in orbit that power a laser to shine at your spaceships. Either to propel them directly, or to transmit power for their ion thrusters etc.