When I first started to use Vagrant I had slowness issues as well. However, through a bit of digging around I figured out that by mounting the shared folder through NFS and to create a swap file, pretty much all slowness issues disappeared.