I played around with Phoenix a bit a while ago, and it wasn't actually difficult to integrate webpack. There are a bunch of posts around the web on how to do that, and I found it pretty straightforward.
So while you get Brunch out of the box, if you already know a different build system, you don't have to switch.
So while you get Brunch out of the box, if you already know a different build system, you don't have to switch.