You can compile it to include only the components you actually use. I don't use stock semantic myself. I use the react port which is a separate project which uses just the CSS of the semantic library (and again can be compiled to include the css/theme you want).

I've never heard of bulma until this post so I will give it a look.