This is pretty cool! It uses Vega transforms under the hood, right? The default backend uses JS for transformation which is slow for large datasets. Did you consider using Duckdb under the hood via WASM? I run into this project but not sure how active it is: https://github.com/vega/vega-plus
Cool! How does it work in practice? Looking at the PR, it seems to pull all the data from Duckdb but is there any plan to apply the transformations (filter, aggregate that the user selected in UI) in Duckdb while rendering the chart?
This PR had just tested running DuckDB-WASM. For more complex computation, I am planning to build a computation engine to generate SQL and push it to DuckDB or other databases. (I built a POC like this in another project, RATH, but the SQL is push to clickhouse instead.)
If you are interested in this, welcome to discuss with us in the PRs/issues on Github or in our Discord: https://discord.gg/Z4ngFWXz2U
