Hacker News new | past | comments | ask | show | jobs | submit login

Wow, just wow. These perf improvements are great. ASIC accelerated filesystems is just crazy

### Performance

* ARC Buffer Data (ABD) - Allocates ARC data buffers using scatter lists of pages instead of virtual memory. This approach minimizes fragmentation on the system allowing for a more efficient use of memory. The reduced demand for virtual memory also improves stability and performance on 32-bit architectures.

* Compressed ARC - Cached file data is compressed by default in memory and uncompressed on demand. This allows for an larger effective cache which improves overall performance.

* Vectorized RAIDZ - Hardware optimized RAIDZ which reduces CPU usage. Supported SIMD instructions: sse2, ssse3, avx2, avx512f, and avx512bw, neon, neonx2

* Vectorized checksums - Hardware optimized Fletcher-4 checksums which reduce CPU usage. Supported SIMD instructions: sse2, ssse3, avx2, avx512f, neon

* GZIP compression offloading - Hardware optimized GZIP compression offloading with QAT accelerator.

* Metadata performance - Overall improved metadata performance. Optimizations include a multi-threaded allocator, batched quota updates, improved prefetching, and streamlined call paths.

* Faster RAIDZ resilver - When resilvering RAIDZ intelligently skips sections of the device which don't need to be rebuilt.




> ASIC accelerated filesystems is just crazy

What?


I guess this refers specifically to the following bullets:

* Vectorized RAIDZ - Hardware optimized RAIDZ which reduces CPU usage. Supported SIMD instructions: sse2, ssse3, avx2, avx512f, and avx512bw, neon, neonx2

* Vectorized checksums - Hardware optimized Fletcher-4 checksums which reduce CPU usage. Supported SIMD instructions: sse2, ssse3, avx2, avx512f, neon

* GZIP compression offloading - Hardware optimized GZIP compression offloading with QAT accelerator.

All use vector and/or SIMD instructions on the CPU, thoughh QuickAssist (QAT above) is available on dedicated add-in card also.


Yeah I don't equate SIMD instructions to being ASIC's.


Yeah an ASIC is an Application-specific integrated circuit. SIMD instructions are not application-specific.


Thanks for correcting me. I was wrong. But it is nice to see acceleration in the FS space using SIMD intrinsics on the chips we already own.


Yeah quick assist cards is what I was referencing.


You should read his comment, he's talking about all the ASICs involved in the underlying filesystem.


let me rephrase gbrown_'s question: which part of my CPU is specific to ZFS? Because that's what ASIC means. The acronym stands for Application-specific integrated circuit.


Edit: not asic just the SIMD stuff is neat. My bad.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: