2631 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Mika Lindqvist	2c98ece180	[configure] Add support for RISC-V ZBC extension	2025-05-28 13:32:14 +02:00
Sam Russell	41d72b9d24	Fix 32bit large chorba	2025-05-28 13:31:37 +02:00
Mika Lindqvist	f90c01107f	[WebAssembly] Fix stack overflow in crc32_chorba_118960_nondestructive.	2025-05-27 14:45:52 +02:00
Nathan Moinvaziri	4b7037cd08	Add large 1mb buffer test for crc32 hashing.	2025-05-27 14:45:11 +02:00
yintong	830995ff78	riscv: add bash configure script and related ci support for riscv	2025-05-01 22:59:25 +02:00
Pavel P	dd15e04991	Remove unnecessary extern	2025-04-28 21:27:13 +02:00
Pavel P	f09f7791bf	Match function declaration for chorba_small_nondestructive_sse2	2025-04-28 21:27:13 +02:00
yintong	10b51fa592	riscv: add crc32 optimization using zbc extension	2025-04-27 18:23:50 +02:00
Adam Stylinski	46fc33f39d	SSE4.1 optimized chorba ... This is ~25-30% faster than the SSE2 variant on a core2 quad. The main reason for this has to do with the fact that, while incurring far fewer shifts, an entirely separate stack buffer has to be managed that is the size of the L1 cache on most CPUs. This was one of the main reasons the 32k specialized function was slower for the scalar counterpart, despite auto vectorizing. The auto vectorized loop was setting up the stack buffer at unaligned offsets, which is detrimental to performance pre-nehalem. Additionally, we were losing a fair bit of time to the zero initialization, which we are now doing more selectively. There are a ton of loads and stores happening, and for sure we are bound on the fill buffer + store forwarding. An SSE2 version of this code is probably possible by simply replacing the shifts with unpacks with zero and the palignr's with shufpd's. I'm just not sure it'll be all that worth it, though. We are gating against SSE4.1 not because we are using specifically a 4.1 instruction but because that marks when Wolfdale came out and palignr became a lot faster.	2025-04-15 14:11:12 +02:00
Detlef Riekenberg	5a232688e1	port: Use __cpuid only, when available. ... Add a fallback, when __cpuid is not available	2025-04-15 14:08:46 +02:00
Hans Kristian Rosbach	00a3168d5d	Add AVX512 version of compare256 ... Improve the speed of sub-16 byte matches by first using a 128-bit intrinsic, after that use only 512-bit intrinsics. This requires us to overlap on the last run, but this is cheaper than processing the tail using a 256-bit and then a 128-bit run. Change benchmark steps to avoid it hitting chunk boundaries of one or the other function as much, this gives more fair benchmarks.	2025-04-14 23:28:38 +02:00
Hans Kristian Rosbach	cfd90c7e1a	Speed up benchmarks when run as part of gtest as it does not check data ... for correctness, making it only run each benchmark for 1 iteration, instead of thousands or hundreds of thousands. Add a separate CI step to crashtest benchmarks without collecting any coverage data. Activate benchmarks in more arches. Disable some warnings to avoid errors in compiling google benchmark. Remove separate benchmark CI job, now included in other jobs instead.	2025-04-14 23:18:41 +02:00
Nathan Moinvaziri	dee0ff75f8	Remove NMake build projects ... Reduce development burden by getting rid of NMake files that are manually kept up to date. For continued NMake support please generate NMake project files using CMake.	2025-04-14 23:18:18 +02:00
Mika Lindqvist	19b3b7f6e9	[FreeBSD] Define _XOPEN_SOURCE for gtest_zlib ... * Without defining _XOPEN_SOURCE as 700, isascii() is not available on FreeBSD 14.	2025-04-14 23:17:59 +02:00
Vladislav Shchapov	ac1642facc	Remove late enable_language calls. ... Signed-off-by: Vladislav Shchapov <vladislav@shchapov.ru>	2025-04-14 23:17:47 +02:00
Mika T. Lindqvist	eb76eca8c7	Fix CXXFLAGS when coverage enabled.	2025-04-14 12:15:59 +02:00
Nathan Moinvaziri	e4a31e0538	Fix SPARC64 packages for Ubuntu 24.	2025-04-10 10:00:59 +02:00
Nathan Moinvaziri	4ff59d4927	Fix PPC64LE CI run when targeting power8.	2025-04-10 10:00:59 +02:00
Nathan Moinvaziri	07578f9c18	Remove deprecated ubuntu-20.04 image from CI.	2025-04-10 10:00:59 +02:00
Cristi Vîjdea	b2a0ffb5e9	Pass POSIX_C_SOURCE for std::alligned_alloc try_compile checks ... On FreeBSD 11, definining POSIX_C_SOURCE to a lower level has the efect of inhibiting the language level (__ISO_C_VISIBLE ) to be lower than C11, even in the presence of -std=c11 Since the check_symbol_exists runs without setting POSIX_C_SOURCE, this means that we will spuriously define HAVE_ALIGNED_ALLOC, while in the actual build it is not going to be defined ref: https://github.com/freebsd/freebsd-src/blob/stable/11/sys/sys/cdefs.h#L738	2025-04-07 23:36:27 +02:00
Mika Lindqvist	e88471f379	Fix pointer type mismatch.	2025-04-06 15:13:26 +02:00
Hans Kristian Rosbach	5ab093eebb	CI: Preinstall packages needed for testing and benchmark. ... Avoids having to compile gtest and google benchmark in every CI job. To make sure we also test downloading and building ourself, don't install for jobs that specify any matrix.packages.	2025-04-05 00:58:40 +02:00
Adam Stylinski	724dc0cfb4	Explicit SSE2 vectorization of Chorba CRC method ... The version that's currently in the generic implementation for 32768 byte buffers leverages the stack. It manages to autovectorize but unfortunately the trips to the stack hurt its performance for CPUs which need this the most. This version is explicitly SIMD vectorized and doesn't use trips to the stack. In my testing it's ~10% faster than the "small" variant, and about 42% faster than the "32768" variant.	2025-03-28 20:43:59 +01:00
Icenowy Zheng	2bba7e8468	riscv: chunkset_rvv: fix SIGSEGV in CHUNKCOPY ... The chunkset_tpl comment allows negative dist (out - from) as long as the length is smaller than the absolute value of dist (i.e. memory does not overlap). However this case is currently broken in the RVV override of CHUNKCOPY -- it compares dist (which is a ptrdiff_t, a value that should be of the same size with size_t but signed) with the result of sizeof (which is a size_t), and this triggers the implicit conversion from signed to unsigned (thus losing negative values). As it's promised to be not overlapping when dist is negative, just use a gaint memcpy() call to copy everything. Signed-off-by: Icenowy Zheng <uwu@icenowy.me>	2025-03-28 15:30:21 +01:00
Adam Stylinski	18b933b88a	Fix a bug on the 32k and greater chorba specializations ... In testing a SIMD vectorization for this, I wrote a gtest which stumbled onto the fact that this had a bug on big endian. Before the initial CRC had been mixed in it needed to be byte swapped.	2025-03-28 15:29:11 +01:00
Icenowy Zheng	64d16e10bc	ci: add a Clang RISCV test target ... Similar to the GCC one, this test target uses system toolchain and QEMU too. Signed-off-by: Icenowy Zheng <uwu@icenowy.me>	2025-03-27 18:16:33 +01:00
Icenowy Zheng	549ca4d617	ci: add a GCC RISCV test target with latest Ubuntu and system toolchain ... Signed-off-by: Icenowy Zheng <uwu@icenowy.me>	2025-03-27 18:16:33 +01:00
Icenowy Zheng	09a155cf33	ci: drop RISC-V Clang test ... The SiFive GitHub organization now deploys an IP allowlist which blocked GitHub Actions, which makes this test always fail. In addition, this is a quite different test than other non-x86 tests. Drop it now. Signed-off-by: Icenowy Zheng <uwu@icenowy.me>	2025-03-27 18:16:33 +01:00
Nathan Moinvaziri	d0652423c1	Disable MSVC optimizations for AVX512 GET_CHUNK_MAG #1883 ... MSVC compiler (VS 17.11.x) incorrectly optimizes the GET_CHUNK_MAG code on older versions. Appears to be resolved in VS 17.13.2. The compiler would optimize the code in such a way that it would cause a decompression failure. It only happens when /Os flag is set.	2025-03-26 20:06:38 +01:00
Hans Kristian Rosbach	fd0d263ced	[CI] Instead of selecting the most recent tag, select the highest version number.	2025-03-18 21:04:58 +01:00
Detlef Riekenberg	89f90d3e9c	ports: Use memalign or _aligned_malloc, when available. Fallback to malloc ... Using "_WIN32" to decide, if the MSVC extensions _aligned_malloc / _aligned_free are available is a bug that breaks other Compiler on Windows. (OpenWatcom as Example) Regards ... Detlef	2025-03-17 16:36:12 +01:00
Eddy S.	5f1c7303ab	fix the url of the s390x actions worker patch ... gaplib changed their patch name scheme with 1a5e012.	2025-03-17 12:23:16 +01:00
Adam Stylinski	50e9ca06e2	Fold a copy into the adler32 function for UPDATEWINDOW for neon ... So a lot of alterations had to be done to make this not worse and so far, it's not really better, either. I had to force inlining for the adler routine, I had to remove the x4 load instruction otherwise pipelining stalled, and I had to use restrict pointers with a copy idiom for GCC to inline a copy routine for the tail. Still, we see a small benefit in benchmarks, particularly when done with size of our window or larger. There's also an added benefit that this will fix #1824.	2025-03-05 22:17:55 +01:00
Vladislav Shchapov	356a7976db	Fix incorrect declaration of FORCE_SSE2 ... Signed-off-by: Vladislav Shchapov <vladislav@shchapov.ru>	2025-03-01 16:45:16 +01:00
Vladislav Shchapov	85223403d9	Change flags to "-Werror=unguarded-availability", "-Werror=unguarded-availability-new" and add it to maybe affected symbol checking ... Signed-off-by: Vladislav Shchapov <vladislav@shchapov.ru>	2025-03-01 16:45:04 +01:00
Vladislav Shchapov	c3bd3d7645	Restore support macOS prior 10.15 ... Signed-off-by: Vladislav Shchapov <vladislav@shchapov.ru>	2025-03-01 16:45:04 +01:00
Hans Kristian Rosbach	9d4af458ea	Make Chorba configurable,and add a few missing header files to CMake config. ... Add CI run without chorba enabled.	2025-02-18 23:59:16 +01:00
Hans Kristian Rosbach	c1796e2145	Use OPTIMAL_CMP instead of BRAID_W to test for optimal size for Chorba.	2025-02-18 23:59:16 +01:00
Hans Kristian Rosbach	f411580733	Clean up internal crc32 function handling. ... Mark crc32_c and crc32_braid functions as internal, and remove prefix. Reorder contents of generic_functions, and remove Z_INTERNAL hints from declarations. Add test/benchmark output to indicate whether Chorba is used.	2025-02-18 23:59:16 +01:00
Hans Kristian Rosbach	ed30965e29	Replace DO1/DO8 macros	2025-02-18 23:59:16 +01:00
Hans Kristian Rosbach	5fb2a1c493	Move Chorba defines	2025-02-18 23:59:16 +01:00
Hans Kristian Rosbach	8648ffef49	Clean up crc32_braid. ... - Rename N and W to BRAID_N and BRAID_W - Remove override capabilities for BRAID_N and BRAID_W - Fix formatting in crc32_braid_tbl.h - Make makecrct not rely on crc32_braid_p.h	2025-02-18 23:59:16 +01:00
Andrew Murray	e8d8049382	Added --installnamedir	2025-02-16 18:15:43 +01:00
Sam Russell	b33ba962c2	implement chorba algorithm	2025-02-15 14:31:50 +01:00
Cameron Cawley	aecfe160c5	Provide --without-acle/-DWITH_ACLE options for backward compatibility	2025-02-12 13:54:30 +01:00
Cameron Cawley	231c4b3a64	Use -Wa,-march with older ARM toolchains	2025-02-12 13:54:30 +01:00
Cameron Cawley	7ea78f12c8	Provide an inline asm fallback for the ARMv8 intrinsics	2025-02-12 13:54:30 +01:00
Cameron Cawley	721c488aff	Rename most ACLE references to ARMv8	2025-02-12 13:54:30 +01:00
Hans Kristian Rosbach	860e4cff79	2.2.4 Release	2025-02-10 23:43:59 +01:00
Mika Lindqvist	43b2703435	Fix shift overflow in inflate and send_code.	2025-02-08 21:43:51 +01:00