Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[auto] Sync version 2304281820.0.0+llamacpp-release.master-55390bc
== Relevant log messages from source repo: commit 55390bcaf2579a5435564d7267ae3ed367837fd6 Author: Georgi Gerganov <[email protected]> Date: Fri Apr 28 20:37:43 2023 +0300 ggml : sync ggml (ggml_alibi) commit 11d902364b0e3b503a02a4e757ee2dc38aacb68f Author: Georgi Gerganov <[email protected]> Date: Fri Apr 28 17:58:44 2023 +0300 ggml : add helper debug printf in soft_max commit 7296c961d9303010a2b98379f738da2a8a55aa1b Author: 0cc4m <[email protected]> Date: Fri Apr 28 16:57:16 2023 +0200 ggml : add CLBlast support (#1164) * Allow use of OpenCL GPU-based BLAS using ClBlast instead of OpenBLAS for context processing * Improve ClBlast implementation, avoid recreating buffers, remove redundant transfers * Finish merge of ClBlast support * Move CLBlast implementation to separate file Add buffer reuse code (adapted from slaren's cuda implementation) * Add q4_2 and q4_3 CLBlast support, improve code * Double CLBlast speed by disabling OpenBLAS thread workaround Co-authored-by: Concedo <[email protected]> Co-authored-by: slaren <[email protected]> * Fix device selection env variable names * Fix cast in opencl kernels * Add CLBlast to CMakeLists.txt * Replace buffer pool with static buffers a, b, qb, c Fix compile warnings * Fix typos, use GGML_TYPE defines, improve code * Improve btype dequant kernel selection code, add error if type is unsupported * Improve code quality * Move internal stuff out of header * Use internal enums instead of CLBlast enums * Remove leftover C++ includes and defines * Make event use easier to read Co-authored-by: Henri Vasserman <[email protected]> * Use c compiler for opencl files * Simplify code, fix include * First check error, then release event * Make globals static, fix indentation * Rename dequant kernels file to conform with other file names * Fix import cl file name --------- Co-authored-by: Concedo <[email protected]> Co-authored-by: slaren <[email protected]> Co-authored-by: Henri Vasserman <[email protected]> Co-authored-by: Georgi Gerganov <[email protected]>
- Loading branch information