Skip to content

Commit

Permalink
[auto] Sync version 2304281820.0.0+llamacpp-release.master-55390bc
Browse files Browse the repository at this point in the history
== Relevant log messages from source repo:

commit 55390bcaf2579a5435564d7267ae3ed367837fd6
Author: Georgi Gerganov <[email protected]>
Date:   Fri Apr 28 20:37:43 2023 +0300

    ggml : sync ggml (ggml_alibi)

commit 11d902364b0e3b503a02a4e757ee2dc38aacb68f
Author: Georgi Gerganov <[email protected]>
Date:   Fri Apr 28 17:58:44 2023 +0300

    ggml : add helper debug printf in soft_max

commit 7296c961d9303010a2b98379f738da2a8a55aa1b
Author: 0cc4m <[email protected]>
Date:   Fri Apr 28 16:57:16 2023 +0200

    ggml : add CLBlast support (#1164)

    * Allow use of OpenCL GPU-based BLAS using ClBlast instead of OpenBLAS for context processing

    * Improve ClBlast implementation, avoid recreating buffers, remove redundant transfers

    * Finish merge of ClBlast support

    * Move CLBlast implementation to separate file

    Add buffer reuse code (adapted from slaren's cuda implementation)

    * Add q4_2 and q4_3 CLBlast support, improve code

    * Double CLBlast speed by disabling OpenBLAS thread workaround

    Co-authored-by: Concedo <[email protected]>
    Co-authored-by: slaren <[email protected]>

    * Fix device selection env variable names

    * Fix cast in opencl kernels

    * Add CLBlast to CMakeLists.txt

    * Replace buffer pool with static buffers a, b, qb, c

    Fix compile warnings

    * Fix typos, use GGML_TYPE defines, improve code

    * Improve btype dequant kernel selection code, add error if type is unsupported

    * Improve code quality

    * Move internal stuff out of header
    * Use internal enums instead of CLBlast enums
    * Remove leftover C++ includes and defines
    * Make event use easier to read

    Co-authored-by: Henri Vasserman <[email protected]>

    * Use c compiler for opencl files

    * Simplify code, fix include

    * First check error, then release event

    * Make globals static, fix indentation

    * Rename dequant kernels file to conform with other file names

    * Fix import cl file name

    ---------

    Co-authored-by: Concedo <[email protected]>
    Co-authored-by: slaren <[email protected]>
    Co-authored-by: Henri Vasserman <[email protected]>
    Co-authored-by: Georgi Gerganov <[email protected]>
  • Loading branch information
github-actions committed Apr 28, 2023
1 parent d972c92 commit ca01036
Show file tree
Hide file tree
Showing 7 changed files with 296 additions and 25 deletions.
2 changes: 1 addition & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[package]
name = "ggml-sys-bleedingedge"
version = "2304281232.0.0+llamacpp-release.master-04aaae1"
version = "2304281820.0.0+llamacpp-release.master-55390bc"
description = "Bleeding edge low-level bindings to GGML. "
repository = "https://github.com/KerfuffleV2/ggml-sys-bleedingedge"
keywords = ["deep-learning", "machine-learning", "tensors", "ggml", "ml"]
Expand Down
2 changes: 1 addition & 1 deletion VERSION.txt
Original file line number Diff line number Diff line change
@@ -1 +1 @@
2304281232.0.0+llamacpp-release.master-04aaae1
2304281820.0.0+llamacpp-release.master-55390bc
Loading

0 comments on commit ca01036

Please sign in to comment.