Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Android Crashes: Known Device/Quantization Incompatibilities #107

Open
a-ghorbani opened this issue Nov 22, 2024 · 2 comments
Open

Android Crashes: Known Device/Quantization Incompatibilities #107

a-ghorbani opened this issue Nov 22, 2024 · 2 comments

Comments

@a-ghorbani
Copy link
Owner

a-ghorbani commented Nov 22, 2024

This issue serves as a repository for tracking Android devices and specific quantizations that lead to crashes.

Please share detailed reports including device model and CPU specs, Android versions, the specific GGUF and its quantization, and stack traces if available.

Phone Model Chipset CPU Configuration App Version Model(s)
Tecno Spark 20 Pro+ MediaTek Helio G99 8-core (2x Cortex-A76 at 2.2 GHz & 6x Cortex-A55 at 2.0 GHz) 1.4.6
OnePlus 12 Qualcomm SM8650-AB Snapdragon 8 Gen 3 (4 nm) 8-core (1x3.3 GHz Cortex-X4 & 3x3.2 GHz Cortex-A720 & 2x3.0 GHz Cortex-A720 & 2x2.3 GHz Cortex-A520) 1.4.6
Motorola Edge 30 Neo Qualcomm SM6375 Snapdragon 695 5G (6 nm) Octa-core (2x2.2 GHz Kryo 660 Gold & 6x1.7 GHz Kryo 660 Silver) 1.5.2 madlad400
Xiaomi Redmi Note 8 Pro Mediatek MT6785V/CC Helio G90T (12 nm) Octa-core (2x2.05 GHz Cortex-A76 & 6x2.0 GHz Cortex-A55) 1.4.6 Whatever model
Samsung Galaxy Note10 Lite Exynos 9810 (10 nm) Octa-core (4x2.7 GHz Mongoose M3 & 4x1.7 GHz Cortex-A55) 1.4.6
Infinix NOTE 30 Mediatek Helio G99 (6 nm) Octa-core (2x2.2 GHz Cortex-A76 & 6x2.0 GHz Cortex-A55) 1.4.6
Huawei P30 Pro Kirin 980 Octa-core (2x2.6 GHz Cortex-A76 & 2x1.92 GHz Cortex-A76 & 4x1.8 GHz Cortex-A55)

If you don't know the CPU and chipset of the phone, you can use GSMArena to get the information.

@a-ghorbani a-ghorbani added question Further information is requested device-compatibility and removed question Further information is requested labels Nov 22, 2024
@a-ghorbani a-ghorbani pinned this issue Nov 22, 2024
@twdragon
Copy link

I used this T5 model, trying different modes and templates: https://huggingface.co/Felladrin/gguf-q5_k_m-madlad400-3b-mt

Either I had only crashes when run without any template and <2en> prompt header for Spanish text, or unreadable <><>>>< sequences when the default template was used. I think, the llama.cpp kernel should be updated

@Slug-Cat
Copy link

Slug-Cat commented Dec 4, 2024

Using Nubia z60 Ultra 16/512GB, Mag Mell IQ3_M crashes upon trying to load.
Version: 1.5.2
Chipset: SD 8 Gen 3
OS: MyOS 14.0.10 (Android 14)
https://huggingface.co/mradermacher/MN-12B-Mag-Mell-R1-GGUF/blob/main/MN-12B-Mag-Mell-R1.IQ3_M.gguf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants