CVE-2024-58400

Description

llama.cpp before b3701 contains an out-of-bounds read vulnerability in llama_decode_internal and llama_encode_internal that allows remote unauthenticated attackers to read memory by supplying unvalidated token IDs. Attackers can send integer-array prompts to the llama-server /completion endpoint with IDs outside 0 to n_vocab to read embedding memory out of bounds or crash the process.

References

https://www.vulncheck.com/advisories/llama-cpp-before-b3701-out-of-bounds-read-in-llama-decode-via-token-ids

https://github.com/ggml-org/llama.cpp/releases/tag/b3701

https://github.com/ggml-org/llama.cpp/pull/9359

https://github.com/ggml-org/llama.cpp/commit/faf69d4237c9ae4d7f572b4674d1002463e8acd3

https://github.com/ggml-org/llama.cpp/commit/eae597182cb61bbde0b26e7cec5999d28b9327fe

https://github.com/ggml-org/llama.cpp/blob/b3681/examples/server/server.cpp#L789

https://euvd.enisa.europa.eu/vulnerability/EUVD-2024-55827

Details

Source: Mitre, NVD

Risk Information

CVSS v2

CVSS v3

CVSS v4

EPSS