first commit

This commit is contained in:
陈赣
2026-06-03 12:43:14 +08:00
commit ba76cfae28
608 changed files with 120791 additions and 0 deletions

13
third_party/cpp_llmlib/README.md vendored Normal file
View File

@@ -0,0 +1,13 @@
a lightweight LLM Client SDK using modern C++ Language, supports calling OpenAI-compatible online services — such as Alibaba Cloud, OpenAI, and other API providers — as well as locally hosted inference backends like Ollama, vLLM, and Hugging Face TGI.
> NOTE: OpenSSL >= 3.0 required for llmlib.hpp.
```
mkdir build
cd build
cmake ..
make -j8
./llmlib_ollama_test # test chat REST API for Ollama
./llmlib_openai_test # test chat REST API for OpenAI-compatible protocol(aliyun LLM API provider/vLLM/...)
```