Tags: #semantic-cache
LLM Caching Library
Python
8.0k
zilliztech/GPTCache
A semantic caching library for LLM queries, designed to drastically cut API costs and accelerate response times.
A semantic caching library for LLM queries, designed to drastically cut API costs and accelerate response times.