^hRJSrSSKrSSKrSSKJrJr SSKJr "SS\5rg)z| In-Memory Cache implementation Has 4 methods: - set_cache - get_cache - async_set_cache - async_get_cache N)ListOptional) BaseCachec\rSrSrSS\\S\\4SjjrSrSrSr SS jr S \ S \\ 4S jr S rS\4SjrS \S\4SjrSrS\4SjrS \ S\ 4SjrSrSrSrS\S\\4SjrSrg) InMemoryCachemax_size_in_memory default_ttlc`U=(d SUlU=(d SUl0Ul0Ulg)zv max_size_in_memory [int]: Maximum number of items in cache. done to prevent memory leaks. Use 200 items as a default XN)r r cache_dictttl_dict)selfr r s Y/home/james-whalen/.local/lib/python3.13/site-packages/litellm/caching/in_memory_cache.py__init__InMemoryCache.__init__s3  %# '-#!#  c[URR55Hcn[R"5URU:dM+URR US5 URR US5 Me g)ae Eviction policy: - check if any items in ttl_dict are expired -> remove them from ttl_dict and cache_dict This guarantees the following: - 1. When item ttl not set: At minimumm each item will remain in memory for 5 minutes - 2. When ttl is set: the item will remain in memory for at least that amount of time - 3. the size of in-memory cache is bounded N)listrkeystimerpoprkeys r evict_cacheInMemoryCache.evict_cache&s_ **,-Cyy{T]]3//##C. !!#t,.rc N[UR5UR:aUR5 X RU'SU;a/USb)[R"5US-UR U'g[R"5UR -UR U'g)Nttl)lenrr rrrr rrvaluekwargss r set_cacheInMemoryCache.set_cache<s} t 4#:#: :    $ F?ve}8!%ve}!rtypingrr base_cacherrr)rrrvs& !!G,IG,r