^hSSKrSSKrSSKJr SSKJr SSKJr SSKJ r J r "SS\R5r "SS \R5r "S S \5r"S S 5rg)N)Optional) BaseModel) print_verbose) DualCache RedisCachec\rSrSrSrSrSrg)SchedulerCacheKeys zscheduler:queueN)__name__ __module__ __qualname____firstlineno__queuedefault_in_memory_ttl__static_attributes__r K/home/james-whalen/.local/lib/python3.13/site-packages/litellm/scheduler.pyr r s Err c \rSrSrSrSrSrSrg)DefaultPrioritiesrr N)r rrrHighMediumLowrr rrrrs D F Crrc4\rSrSr%\\S'\\S'\\S'Srg)FlowItempriority request_id model_namer N)r rrrint__annotations__strrr rrrrsMOOrrc\rSrSr%\\S'SS\\S\\4Sjjr S\ 4Sjr S \ S \ S \ S \4S jrS \ S \ S \ S \4SjrSrS \ S \ 4SjrS\ S \ S S4SjrSrg) SchedulercacheNpolling_interval redis_cachec/UlSnUb[RRn[ X#S9UlU=(d SUlg)zO polling_interval: float or null - frequency of polling queue. Default is 3ms. N)r,rgQ?)rr rvaluerr*r+)selfr+r,rs r__init__Scheduler.__init__sG 15  "$6$L$L$R$R !#  !1 8Drrequestc# URURS9IShvN n[R"X!RUR 45 UR X!RS9IShvN gNRN7f)Nr#)rr#) get_queuer#heapqheappushr!r" save_queue)r/r2rs r add_requestScheduler.add_request1senn0B0BnCC u//1C1CDEooE6H6HoIII D Js"A6A2A A6,A4-A64A6idr#health_deploymentsreturncR# URUS9IShvN nU(d[SRU55e[S[ U535 [ U5S:XaC[SUSU35 USSU:Xa%[ R "U5 [S U35 g g g N7f) z Return if request can be processed. Returns: - True: * If healthy deployments are available * OR If request at the top of queue - False: * If no healthy deployments available * AND request not at the top of queue r4N-Incorrectly setup. Queue is invalid. Queue={}zlen(health_deployments): rzqueue: z , seeking id=z Popped id: TF)r5 Exceptionformatrlenr6heappopr/r;r#r<rs rpollScheduler.poll;snn n;;?FFuM  1#6H2I1JKL ! "a ' GE7-t< =Qx{b  e$ B401-rbsO !9   y mmr