^h SSKrSSKrSSKJrJr \R "5 \R "S5 SSKrSSS5 SS\S\S\ S\ S\4 S jjr S r S r S rS rSS\\\\4S\S\ S\4Sjjrg!,(df  NE=f)N)DictListignoretextmodel max_tokenstop_proportionreturncUS:XaU$[R"X5n[U5U::aU$US- n[X5-5n[U5XV- - n[R"XSU5S-[R"XUS5-$)Nrz [...] )litellmencodelenintdecode)rrrr tokens total_lentop_len bot_starts K/home/james-whalen/.local/lib/python3.13/site-packages/chatdbg/util/trim.pysandwich_tokensr sT ^^E (F 6{j  N n01K9#67 NN57"3 4 nnU9:$67 8 c*[R"XS9$)Nmessages)r token_counterrrs r _sum_messagesrs   ::rc.^[U4SjU55$)Nc3R># UHupU(dM[UT5v M g7f)N)r).0rkeptrs r #_sum_kept_chunks.."s$Uf2B8PT-}Xu--fs '')sum)chunksrs `r_sum_kept_chunksr'!s UfU UUrc/n/nUH:nURSS5U;a[USUSS5nXeS'X5/- nM5XE/- nM< X44$)N tool_call_idcontentig?)getr)rr tool_call_idstoolsothermr+s r_extractr1%s` E E  55 $ 5%a lE3DG"iL SLE SLE <rcU(d/$USnSU;a*[USUSS5US'U/S4/[USSU5-$USVs/sHo3SPM nn[USSX5upVU/U-S4/[Xa5-$s snf)Nr tool_callsr+Fid)r _chunkifyr1)rrr0 tool_callidsr.r/s rr7r73s   A1&q|UD!D) e ~ (12, >>>01,@9@ e9 ue$% %(???AsA<r trim_ratioc[R"U5n[RUSn[ X2-5n[R "XS9U:aU$[ XS9nUVVs/sHupgXg=(d USSS:H4PM nnn[[U55HnXXup USSS:XdMUS4XX'M [[U55S S S 2H5nXXup U (aM[XQ5[X5-U:aUS4XX'M5 O [XQ5U:dS [XQ5S US 35eUVV Vs/sHup U (dMUHofPM M snn n$s snnfs snn nf)a Strategy: - chunk messages: - single message, or - tool request and all the tool responses - keep the system messages - keep the first user message - go most recent to oldest, keeping chunks until we are at the limit Also, shorten tool call results along the way. -max_input_tokensrrrrolesystemuserTNr*zNew conversation too big z vs !) copydeepcopyr model_costrrr7rangerr'r) rrr:max_tokens_for_modelrr&r0bir"s r trim_messagesrH@s"}}X&H"--e45GH)67JU6C  6F@F FvVaq/qtF|x/0vF F3v;  A;v & (!4(FI 3v; " %   V +mH.L L "4(FI &$ '*4V "#3F#B"C4 |STUV4'- Gf"8AhAhAf GGAG@ Hs"!E: E% E%)r4g?)g?)rAwarningstypingrrcatch_warnings simplefilterr strrfloatrrr'r1r7listrHrrrQs   (# LO   '* CH  &;V  @ =H4S>"=H =H=H =Hws A88 B