oi`e /SQrSSKrSSKrSSKrSSKJr SSKJrJrJ r J r J r J r \RrSSKJr SS KJrJrJrJr \R.rSPS \S \4S jjr0qS \S\ S\4Sjr\R<rSSK Jr \"\5\"\5LdS5e\\r%S\S\ S\ S\ 4Sjr&\r'SSK(J'r' \"\'5\LdS5e\r,SS#K-J,r, \"\,5\LdS$5e\r.\r/SS%K(J.r. \"\.5\LdS&5e\,\:wa "S'S(\,\.5r/\Rr1SS*K2J1r1 \Rr3SS+K2J3r3 \Rr4SS,K2J4r4 \Rr5SS-K2J5r5 \r6SS.K7J6r6 \ \r8SS/K7J8r8 \Rr9SS0K:J9r9 \Rr;SS1K J;r; \RrSS4K J>r> \R~RRrB\R~RRrD0\R\R_\R\R_\R\R_\H\R_\I\R_\J\R_\L\R_\M\R_\\_\%\\_\1\R_\3\R_\4\R_\5\R_\9\R_\;\R_\<\R_\=\R\>\R0ErO\6\:wa\R\O\6'\8\ \:wa\R\O\8'\'\:wa\\O\''\,\:wa\\O\,'\.\:wa\\O\.'SSKPrP\R\O\PR'S5\S\4S6jrRS5\S\4S7jrSS8\S\ \ \\44S9jrTS:\ \ S;\ \ S\ \4S<jrUSQS=\S>\S?\S\ \V\44S@jjrWSA\SB\S\4SCjrXSRSA\SB\S>\SD\VSE\VS?\S\V4SFjjrYSRSA\SB\SG\ \\ \4SD\VSE\VS?\S\V4SHjjrZSRSI\ \ \\\4SD\VSJ\VS?\S\ \\V44 SKjjr[SA\SB\S\V4SLjr\SA\S\ \4SMjr]SN\ \ \\4S\ \\V44SOjr^g! SSKJ r GNE=f! SSKJr GN=f!\!aIr"\"\"5r"S\";a\#"S5eS\";a\#"S5eS\";a\$"\"5e\#"S\"\"5S35eSr"C"f\$a r"\$"\"5eSr"C"ff=f!\!a5r"SS K)J*r+ \"\+5\"S!5:a\#"S"\"\"5S35eSr"C"GNZSr"C"f\$a r"\$"\"5eSr"C"ff=f! GN[=f! \'r/\/\:Xa\R`"S)\"\'535 GNV=f! GNK=f! GNA=f! GN7=f! GN-=f! GN-=f! GN*=f! GN =f! GN=f! GN =f! GN=f! GN=f! GNN=f)S)patch_functionpatch_function_past_key_valuesprocess_returnprocess_output_options KWARGS_TYPEraise_errorUnpackCache DynamicCache HybridCache StaticCache TextInputPreTokenizedInput ImageInput ImagesKwargsMultiModalDataProcessingKwargsProcessorMixin_get_unique_storage_namededentN)r)AnyCallableDictListTupleUnion)_TypedDictMeta)Version)UNSLOTH_ENABLE_LOGGINGUNSLOTH_COMPILE_DISABLEtorch_compile_optionsloggerf exceptioncp[(a+[R"SUSUb [U5OSS35 g)Nz#================== Failed to patch z. Error z ================== )r r#errorstr)r$r%s ]/home/james-whalen/.local/lib/python3.13/site-packages/unsloth_zoo/temporary_patches/utils.py raise_errorr+6sA  c!*!6s9~B?@# $  output_class return_dictreturnc 4U[;a/[UnX!R5-nUVs0sHoDX_M nnU"S0UD6$s snf! UR5n[[R"U5R R55nX%-nUVs0sHoDX_M Os snfnn[ R"SURSUSUSXR- 35 U[U'U"S0UD6s$![an[[U55eSnAff=f=f)z4CausalLMOutputWithPast(...) might change arguments! zUnsloth: Returning z+ changed return args. Previously we wanted z Now we can only use z These keys are gone: N) PROCESS_RETURN_ALLOWED_TYPESkeyssetinspect signature parametersr# warning_once__name__ Exception RuntimeErrorr))r-r. allowed_keys chosen_keyskeyreturn_dict_keyses r*rrEs9 ' 7 77 EL&)9)9);;K=HI[c!11[KI*k**J'&++-7,,\:EEJJLM #6 :EF+3k..+F F!,"7"7!89$$4#56$$0>2$$4$C#D F  '9E ( 6.+. . 's1v& & 'sL)AA AAADB('6DC1.D1 D;DDD)Unpackz-J)PWX\XcXcexzQA 4 @gdkk[qsxFy&7 %9 !" Mr,)TransformersKwargszHUnsloth: TransformersKwargs type changed! Please file a bug report asap!) __version__z 4.54.0.dev0z:Unsloth: TransformersKwargs has been moved! Other error = )FlashAttentionKwargszJUnsloth: FlashAttentionKwargs type changed! Please file a bug report asap!) LossKwargsz@Unsloth: LossKwargs type changed! Please file a bug report asap!c\rSrSrSrg)KwargsForCausalLMr1N)r9 __module__ __qualname____firstlineno____static_attributes__r1r,r*rPrPs3r,rPz\Unsloth: KwargsForCausalLM cannot be inherited from TransformersKwargs since it's of type = )r)r )r )r )r )r )r)r)r)r)r annotationcU[La[$[[S5(aD[R"U5nUb+[R"U5n[ SU55nX4$[ RX5$)zs Canonicalize type annotations for consistent comparison. Makes List[int], typing.List[int], list[int] equivalent. get_originc38# UHn[U5v M g7fN)canonicalize_annotation).0args r* +_canonicalize_annotation..&sF#055s)EMPTYhasattrtrXget_argstuple TYPE_MAPPINGSrH)rVoriginargss r*_canonicalize_annotationrhsi U q,j)  ::j)DFFFD> !   Z 44r,c4[U5n[U5[La[U5S:XaUS[R :Xa;[ [US55nURSS9 [U5nUSU4nU$US[:XaK[US5[La6[US5S:Xa$S[USS5;a[[44nU$US[:Xa4[US5[LaS[US5;a [[44nU$)Nrrrc[U5$rZ)r))xs r*)canonicalize_annotation..3sc!fr,)r>Kwargs) rhtyperdlenrbrlistr4sortt_Unpackr)t_TypedDictMeta)rVrgs r*r[r[*s)*5J J5 S_%9 a=AGG #JqM*+D II,I -;D$Q-/J ]h & A 5 (  1 ! # JqM!,- -"_$68J  ]h & A 4 ' JqM* *"_$68J r,funcc [R"U5n/nURR 5n[ U5HupV[UR5nURRnURn SUR5;a5SnU[:Xa)U [:Xa[U5S- U:Xa [ ["44n US:Xa9[U5S:Xa*UR$S:XaU [:Xa[&R(n UR+UUUR,[L[/U 5S.5 M U$![[4an[SU35eSnAff=f) z Return a fingerprint we can use to compare function signatures. Returns: [{'name': str, 'kind': int, 'is_required': bool, 'annotation': Any}] z,Unsloth: Cannot inspect function signature: NrDrrkrforward)namekind is_requiredrV)r5r6 ValueError TypeErrorr7values enumerater)rxryvaluerVlowerVAR_KEYWORD_IDr`rprsrtr9torchTensorappenddefaultr[) rur6r@ fingerprintsignature_parameterskkparam param_name param_kindrVs r*get_function_fingerprintrIsT M%%d+ K$//66834 _ ZZ%% %%  z'') )!J~-u$)*1,2&(:<  3  % &! + ]]i ' 5 J  ==E12:>   15< G  "MGsKLLMsD::E EEold_fpnew_fpc[SU55n[SU55n[X#- 5nUR5 [U5$)Nc3*# UH oSv M g7frxNr1r\rks r*r^ removed_flags..{/1vYc3*# UH oSv M g7frr1rs r*r^r|rr)r4rqrrrd)rr old_params new_paramsremoved_paramss r* removed_flagsrwsH///J///J*12N   r, original_funcnew_func match_levelc US;aSSUS34$[U5n[U5nSn[U5[U5:waD[X45nUS:XaS$U"X4U5upUS :XaS U 4$SS [U5S [U534$[ X45HupU S U S 4U S U S 4:wa5US:Xa"[X45nU"X4U5upUS :XaS U 4s $SSU S S34s $U S(aU S(d SSU S S34s $US:XdMyU SU S:wdMSSU S SU SSU S34s $ g![anSSU34sSnA$SnAff=f)z: Check if it's safe to patch original_func with new_func. )strictrelaxedFzInvalid match_level: z. Use 'strict' or 'relaxed'zSignature inspection failed: Nc[U5S:aUSS[:XaUSSS:XaUSS[:XaUSSS:Xa[U5nU[SS15-nSnS nU[U5:azXnUSU;aWUS - nU[U5:aCXnUSU;a USS ;aUS[[4;aOS nOUS - nU[U5:aMCUS - nU[U5:aMzU(dS$g )NrryrxrDrgrFr)rgrDT)Fr')TzReplacing with *args, **kwargs)rprVAR_POSITIONAL_IDr4)rrremoved_flags_listifailold_args r*check_args_kwargs+can_safely_patch..check_args_kwargss+ K1  2Jv . 0VBZ5G85S 2Jv "3 3r 68Jf8T"%%7!8  #vx&8"9 9 ADc&k/ )6?&88FAc&k/"()"6?2DD '3F F!(^EV4X!X $'+ %Qc&k/Q!c&k/">>r,)rFrGTzParameter count mismatch: z vs rxryrz Parameter 'z' signature changedrzz#' changed from optional to requiredrrVz ' type annotation changed from: z to )Tr')Fz?New function removed output_attentions and output_hidden_states)rr{rprzip) rrrrrr@rrresultr( old_param new_params r*can_safely_patchrs//-k]:UVVV:)-8)(3 >  6{c&k!+6: !O O\ \)&:LM  T>; 23v;-tCK=QQQ!$F 3 f y0 1i6GSYIZ5[ [i'%26%B" 1&BT U T>;&K &(9'::MNN N ] #Im,DK &(9'::]^^ ^ ( "y'>)LBY'Y)F+,,M&'u&' )) )!4( O :5aS999:sD44 E>E E E target_obj attr_namecN[US5(a URnOF[US5(aURRnO[[ U5R5n[US5(a)UR R S5SnSUSUSU3$SUSU3$)z; Generate a unique name for storing the original function. r9 __class__rR.r _original__)rar9rr)rorRsplit)rrobj_name module_names r*rrsz:&&&& [ ) )''00tJ'001z<(( ++11#6r: K=(1YK@@H:Qyk22r,forcestore_originalc [X5(d2[(a&[R"SUSUR35 g[ X5nUbr[ U5[La`[(dU[US5(a URn[US5(a URn[R"UUU[S9nU(a[X5n [X U5 U(dJ[XU5upU (d5[(a)[R"SURSUS U 35 g[XU5 [(a'[R "S URSUS35 g !["a>n [(a)[R"S URSUS U 35 Sn A gSn A ff=f)z' Patch a function/method on an object. Unsloth: Attribute '' not found on FNget_compiler_config) fullgraphdynamicoptionszUnsloth: Skipped rz Reason: zUnsloth: Patched TUnsloth: Failed to patch : )rar r#r(r9rIroboolr! __wrapped__rcompiler"rsetattrrinfor:) rrrrrrrrr unique_nameis_safereasonr@s r*rrs : ) ) ! ! LL/ {/*J]J]I^_ `J2MiD!8AXAX 82 3 3++H ="7 8 8)55M== !+    .zE  7 *=KP%% 01D1D0EQykQ[\b[cde x0 ! ! KK+J,?,?+@)AN O  ! ! LL4Z5H5H4I9+UWXYWZ[ \s6>E55 F=?4F88F= new_functionsc 0[X5(d2[(a&[R"SUSUR35 g[ X5n[ R"U5RR5n Sn Sn UHdn [ R"U 5RR5n SH,nX;dM X;dM[UUU UUUUUS9n U (a M`M. Mf U (d4[(a)[R"S URS US U 35 U $! [R"SUR35 g=f![an[U5n SnAMSnAff=f![an[U5n SnAMSnAff=f) z/Patch either past_key_value or past_key_values rrFzUnsloth: Cannot inspect r'N)past_key_valuepast_key_values)rrrrrrrrrrr) rar r#r(r9rIr5r6r7r3r:r)r)rrrrrrrrrold_keyssuccessr(runew_keysr@r>s r*rr2s : ) ) ! ! LL/ {/*J]J]I^_ `J2M$$]3>>CCEG E ((.99>>@H :C3?,%/$-#' %)7&1$-") Gw:0 -- 01D1D0EQykQSTYSZ[\ N? / 0C0C/DEF  FE  $!FEs<.D(.E E5(%E E2 E--E25 F? FFpatches fail_fastc 0nUHkupxn [US[U55SU3n [UUU UUUUS9n XU 'U(dM=U (aMF[(a[R "SU 35 U$ U$)z! Apply multiple patches at once. r9r)rrrrz2Unsloth: Stopping patch process due to failure on )rIr)rr r#r() rrrrrrresultsrrrr>rs r*patch_multiplerhsG+2' xZZAB!I;O   %!  9WW%% QRUQVWX  N%,3$ Nr,c[X5n[X5(d)[(a[R"SUSUS35 g[ X5n[ XU5 [X5 [(a[R"SU35 g![a1n[(a[R"SUSU35 S nAgS nAff=f) z- Restore original function if it was stored. z&Unsloth: No stored original found for z (looked for )FzUnsloth: Restored original TzUnsloth: Failed to restore rN) rrar r#r(rIrdelattrrr:)rrrrr@s r*restore_originalrs+:AK : + + ! ! LLA)MZeYffgh i  8  }5 ( ! ! KK5i[A B  ! ! LL6ykA3G HsAB C'CCc:/n[U5HnnURS5(dMURS5(aM3URS5SSn[U5S:dMXUSnUR U5 Mp [ [ [U555$)z8 List all stored original functions on a target object. r _original___rrNr)dir startswithrrprsortedrqr4)rstoredrparts method_names r*list_stored_originalsrsF_    - -i6J6J>6Z6ZOOC(,E5zQ#Bi  k*% $s6{# $$r,target_objs_and_attrscp0nUH-up#[US[U55SU3n[X#5X'M/ U$)z& Restore multiple original functions. r9r)rIr)r)rrrrr>s r*restore_multiplersGG!6 ZZAB!I;O' > "7 Nr,rZ)r)FTrNT)___all__r5typingrbrtextwraprrrrrrrrrttyping_extensionsutilsrcommonr r!r"r#_emptyr`r)r+r2rorrArstransformers.processing_utils ImportErrorr@r;r:rrrKtransformers.utils transformersrLtransformers_versionrM+transformers.modeling_flash_attention_utilsrNrPr(rtransformers.cache_utilsr r r r $transformers.tokenization_utils_baser rtransformers.image_utilsrrrr Parameter VAR_KEYWORDrrVAR_POSITIONALrr IntTensor FloatTensorrqdictr4Setrd frozenset FrozenSetretypes UnionTyperhr[rrrrrrrrrrrr1r,r*rsh" , ::D&&Obb  3  3   "     :5xxH4 V X&GFG&('   &%5  O3SRS3' P !"o5UTU5  # - ZO+KJK+.F 4jF /uu 6ee 5ee 5  ?IG UU 4uu ;=55?=%%1177%%44:: LL5<< OO5<< 5<< 166   166  155  1771;; 88O4 155155155155155 155!"155#$155155' * aee=#;S !aee=1B#C?*RaM:L,M?*RaM:N,O ?*RaM*,E %&WWM%//"5558*8*T#s(^0D*V! $Z! $Z! #Y!  UUUU 49 Ul333 3(; ; ; ;   ;  ;  ;  ; x2224>122  2  2  2 2f   %S(*+ ,   #t)_@ 2%c%d3i% DsCx,A d3PT9o mDCCr544  AA>!Cx   +a /S    l  8QA) )  A,H @#$ (>>HQQ- -   A,  *O+  77;VV'"V/4V7V?!W.Q9<R S*AS S*S%%S*-T93*T## T9,T44T9<U%U,/U47U<?VV VVV$'V,/V47V<?WW