ȅi,SSKJr SSKJr SSKrSSKJr SSKJr SSK J r SSK J r J r SSKJrJr S S KJrJrJr S S KJrJrJrJrJrJrJrJrJrJr S \S \ S\ S-4Sjr!S \S \ S\S\ S\ S\ S\ S\ S\ S\"S\"S\ S-S\4Sjr#S \ S\$\\%\ \ 44S\$\\%\ \ 44S\S\ S\ 4 Sjr&S\S\S \ S!\S"\RN\(-S#\RN\"-S$\ S\4S%jr)S\S&\S\\*\-S'\ S \ S!\S(\ S\S)\$\ \+\4S\\*\-4S*jr,S\S'\ S \ S!\S\4 S+jr-S,\S'\ S-\"S\.4S.jr/S/\\*\-S0\\*\-S-S,\S'\ S \ S(\ S\4S1jr0S/\\*\-S0\\*\-S-S\S'\ S \ S(\ S\4S2jr1S8S3\ S'\ S4\ S \ S5\$\ \%\\44S\S6\.S)\$\ \+\4S-S\ 4S7jjr2g)9)Callable)AnyN)get_node_type_to_io_type_map)get_new_attr_name_with_prefix)_is_activation_post_process) GraphModulemap_arg)GraphNode)NSNodeTargetTypeNSSingleResultValuesType NSSubgraph) get_arg_indices_of_inputs_to_log$get_node_first_input_and_output_typeget_node_input_qparamsget_normalized_nth_inputget_number_of_non_param_argsget_target_type_strgetattr_from_fqnNodeInputOrOutputTypeop_type_supports_shadowingreturn_first_non_observer_nodenodegmreturncjSn[US5(aUnURS:Xaq[UR[5(d![ S[ UR535e[XR5n[U5(a [XS5nURURSnU$)N_node_name_to_scope call_moduleExpected str, got r) hasattrop isinstancetargetstrAssertionErrortyperrrrname)rrfqnnode_to_use_for_fqnmodules U/home/james-whalen/.local/lib/python3.13/site-packages/torch/ao/ns/fx/graph_passes.py_maybe_get_fqnr-s Cr())# 77m #dkk3//$'9$t{{:K9L%MNN%b++6F*622&>t&K#$$%8%=%=>qA J logger_clslogger_node_name_suffix ref_node_name model_nameref_nameref_node_target_type results_typeindex_within_arg index_of_argr)c [URU-5"U5n [X5n U"UURUUU UUU U U 5 n[XU5 URR SX405nU$)z Given a starting graph of prev_node -> node -> next_node This function creates a new logger_cls obj and adds it after node, resulting in prev_node -> node -> logger_obj -> next_node r)rr(rsetattrgraph create_node)rrr/r0r1r2r3r4r5r6r7r)logger_node_name target_type logger_obj logger_nodes r,_insert_logger_after_noder@,s25 ++ &d/K   J B*-**((8H'SUVK r.*node_to_instrument_inputs_to_ref_node_name+node_to_instrument_outputs_to_ref_node_namec^[5n0mU4SjnURRGHnURS:Xa'UR [ [ XpS5U55 M;Xq;dXr;Ga[Xp5nXq;Ga(UUup[U5n U GHn [ XpU 5n [U 5[LaTTU Rn[UUUSURUU U [RRSU US9 TU R'Mv[U 5[ R"R$R&LdM[)U 5HXunnTURn[UUUSURUU U [RRUU US9 TUR'MZ GM UR+Xv5TUR'Xr;aZUUup[TURUUSURUU U [R,RSSUS9 TUR'GMGMUR+Xv5TUR'GM [/X5nU$)z Takes the graph of gm, adds loggers to the output of each node in nodes_to_instrument. Returns a GraphModule with the new graph. c$>[UU4Sj5$)Nc">TUR$Nr()renvs r,8add_loggers_to_model..load_arg..ms s499~r.r )arHs r,load_arg&add_loggers_to_model..load_arglsq566r.outputr _ns_logger_r6r7r))r r:nodesr"rOr rr-rr'r r(r@r NODE_INPUTvaluetorchfximmutable_collectionsimmutable_list enumerate node_copy NODE_OUTPUTr)rrArBr/r2 new_graphrMrr)r3 ref_node_typearg_indices_to_log node_arg_idxnode_arg prev_nodearg_idxargnew_gmrHs @r,add_loggers_to_modelre\sCIC7 77h    W%=d%JHU V   >  ? *CA*T+'&Fd%K"$6L7,OHH~-$' $6 -F%&) II&$)4??EE-.)5 # .HMM*X%((*H*H*W*WW-6h,?LGS(+CHH I2K ) " * - $ * ( - 8 C C I I18-9$' 3C /-@/%7T'00@C NB*U+'"; N!II!,88>>%&!" "DII C*'00@C Nil 'F Mr. prev_node_cnode_agm_bgraph_cscale zero_pointdtype_cast_namecf[URS-5"U5n[X'U5 URSUS0U5n[URS-5"U5n [X)U5 URSU S0U 5n URS[R XU [R 40U5$)N _input_scale_get_attr_input_zero_point_ call_function)rr(r9r;rUquantize_per_tensorquint8) rfrgrhrirjrkrlscale_node_name scale_nodezero_point_node_namezero_point_nodes r, _insert_quantize_per_tensor_noderys4FKK/4QRSWXO D5)$$OR_J9 **   D 3))("b2FO    !! /5<<@   r.node_cgm_anode_name_prefixnode_type_to_io_type_mapc DSn Sn Sn Sn Sn Sn[XXx5unn[XXx5unnU[R:XaU[R:XdPU[R:XaU[R:Xd(U[R:Xa%U[R :Xa[ Rn OUU:Xa/U[R:wa[ RRn OU[R:Xa8U[R:Xa$[XU5nUb[ Rn UupOrU[R:Xa'U[R:XaSn [ Rn O7[SUSUR5S3USUR5S3-5e[!U["5(a[%U5"U5nU (a-U bUb['UUUUU UU5$UR)SU U40U5$U (aUR)SU X,40U5$U (d [S 5eU "5n[+UUU5 UR)S UU40U5$[!U[,5(a/nUHn[%U5"U5nU (a)UR)SU U40U5nUR/U5 MDU (d [S 5eU "5n[+UUU5 UR)S UU40U5nUR/U5 M U$[S [1U5S 35e) a Given a starting graph C (derived from graph B) of ... -> prev_node_c -> node_c -> ... And a corresponding related node_a, inserts the correct dtype cast node after prev_node_c to cast into the dtype expected by node_a, resulting in: dtype_cast / ... -> prev_node_c -> node_c -> ... For example, if node_c is an int8 op and node_a is an fp32 op, this function will insert a dequant. Ntozdtype cast from  z to z needs to be implementedrr call_methodz*Expected dtype_cast_mod_cls to be not Nonerztype fz is not handled)rrFP32INT8FP16 FP32_OR_INT8rU dequantizeUNKNOWNnnIdentityrrsfloat16r& format_noder#r rryr;r9listappendr')rgrzrfr{rhrir|r/r} dtype_cast_opdtype_cast_mod_clsdtype_cast_methoddtype_cast_method_dtypedtype_cast_scaledtype_cast_zero_pointnode_input_type_a_node_output_type_anode_input_type_c_node_output_type_cnode_a_input_qparamsnew_dtype_cast_namedtype_cast_modresultsprev_node_c_innernew_dtype_cast_nodes r,_insert_dtype_cast_after_noders|6M" -Qj.**.Rj.** !6!;!; ;!%:%?%?? !6!;!; ;!%:%?%?? !6!;!; ;!%:%G%GG(( .. !6!>!> >"XX..2777 !6!;!; ; 6 2  +!55M6J 3 2777 !6!;!; ; "'--0163E3E3G2H M"#1V%7%7%9$::RS T  +t$$;&&##   K & &!, "?@P"QRV"W &-&9&9#!&(' '#23)()UVV!3!51>B&-&9&9!'&(' '#231"-2vd;&7%8HIIr.c URS:Xa[URS-5"U5n[XR5n[ R "U5(aUR5n[X$U5 URURUS0U5nU$URS:XGaURS;a[SURS35eURS:Xaa[[XS 5XU5n[URS-5"U5nURURURU40U5nU$[[XS 5XU5n[URS-5"U5nURURURU[XS 540U5nU$[S UR5S URS35e) z# Simple copy of node_a to graph_c. ro _shadow_copy_rprrrztarget  is not implementedrrr zhandling of node z with op )r"rr(rr$rU is_tensordetachr9r;r&_copy_node_from_a_to_crr)rgr{rhrinode_a_copy_name node_a_obj node_a_copyarg_copys r,rrsyyJ89VW  &dMM: ??: & &#**,J 3)) II'R1A  m # == 4 4 76==/9L!MN N ==L (-(q94wH = o-   "-- 6==8+r;KK -(q94wH = o-   "--  3F!DE K  2 2 45YvyykI\ ]  r. subgraph_anum_non_param_args_node_ac/nURnX@R:wa.URU5 [XAS5nX@R:waM.URU5 UR 5 SnUHnXcSLaUOSnUR USS9nUbUupOUR URpSn U [U 5:a<U S:XaOU S:XaUS:XaOU"XU5(d gU S- n U [U 5:aM<U R5H,n U S:XaOU S:XaUS:XaOU"X5(d gU S- n M. M g)z This function returns `False` if the input subgraph cannot be copied by `_insert_copy_of_subgraph_a_after_input_node_c`. This usually means that there is a corner case logic for which copy is not yet implemented. rc[U[5(a<[X5nURS:XaURS;$URS:Xagg[U[ [ 45(a UHn[U[5(aM g g)NrrroTF)r#r rr"r$rtuple) node_a_argr{arg_aels r, _can_insert3_can_insert_copy_of_subgraph_a.._can_insertsw j$ ' '2:DExx=(||';;;Z'  T5M 2 2 !"d++ !r.r Tnormalize_to_only_use_kwargsF) end_node start_noderrreversenormalized_argumentsargskwargslenvalues) rr{rrRcur_noderrglocal_num_non_param_args_node_anorm_args_kwargs norm_args norm_kwargscur_idx kwarg_vals r,_can_insert_copy_of_subgraph_arse E""H ++ + X+HA> ++ + LL MMO ")/8); % ("66 t7   '%5 "I{%+[[&--{I&!|A"AQ"F"9#5t<< qLGI&%++-I!|A"AQ"F"933 qLG.3H r. input_node_cinput_node_c_2c [U[[45(d[S[ U535eUR /nUR nXrR :wa/[XsS5nURSU5 XrR :waM/USn[XXXE5n [S[U55Hn XjnU n [U SUUUU5n M U $)z" TODO(before land): real docblock zExpected Node or list, got rr N) r#r rr&r'rrrinsert)_insert_copy_of_node_a_after_input_node_cranger) rrrr{rhr| nodes_of_ar cur_node_a cur_node_c cur_idx_arfs r,-_insert_copy_of_subgraph_a_after_input_node_crs lT4L 1 1:4 ;M:NOPP%%&J""H ++ ++HA>!X& ++ + AJ:jJ1c*o. *  >       / r.c^^^^[U[5(a URmO;[U[5(d[ S[ U535eUSRmUR TSS9nUbUupxOURURp/n 0n UUUU4Sjn Sn U [U5:aFU S:XaUn OU S:XaUbUn O U "X|5n U RU 5 U S- n U [U5:aMFUR5H.unmU S:XaX U'OU S:XaUbXU'O U "T5X'U S- n M0 [U 5n [U5"T5nURS:Xa[U5"T5n[UR[ 5(d![ S[ UR535e[#TUR5n[%TUU5 TR'URUU U U5nU$URS ;a[ S UR35eTR'URURU U U5nU$) a Assume that node_a from graph_a has args (input, (input2)?, arg1, ...), and kwargs {kw0: kwarg0, ...} Note: input2 is optional. If it equals to None, we assume that the op has a single non-param input. If it is specified, we assume that the op has two non-param inputs. Copies the underlying values of arg1..argn and kwarg0..kwargn into gm_b, and creates the corresponding nodes in graph_c. Note: observers are ignored, so if an arg is an observer we navigate up until we find a non-observer parent. If node_a is a call_module, points the module pointed to by node_a to gm_b. Creates the copy of node_a in graph_c, with input as the first arg, and all other args and kwargs pointing to the copies of the objects in gm_b created above. An example in pictures: graph A: ======== input -------------> node_a / / / (input_2)?----------/ / / / / weight -> weight_obs / / bias ---------------- graph C (derived from B): ========================= input_node_c --> node_a_copy / / / (input_node_c_2)? / / / / weight_copy ----/ / / bias_copy ------/ Expected list, got rTrcz>[U[5(a[UT5n[UTTT5nU$[U[[ [ R45(aU$[T[[45(a+TH#n[U[5(dM[S5e U$[S[T5S35e)Nz/handling of Node inside list is not implementedzhandling for kwarg of type r) r#r rrintfloatrUdtyperrr&r')rcrr{rhrirs r, _copy_arg<_insert_copy_of_node_a_after_input_node_c.._copy_args c4 0d;C(dD'BCJ c5%++6 7 7J  D%= 1 1b$''(I J -d9o->>QR r.r rr )rrrzUnexpected op: )r#r r:rr&r'rrrrritemsrrr"r$r%rr9r;)rrrgr{rhr|rrrnew_args new_kwargsrrnew_arg kwarg_namenode_a_shadows_c_namenew_mod_copy_namemod_anode_a_shadows_crirs `` @@r,rr<sYf,%%$$,-- #6tL7I6J!KL Lq/''22 43#!1 ;!'fmm;HJ(G C N " a<"G \n8$G 23G 1  C N ""-!2!2!4 I a<%1z " \n8%3z "%.y%9J "1 "5XH9:JKDQ yyM!9:JKDQ&---- #5d6==6I5J!KL L v}}5'/".. II    !    99< < ?699+!>? ?".. II MM   !   r.name_aname_bmatched_subgraph_pairsshould_log_inputsc^3Uc [5n[5n0m3U34Sjn 0n 0n UR5HYupU up[URU5n[URU5nUU UU4XR 'UU UU4XR 'M[ URRGHnURS:Xa*UR[URSU 55 M>UU ;nUU ;nU(dU(GaU(a U UunnnnOU(d [S5eU Uunnnn[UR 5=(a [U5nU(dW[S[UU53S[UR U53-S-5 UR!UU 5T3UR"'GM [%UR XU5unn[%UX5U5unnU[&R(:g=(aG U[&R(:g=(a- U[&R(:g=(a U[&R(:gnU(dW[S[UU53S[UR U53-S -5 UR!UU 5T3UR"'GMU[&R*:XaU[&R,:Xat[/UR X5nU(dW[S[UU53S[UR U53-S -5 UR!UU 5T3UR"'GM[1UR U5n[3XU5(dW[S[UU53S[UR U53-S -5 UR!UU 5T3UR"'GM [5URU5n[5WRU5nU(Ga"U(Ga[7UUS5n [9U [:5(aST3U R"n![=U!UUS UR"UUU[>R@RBSSUS 9 T3U!R"'O[9U [D5(axU V"s/sHn"T3U"R"PM n#n"[GU#5HIun$n![=U!UUS UR"UUU[>R@RBU$SUS 9 T3U!R"'MK O[S[IU 5S35eU(dU(a.UR!UU 5T3UR"'T3UR"n%U(Ga[7W%US5n!U(aU[9U![:5(a[7U%US5n!O2[9U![D5(aU!V"s/sHn"[7U"US5PM n!n"[KUR U%U!UUUUR"S-UU5 n&U(aSn'[9U&[:5(a/[=U&UUSU'UUU[>R@RBSSUS 9 n&U&n(O[9U&[D5(d[S[IU&535e/n)[GU&5HCun*n+[=U+UUSU'UUU[>R@RBU*SUS 9 n,U)RMU,5 ME U)n&U&n(Sn-[1UR U5nUS:Xa [7U%US5n-[OU&U-UUUU%R"S-5n.U.T3U.R"'U(aU.n/[7U/US5W(:wa [7U/US5n/[7U/US5U(:waM [9U([:5(a([QUU(R"5n0U/R"U0l)O\[9U([D5(d[S[IU(535eU(H*n1[QUU1R"5n0U/R"U0l)M, [=T3U.R"UUSU.R"UUU[>RTRBSSUS 9 T3U.R"'U(aS[=T3UR"UUSUR"UUU[>RTRBSSUS 9 T3UR"'GMGMUR!UU 5T3UR"'GM [WX85n2U2$s sn"fs sn"f)aI Creates a new GraphModule consisting of the graph of C, with the meaningful nodes of A shadowing the corresponding nodes of B. For example, Graph A: a0 -> op0_fp32 -> a1 -> op1_fp32 -> a2 Graph B: b0 -> op0_int8 -> b1 -> op1_int8 -> b2 matched_node_pairs: {'op0': (op0_fp32, op0_int8), 'op1': (op1_fp32, op1_int8)} Graph C (A shadows B): / dequant0 -> op0_fp32 -> logger_a_0 / dequant_1 -> op1_fp32 -> logger_a_1 / / b0 -------------> op0_int8 -> logger_b_0 --------------> op1_int8 -> logger_b_1 In a nutshell, this function does the following for each node pair: * copies the necessary attributes and modules from gm_a to gm_b, keeping names unique * adds a dtype cast op (dequant, quant, etc) * adds a copy of node_a in gm_b's graph * adds loggers to the outputs of node_a and node_b Nc$>[UU4Sj5$)Nc">TUR$rFrG)renv_cs r,rI6create_a_shadows_b..load_arg..suTYY'7r.rK)rLrs r,rM$create_a_shadows_b..load_argsq788r.rOrz+Expected node_b_is_end_node to be not falsez$skipping shadow loggers for node_b: z, start_node_a: z , unsupportedz, unknown dtype castz, unknown input qparamsz", unhandled logic in subgraph copy_ns_logger_b_inp_rQztype z is not handled yet _dtype_cast__ns_logger_a_inp_rrr r _ns_logger_a_ _ns_logger_b_),rr rr base_op_noderrr:rRr"rOr rr&rprintrZr(rrrrrrrrr-rr#r r@rrSrTrrYr'rrrgetattrr1r[r)4rr{rrhrr/rr}rirM+start_node_b_to_matched_subgraph_a_and_name)end_node_b_to_matched_subgraph_a_and_name match_namematchr subgraph_bref_node_type_aref_node_type_bnode_bnode_b_is_start_nodenode_b_is_end_noder3all_op_types_support_shadowingrnode_output_type_anode_input_type_bnode_output_type_bnode_io_types_known_a_and_brr fqn_base_a fqn_base_b prev_node_brfrcprev_node_c_listrbrzdtype_cast_noder1 input_logger new_loggersdtype_cast_idxdtype_cast_node_innerdtype_cast_loggernode_c_second_non_param_argrrinput_logger_modinput_logger_innergm_crs4 @r,create_a_shadows_brst H '#?#A gGE935/02-399; !& -j.E.EtL-j.E.EtL     N 34I4IJ     J 12E2EF<"**"" 99 NN76;;q>8< =  &)TT#'PP #5# @G ##*()VWW >fE ##.H%%..5,V4 +2:;NvW[;\:]^())F)FFH'*?*G*GG ( /:;NvW[;\:]^())C)CC'=))4($,>?RSY[_?`>ab,-@AVAVX\-],^_`34 *1):):68)LE&++&(D%%t) %2";:;NvW[;\:]^()N4O0G[6O + $ * 3 & & ( / 8 C C I I18-.$. 7E+"2"235P"-#D$5#66IJ$'9%,%6%6vx%Hfkk"v{{+$7vtQG $!+t44&>vtQ&O #K66(3''25S$B'2$'#@))KK.0, #,%$&M!/488*C+ &/)"$+4??EE-.)* * +;J )/4@@"0"5d?6K5L M#') EN+FAN,A1J 5 $ * 3 - & ( / 8 C C I I1?-.$. 1-(../@A#F$+6'6 /3+,H))4-)-12J 3/ $Q#/KK/1$ 0@&++,% 0H28T1EU#;HdA#N38T1EU",55+249J9J+K(9A(6 *,=="0"5d<6H5I J# 3?./6t=O=T=T/U,=E]],:3? 0I*//0#$))#,88>>%&!"" 0&++,("%>&++&#KK#,88>>%&!"" &fkk""4")!2!268!DE&++ e #h t %D Kk,Tl's ?b;crF)3collections.abcrtypingrrUtorch.ao.ns.fx.mappingsrtorch.ao.quantization.fx.utilsrtorch.ao.quantization.observerrtorch.fxrr torch.fx.graphr r ns_typesr rrutilsrrrrrrrrrrr%r-rr@dictrreTensorrryrsetrrboolrrrrrpr.r,r!s$ @HF)&LL   ;3:"- ---! -  -  ------ t- -`jj04T5c?5J0Kj26dE#s(O6K1Lj j  j  jZ    <<%    s"  B^J ^J ^JT "^J  ^J  ^J  ^J^J^J#3,<(=#=>^J DJ^JD6 6 6  6  6  6 rHH H #H HV)d#)4:%,))  )  )  ) )XM d#M 4:%,M  M   M  M  M  M pIMw w w w  w !eJ ,B&C!CD w  ww#3,<(=#=>Ewwr.