ȅiM&SSKrSSKrSSKrSSKJr SSKJr SSKJr SSK J r SSK J r J r JrJr SSKrSSKJrJrJrJr \"S5r\R."\5r\ "S S \ \55r"S S \\ 5r"S S\5r"SS5rg)N)abstractmethod) defaultdict)Callable) dataclass)AnyGenericOptionalTypeVar) _BackendId_DynamoCacheEntry DynamoCachePrecompileCacheEntryTcb\rSrSr%Sr\\S'\\S'\S\ 4Sj5r S\ S\4SS 4S jr S r g ) BackendCacheArtifacta Represents a single serializable backend artifact from a dynamo backend. Each BackendCacheArtifact has a key associated with it along with some serializable content. Example implementation: class MyPrecompileCacheArtifact(PrecompileCacheArtifact[MySerializableType]): my_field: int def after_deserialization(self) -> MySerializableType: result = pickle.loads(self.content) # Do some extra work post deserialization result.my_post_deserialization_function(self.my_field) return result keycontentreturncg)z Code to be run after reading raw byte contents from disk. Generally converts self.content from raw bytes back into its original form. Nselfs Z/home/james-whalen/.local/lib/python3.13/site-packages/torch/_dynamo/precompile_context.pyafter_deserialization*BackendCacheArtifact.after_deserialization1s edit_fn.Nc2U"UR5Ulg)z$ Edit the contents of the artifact. Nr)rrs r edit_contents"BackendCacheArtifact.edit_contents9st||, rr )__name__ __module__ __qualname____firstlineno____doc__str__annotations__rrrrrr!__static_attributes__rrrrrsH" H L q  -Xc3h%7-D-rrc"\rSrSrS\4SjrSrg)EagerCacheArtifact@rcUR$Nr rs rr(EagerCacheArtifact.after_deserializationAs ||rrN)r#r$r%r&rrr*rrrr,r,@ssrr,c\rSrSrSrg)BypassDynamoCacheEntryErN)r#r$r%r&r*rrrr2r2Esrr2c \rSrSr%Sr0r\\\\ 4\ S'0r \\ \ 4\ S'\SSj5r\S\\ SS4S j5r\S \ S \ SS4S j5r\S \ S \S\ 4SS4Sj5r\S \ S\\\ 4Sj5r\S\\ \ 4S\\\\ 4S\\ \ 44Sj5r\S\\ \ 44Sj5r\S\\\ \4\\ \ 444Sj5rSrg)PrecompileContextIa PrecompileContext is a special CacheArtifactManager for handling precompilation It uses the same interface as CacheArtifactManager, but handles deserialization differently: instead of placing each artifact into respective caches, it will stitch all the cache artifacts for a single key together and place it into a global Precompile Cache. PrecompileContext has two main portions: dynamo_cache_entries and backend_cache_artifacts. When saving, PrecompileContext.serialize() will serialize all dynamo cache entries along with any PrecompileCacheArtifacts that are needed to save those dynamo cache entries. The following artifact types are supported by PrecompileContext: - BundledAOTAutogradCacheArtifact _backend_artifacts_by_key_dynamo_cache_entriesrNclURR5 URR5 gr/)r7clearr8)clss rr:PrecompileContext.clearbs& %%++- !!'')rartifactcSSKJn U"5 [R"U5UR[ UR 5'SSS5 g!,(df  g=f)zA Records a backend artifact to be used with dynamo cache entries r) no_dispatchN)torch.utils._mode_utilsr?copydeepcopyr7r r)r;r=r?s rrecord_artifact!PrecompileContext.record_artifactgs< 8 ]FJmmGC ) )*X\\*B C]]s 7A A cache_entryrc XRU'gr/)r8)r;rErs rrecord_dynamo_cache_entry+PrecompileContext.record_dynamo_cache_entryys*5!!#&rr.cXR;d SUS35eUR[U5nURU5 g)z* Edit the content of an existing artifact zKey z not found in artifactsN)r7r r!)r;rrr=s r edit_artifactPrecompileContext.edit_artifactsG 333XtC5@W5XX300CAw'rcLURR[U5S5$)z; Return the backend cache artifact with the associated key N)r7getr )r;rs rserialize_artifact_by_key+PrecompileContext.serialize_artifact_by_keys! ,,00C$GGrdynamo_entriesbackend_artifactsc[[5nUR5H-up4UR5nX5S'USR U5 M/ UR 5H!nUSR UR 5 M# U$)z Return a JSON serializable debug dump of all entries in the precompile context Called in serialize before serialization, and in populate_caches after deserialization rdynamobackends)rlistitems debug_infoappendvaluesr)rPrQrWrrEinfor=s rdump_debug_info!PrecompileContext.dump_debug_infos3>d2C . 4 4 6 C))+DK x ' ' -!7 *002H z " ) )(,, 73rcUR5upUR5Hup4[R"XC5 M U$r/)create_cache_entriesrVr write)r;precompile_cache_entriesrWrentrys rsave_to_dynamo_cache&PrecompileContext.save_to_dynamo_caches=/2/G/G/I, 288:JC   e );rcX^ ^ URnURn[U5n[R X5n[ R "UUS.5m [RRSSU 4SjSS9 0nUR5H%upg[R"Xr5nUbXU'M%M' XT4$![ahn [RSUS S 9 U n [ R "U[!U 5S .5m [RRSS U 4S jS9 Sn A MSn A ff=f)zt Grabs all the cache entries in the precompile context and stitches them together into full PrecompileCacheEntries. ) num_entries artifactsr=c SSS.$)Ndynamo_cache_entriesjsonnameencodingrrrr8PrecompileContext.create_cache_entries..s ."!rc>T$r/r) debug_strsrrmrnsyrF) metadata_fn payload_fnexpect_trace_idNzFailed to create cache entry %sT)exc_info)rerrorc SSS.$)Ndynamo_cache_exceptionrirjrrrrrmrns 8$*)rc>T$r/r)datasrrmrnstr)rqrr)r8r7lenr5r[ridumpstorch_loggingtrace_structuredrVrfrom_cache_entry Exceptionloggerwarningr() r;rPrQ num_artifactsrWr`rrEresulteruryrps @@rr^&PrecompileContext.create_cache_entriessF2299N+ &66  JJ,'  '' )! ( $& . 4 4 6 C ->>%4:S1& !74(33' @#PTUzz"!$U //! , 0% sB77 D)AD$$D)r)rN)r#r$r%r&r'r7dictr rrr)r8r(r classmethodr:rCrGrrJr rN staticmethodr[rbtuplerr^r*rrrr5r5Is $NPtJ0DS0I$IJO;=4%6 67<**&s+ "5+5255 55 ((hsCx.@(T((HCHH=QRU=V4WHH S"334 ,@,E EF c3h(T#s(^ ;4 tC--.S#X> ?;4;4rr5)rAriloggingabcr collectionsrcollections.abcr dataclassesrtypingrrr r r|torch._dynamo.packager r r rr getLoggerr#rrr,rr2r5rrrrs #$!22  CL   8 $ !-71:!- !-H-c2  Y ^4^4r