΅iG %SrSSKrSSKrSSKJr SSKJr SSKrSSKJr SSK J r SSK J r SS K Jr \Rr\R rS r\\R&R(S 4\S 'S q/q\\\/S4\\4\S'\R4"5r\R8"5r\ "5q\"\R&S5(a\R&R@r!O S\"S\"4Sjr!\"\R&S5(a\R&RFr$O S\"S\"4Sjr$Sr%Sr&Sr'S\(4Sjr)SESjr*"SS\+5r,S\(4Sjr-S\(4Sjr.SFS\ SS4Sjjr/S\"4Sjr0S\"4S jr1SFS\ S\4S!jjr2SFS\ S\4S"jjr3SGS#\S-S$\S%\"SS4S&jjr4S\5\\44S'jr6S(\\"\"\"\"/S4SS4S)jr7SHS*\(4S+jjr8SFS\ S\\"\"44S,jjr9SES-jr:S.\4S/jr;S\ SS4S0jr"S3S45r?S5r@S.\S-S\?4S6jrASIS\ S\4S7jjrBS\\4S8jrCSIS9\S\ SS4S:jjrDS;\\SS4S<jrES=\"SS4S>jrFS=\"SS4S?jrGS\"4S@jrHS\"4SAjrIS\"4SBjrJSSCKK7 SSCKL7 /SDQrMg)JzH This package enables an interface for accessing MTIA backend in python N)Callable)Any)Tensor)_LazySeedTracker)Device)_get_device_index.default_generatorsF _queued_calls_mtia_exchangeDevicedevicereturnc&US:ag[S5eNrz)PyTorch was compiled without MTIA support RuntimeErrorrs M/home/james-whalen/.local/lib/python3.13/site-packages/torch/mtia/__init__.py_exchange_devicer( A:FGG_mtia_maybeExchangeDevicec&US:ag[S5errrs r_maybe_exchange_devicer2rrc[5 gN) _lazy_initr rrinitr 8sLrc:[=(a [5(+$)z9Return whether PyTorch's MTIA state has been initialized.) _initialized_is_in_bad_forkr rris_initializedr$<s  1 111rc [ [5(aU"5sSSS5 $URSS5(a*[R U[ R "55 OkURSS5(a*[RU[ R "55 O*[RU[ R "545 SSS5 g!,(df  g=f)Nseed_allFseed) _initialization_lockr$get_lazy_seed_trackerqueue_seed_all traceback format_stack queue_seedr append)callablekwargss r _lazy_callr2As    :   zz*e,,"11(I[RR5$r)torch_C_mtia_isInBadForkr rrr#r#Os 88 % % ''rc [5(d[[S5(ag[ [5(a SSS5 g[ 5(a [ S5e[ 5(d [S5e[RR5 S[l [RS[R555 [H upU"5 M [)[S5 SqSSS5 g![ a1nS[#U5SSR%U53n['U5UeSnAff=f![)[S5 f=f!,(df  g=f) Nis_initializingzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia.dynamic_library` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!Tc36# UHo(dM Uv M g7frr ).0callss r _lazy_init..usX0NuRWUU0Ns  z6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: )r$hasattr_tlsr(r#r _is_compiledAssertionErrorr4r5 _mtia_initr8r extendr* get_calls ExceptionstrjoinDeferredMtiaCallErrordelattrr") queued_callorig_tracebackemsgs rrrSsH74):;;          I ~~ *   $X0B0L0L0NXX -/<+ <M0= D+ , Y  H!<PQTUVQWPXYCCE77>CZB[]04!; < D+ ,W  sNEB E ED%E)E D?,D::D??EEE E%c\rSrSrSrg)rIr N)__name__ __module__ __qualname____firstlineno____static_attributes__r rrrIrIsrrIc>[RR5$)z*Return true if compiled with MTIA support.)r4r5 _mtia_isBuiltr rrrArAs 88 ! ! ##rc<[5(dg[5S:$)z'Return true if MTIA device is availableFr)rA device_countr rr is_availablerZs >> >A rc[RRU5 [RR 5sSSS5 $!,(df  g=f)z?Waits for all jobs in all streams on a MTIA device to complete.N)r4mtiarr5_mtia_deviceSynchronizers r synchronizer^s0   6 "xx//1 # " "s A Ac>[RR5$)z,Return the number of MTIA devices available.)r4r5_mtia_getDeviceCountr rrrYrY 88 ( ( **rc>[RR5$)z0Return the index of a currently selected device.)r4r5%_accelerator_hooks_get_current_devicer rrcurrent_devicerds 88 9 9 ;;rcP[RR[USS95$)a;Return the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Toptional)r4r5_mtia_getCurrentStreamr rs rcurrent_streamri! 88 * *+[RR5$)z4Return a dictionary of MTIA memory allocator history)r4r5_mtia_memorySnapshotr rrsnapshotrvrarobservercB[RRU5 g)z9Attach an out-of-memory observer to MTIA memory allocatorN)r4r5_mtia_attachOutOfMemoryObserver)rws rattach_out_of_memory_observerrzs HH,,X6rincluding_emulationcg)zLReturn a bool indicating if the current MTIA device supports dtype bfloat16.Tr )r{s ris_bf16_supportedr}s rcP[RR[USS95$)aReturn capability of a given device as a tuple of (major version, minor version). Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Trf)r4r5_mtia_getDeviceCapabilityr rs rget_device_capabilityr" 88 - -.?QU.V WWrc>[RR5$)zEmpty the MTIA device cache.)r4r5_mtia_emptyCacher rr empty_cachers 88 $ $ &&rstreamcJUcg[RRU5 g)aSet the current stream. This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)r4r5_mtia_setCurrentStreamrs r set_streamrs~ HH##F+rcf[U5nUS:a [RRU5 gg)zSet the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. rN)r r4r5%_accelerator_hooks_set_current_devicers r set_devicers,v &F { 66v>rcP[RR[USS95$)zReturn a dictionary of MTIA device properties Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Trf)r4r5_mtia_getDevicePropertiesr rs rget_device_propertiesrrrcB\rSrSrSrS\4SjrSrS\S\S\4SjrS r g ) rizContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. c0[USS9UlSUlg)NTrfr)r idxprev_idx)selfrs r__init__device.__init__"s$Vd; rc`[RRUR5Ulgr)r4r5(_accelerator_hooks_maybe_exchange_devicerr)rs r __enter__device.__enter__&sII$((S rtypevaluer,c`[RRUR5Ulg)NF)r4r5rrr)rrrr,s r__exit__device.__exit__)s88DDT]]Sr)rrN) rQrRrSrT__doc__rrrrrUr rrrrs3sTSrcZ\rSrSr%Sr\S-\S'S\S-4SjrSrS\ S \ S \ 4S jr S r g) StreamContexti.aContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. N cur_streamrcSUlXl[SS5Ul[R R 5(dURcSUl[R R 5(dSO[RRS5Ul [R R 5(dSUl g[RRS5Ul g)NTr) rrr rr4jit is_scriptingr\rmsrc_prev_streamdst_prev_stream)rrs rrStreamContext.__init__<s $T40yy%%''xx ..00Dejj6O6OPT6U  ..00D 6;jj6O6OPT6U rcURnUbURS:Xag[RR S5UlUR R UR :waL[ UR 5 [RR UR 5UlSSS5 [RRU5 g!,(df  N.=fNr) rrr4r\rirrrr)rrs rrStreamContext.__enter__Ks[[  R $zz88>    & &**;*; ; ))*',zz'@'@ARAR'S$+ j)+*s >/C C#rrr,c0URnUbURS:XagURRUR:wa)[R R UR5 [R R UR5 gr)rrrrr4r\rr)rrrr,rs rrStreamContext.__exit__Zsj[[  R     & &**;*; ; JJ ! !$"6"6 7 d223r)rrrrr) rQrRrSrTrStream__annotations__rrrrrUr rrrr.sB    v}   * 4S 4 4 4rrcD[RRXU5 g)zset stream specified by the stream id, device index and device type Args: stream_id (int): stream id in stream pool device_index (int): device index in topo device_type (int): enum device type N)r4r5_mtia_setStream) stream_id device_index device_types r_set_stream_by_idrhs HHYkBrc[U5$)aWrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rrs rrrss   rcv[5 [USS9nUc [5n[UnUR 5$)aCReturns the random number generator state of the specified MTIA device as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). .. warning:: This function eagerly initializes MTIA. Trf)rr rdr get_state)rrdefault_generators r get_rng_stater~s<L FT 2C {*3/  & & ((rch[[55Vs/sHn[U5PM nnU$s snf)zRReturns a list of ByteTensor representing the random number states of all devices.)rangerYr)iresultss rget_rng_state_allrs/).|~)>?)>A}Q)>G? N@s/ new_statec"^^[5(dD[RR5 TR [R S9mSSS5 [ USS9mTc [5mUU4Sjn[U5 g!,(df  N8=f)a$Sets the random number generator state of the specified MTIA device. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). ) memory_formatNTrfc:>[TnURT5 gr)r set_state)rrrs rcbset_rng_state..cbs.s3##I.r) r$r4r5_DisableFuncTorchclonecontiguous_formatr rdr2)rrrrs` @r set_rng_statersm    XX ' ' )"e6M6MNI* FT 2C {/rN* )s B B new_statescB[U5Hup[X!5 M g)zSets the random number generator state of all devices. Args: new_states (Iterable of torch.ByteTensor): The desired state for each device. N) enumerater)rrstates rset_rng_state_allrs j)e*rr'c<^[T5mU4Sjn[USS9 g)auSets the seed for generating random numbers for the current MTIA device. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. Args: seed (int): The desired seed. .. warning:: If you are working with a multi-GPU model, this function is insufficient to get determinism. To seed all GPUs, use :func:`manual_seed_all`. cN>[5n[UnURT5 gr)rdr manual_seed)rrr's rrmanual_seed..cbs$.s3%%d+rTr'Nintr2r'rs` rrrs t9D, rrc<^[T5mU4Sjn[USS9 g)zSets the seed for generating random numbers on all MTIA devices. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. Args: seed (int): The desired seed. cn>[[55Hn[UnURT5 M gr)rrYr r)rrr's rrmanual_seed_all..cbs-|~&A 21 5   ) )$ /'rTr&Nrrs` rmanual_seed_allrs t9D0 rD!rcSn[USS9$)adSets the seed for generating random numbers to a random number for the current MTIA device. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. .. warning:: If you are working with a multi-GPU model, this function will only initialize the seed on one GPU. To initialize all GPUs, use :func:`seed_all`. cH[5n[UnUR5$r)rdr r')rrs rrseed..cbs$.s3 %%''rTrr2rs rr'r's( bt $$rcSn[USS9$)zSets the seed for generating random numbers to a random number on all MTIA devices. It's safe to call this function if MTIA is not available; in that case, it is silently ignored. cSnSn[[55H8n[UnU(dUR5nSnM'UR U5 M: U$)NrFT)rrYr r'r) random_seedseededrrs rrseed_all..cbsT |~&A 21 5 /446 !--k: 'rTrrrs rr&r&s  b4 ((rcX[5 [5n[UR5$)zvReturns the current random seed of the current MTIA device. .. warning:: This function eagerly initializes MTIA. )rrdr initial_seed)rs rrrs% L  C c " / / 11r)*)#r rZr$r^rYrdrirm memory_statsmax_memory_allocatedmemory_allocatedreset_peak_memory_statsrrrsrvrzrrrrrrrrrrrr'r&rr} MTIAGraphgraphgraph_pool_handle)rNr)allpythonr)T)r\)Nr threadingr,collections.abcrtypingrr4r torch._utilsr torch.typesr_utilsr Eventrr tupler5 Generatorrr"r listrGlocalr@Lockr(r*r?r rrrrr r$r2boolr#rrFrIrArZr^rYrdrirmrsdictrvrzr}rrrrrrrrrrrrrrrr'r&rmemory mtia_graph__all__r rrrs$ )%   68E%((,,c127 t (2t8 d3i '( ~~'%' 588+,,xx44HHH  588011"XX??HsHsH 2 K((0f I $d$ d22$2 +c+ << U6 UV U U6 UV UMNE 4ZE),EFIE E&+$sCx.+ 7S#s+T127 74 X&XE#s(OX' ,v , ?v ?$ ?X&XDcNX(7474tC!6D=!]!)&)f)$4< VV2 $v, 4 cd*"#"$""%c%")#)*2c2$ r