΅ih.%SrSSKrSSKJr SSKJrJr \R"\5r "SS\5r \S\ S-4r \Sr 0q \\\ 4\S 'Sq\\\ 4S-\S 'S \\ -S \ S S4SjrS \\ -S S4SjrS \\4SjrS \S-4SjrSS\S S4Sjjrg)zRegistry for flash attention implementations. This module contains the registration system for flash attention implementations. It has no torch dependencies to avoid circular imports during initialization. N)Callable)LiteralProtocolc\rSrSrSSjrSrg)FlashAttentionHandleNcg)N)selfs V/home/james-whalen/.local/lib/python3.13/site-packages/torch/nn/attention/_registry.pyremoveFlashAttentionHandle.removescr )returnN)__name__ __module__ __qualname____firstlineno__r __static_attributes__r rr rrs!rr.FA4_FLASH_ATTENTION_IMPLS_FLASH_ATTENTION_ACTIVEimpl register_fnrcU[U'g)a Register the callable that activates a flash attention impl. .. note:: This function is intended for SDPA backend providers to register their implementations. End users should use :func:`activate_flash_attention_impl` to activate a registered implementation. Args: impl: Implementation identifier (e.g., ``"FA4"``). register_fn: Callable that performs the actual dispatcher registration. This function will be invoked by :func:`activate_flash_attention_impl` and should register custom kernels with the PyTorch dispatcher. It may optionally return a handle implementing :class:`FlashAttentionHandle` to keep any necessary state alive. Example: >>> def my_impl_register(module_path: str = "my_flash_impl"): ... # Register custom kernels with torch dispatcher ... pass # doctest: +SKIP >>> register_flash_attention_impl( ... "MyImpl", register_fn=my_impl_register ... ) # doctest: +SKIP N)r)rrs r register_flash_attention_implrs<$/4 rc[SS9 [RU5nUc[SUS[ 535eU"5nUbX4qgg)a# Activate into the dispatcher a previously registered flash attention impl. .. note:: Backend providers should NOT automatically activate their implementation on import. Users should explicitly opt-in by calling this function or via environment variables to ensure multiple provider libraries can coexist. Args: impl: Implementation identifier to activate. See :func:`~torch.nn.attention.list_flash_attention_impls` for available implementations. If the backend's :func:`register_flash_attention_impl` callable returns a :class:`FlashAttentionHandle`, the registry keeps that handle alive for the lifetime of the process (until explicit uninstall support exists). Example: >>> activate_flash_attention_impl("FA4") # doctest: +SKIP F) _raise_warnNzUnknown flash attention impl 'z'. Available implementations: )restore_flash_attention_implrget ValueErrorlist_flash_attention_implsr)rrhandles r activate_flash_attention_implr$=sk2!),,T2K,TF3**D*F)G I  ]F #'.rc<[[R55$)zBReturn the names of all available flash attention implementations.)sortedrkeysr rr r"r"fs (--/ 00rc.[b [S$[$)z Return the currently activated flash attention impl name, if any. ``None`` indicates that no custom impl has been activated. r)rr rr current_flash_attention_implr)ks# # . "%rrcSn[b [SnUbUR5 SqgU(a[RS5 Sqg)z( Restore the default FA2 implementation NzDTrying to restore default FA2 impl when no custom impl was activated)rr loggerwarning)rr#s r rrxsL F*(+   #  R #r)T)__doc__loggingcollections.abcrtypingrr getLoggerrr,r _RegisterFn_FlashAttentionImplrdictstr__annotations__rtuplerr$listr"r)boolrr rr r;s $$   8 $"8"s04778 en13S+-.3CGs$889D@G/ # #// /B&1 # #&1 &1R1DI1 cDj #d#d#r