+h7~SSKJr SSKrSSKrSSKJr SSKJrJr SSK J r SSK J r J r SSKJr "S S \\ \ 5rg) )OptionalN)nn) GPT2ConfigGPT2LMHeadModel)ModuleUtilsMixin) ConfigMixinregister_to_config) ModelMixinc( ^\rSrSrSrSS/r\S*S\S\S\\S\S \S \S \S \S \\S\ S\ S\ S\ S\ S\ S\ S\ S\ S\ 4&U4Sjjj5r S+S\ RS\ RS\\ RS\\ R4SjjrS\S\ R S \ R4S!jrS"r\ R&"5S#5r\ R&"5S,S$\S%\S&\ S'\\4S(jj5rS)rU=r$)-UniDiffuserTextDecodera Text decoder model for a image-text [UniDiffuser](https://huggingface.co/papers/2303.06555) model. This is used to generate text from the UniDiffuser image-text embedding. Parameters: prefix_length (`int`): Max number of prefix tokens that will be supplied to the model. prefix_inner_dim (`int`): The hidden size of the incoming prefix embeddings. For UniDiffuser, this would be the hidden dim of the CLIP text encoder. prefix_hidden_dim (`int`, *optional*): Hidden dim of the MLP if we encode the prefix. vocab_size (`int`, *optional*, defaults to 50257): Vocabulary size of the GPT-2 model. Defines the number of different tokens that can be represented by the `inputs_ids` passed when calling [`GPT2Model`] or [`TFGPT2Model`]. n_positions (`int`, *optional*, defaults to 1024): The maximum sequence length that this model might ever be used with. Typically set this to something large just in case (e.g., 512 or 1024 or 2048). n_embd (`int`, *optional*, defaults to 768): Dimensionality of the embeddings and hidden states. n_layer (`int`, *optional*, defaults to 12): Number of hidden layers in the Transformer encoder. n_head (`int`, *optional*, defaults to 12): Number of attention heads for each attention layer in the Transformer encoder. n_inner (`int`, *optional*, defaults to None): Dimensionality of the inner feed-forward layers. `None` will set it to 4 times n_embd activation_function (`str`, *optional*, defaults to `"gelu"`): Activation function, to be selected in the list `["relu", "silu", "gelu", "tanh", "gelu_new"]`. resid_pdrop (`float`, *optional*, defaults to 0.1): The dropout probability for all fully connected layers in the embeddings, encoder, and pooler. embd_pdrop (`float`, *optional*, defaults to 0.1): The dropout ratio for the embeddings. attn_pdrop (`float`, *optional*, defaults to 0.1): The dropout ratio for the attention. layer_norm_epsilon (`float`, *optional*, defaults to 1e-5): The epsilon to use in the layer normalization layers. initializer_range (`float`, *optional*, defaults to 0.02): The standard deviation of the truncated_normal_initializer for initializing all weight matrices. scale_attn_weights (`bool`, *optional*, defaults to `True`): Scale attention weights by dividing by sqrt(hidden_size).. use_cache (`bool`, *optional*, defaults to `True`): Whether or not the model should return the last key/values attentions (not used by all models). scale_attn_by_inverse_layer_idx (`bool`, *optional*, defaults to `False`): Whether to additionally scale attention weights by `1 / layer_idx + 1`. reorder_and_upcast_attn (`bool`, *optional*, defaults to `False`): Whether to scale keys (K) prior to computing attention (dot-product) and upcast attention dot-product/softmax to float() when training with mixed precision. zh\.\d+\.attn\.biaszh\.\d+\.attn\.masked_bias prefix_lengthprefix_inner_dimprefix_hidden_dim vocab_size n_positionsn_embdn_layern_headn_inneractivation_function resid_pdrop embd_pdrop attn_pdroplayer_norm_epsiloninitializer_rangescale_attn_weights use_cachescale_attn_by_inverse_layer_idxreorder_and_upcast_attnc@>[TU]5 XlX&:waUc[SUSUS35eX lX0lUR b+[ R"URUR 5O[ R"5Ul UR b![ R"UR U5O[ R"5Ul [S0SU_SU_SU_SU_SU_S U _S U _S U _S U _S U _SU_SU_SU_SU_SU_SU_6n[U5Ul g)Nz>`prefix_hidden_dim` cannot be `None` when `prefix_inner_dim`: z and `n_embd`: z are not equal.rrrrrrrrrrrrrrr r!)super__init__r ValueErrorrrrLinearIdentity encode_prefix decode_prefixrr transformer)selfrrrrrrrrrrrrrrrrrr r! gpt_config __class__s o/home/james-whalen/.local/lib/python3.13/site-packages/diffusers/pipelines/unidiffuser/modeling_text_decoder.pyr%UniDiffuserTextDecoder.__init__Bs. *  %*;*CPQbPcd$X_6  !1!2%%1 IId++T-C-C D  :>9O9O9[BIId,,f 5acalalan   ! #        !4 $ " "  2 0  2   -L %&UniDiffuserTextDecoder.get_dummy_tokens {{:'9'9U[\\r1c$URU5$)N)r))r,prefixs r/encodeUniDiffuserTextDecoder.encodes!!&))r1cZ[R"USSS9n/n/nUH]nURURU55nUR XcUS9upxUR US5 UR US5 M_ [R "U5n[R "U5nXE4$)a Generate captions given text embedding features. Returns list[L]. Args: features (`torch.Tensor` of shape `(B, L, D)`): Text embedding features to generate captions from. eos_token_id (`int`): The token ID of the EOS token for the text decoder model. device: Device to perform text generation on. Returns: `List[str]`: A list of strings generated from the decoder model. r7rr8) input_embedsr@ eos_token_id)r<splitr*to generate_beamappendstack) r,featuresrUr@generated_tokensgenerated_seq_lengthsfeature output_tokens seq_lengthss r/generate_captions(UniDiffuserTextDecoder.generate_captionss";;x2 "G((F);(F#]]9Hv||AB7GHF"YY '"?QGI#knn5E&F&N&N&PPJ~~I%L%$/+015aq 5 1{{g{Gz?TTFF)NN)NNNCrhN)__name__ __module__ __qualname____firstlineno____doc__"_keys_to_ignore_on_load_unexpectedr rkrstrrurlr%r<TensorrFr@r>rQno_gradrarX__static_attributes__ __classcell__)r.s@r/r r s/b+@A])^& ,0!%#- $(#'#'05(-)>7>7>7$C= >7  >7  >7>7>7>7#>7!>7>7>7>7">7 !!>7"!#>7$%>7&*.'>7("&)>7>7H26)- <<||!.  & @]#]u||] ]* ]]_77> ]]_ &*^)  ^)  ^)^)sm^)^)r1r )typingrnumpyrvr<r transformersrrtransformers.modeling_utilsrconfiguration_utilsr r modelsr r r#r1r/rs0 48B Z)Z6FZ)r1