+hG SSKrSSKJrJrJrJrJrJr SSKrSSK J r J r J r J r SSKJr SSKJrJr SSKJrJr SSKJr SS KJr SS KJr SS KJrJrJrJ r J!r!J"r" SS K#J$r$ S SK%J&r& S SK'J(r( SSK)J*r* \"5(a SSK+J,s J-r. Sr/OSr/\R`"\15r2Sr3SS\\4S\\\5\Rl4S\\\4S\\\74Sjjr8"SS\&\\\*5r9g)N)AnyCallableDictListOptionalUnion)CLIPTextModelWithProjection CLIPTokenizerT5EncoderModelT5TokenizerFast)VaeImageProcessor)FromSingleFileMixinSD3LoraLoaderMixin)PAGCFGJointAttnProcessor2_0PAGJointAttnProcessor2_0) AutoencoderKL)SD3Transformer2DModel)FlowMatchEulerDiscreteScheduler)USE_PEFT_BACKENDis_torch_xla_availableloggingreplace_example_docstringscale_lora_layersunscale_lora_layers) randn_tensor)DiffusionPipeline)StableDiffusion3PipelineOutput)PAGMixinTFa^ Examples: ```py >>> import torch >>> from diffusers import AutoPipelineForText2Image >>> pipe = AutoPipelineForText2Image.from_pretrained( ... "stabilityai/stable-diffusion-3-medium-diffusers", ... torch_dtype=torch.float16, ... enable_pag=True, ... pag_applied_layers=["blocks.13"], ... ) >>> pipe.to("cuda") >>> prompt = "A cat holding a sign that says hello world" >>> image = pipe(prompt, guidance_scale=5.0, pag_scale=0.7).images[0] >>> image.save("sd3_pag.png") ``` num_inference_stepsdevice timestepssigmasc UbUb [S5eUbS[[R"UR5R R 55;nU(d[SURS35eUR"S X2S.UD6 URn[U5nX14$UbS[[R"UR5R R 55;nU(d[SURS35eUR"S XBS.UD6 URn[U5nX14$UR"U4S U0UD6 URnX14$) a Calls the scheduler's `set_timesteps` method and retrieves timesteps from the scheduler after the call. Handles custom timesteps. Any kwargs will be supplied to `scheduler.set_timesteps`. Args: scheduler (`SchedulerMixin`): The scheduler to get timesteps from. num_inference_steps (`int`): The number of diffusion steps used when generating samples with a pre-trained model. If used, `timesteps` must be `None`. device (`str` or `torch.device`, *optional*): The device to which the timesteps should be moved to. If `None`, the timesteps are not moved. timesteps (`List[int]`, *optional*): Custom timesteps used to override the timestep spacing strategy of the scheduler. If `timesteps` is passed, `num_inference_steps` and `sigmas` must be `None`. sigmas (`List[float]`, *optional*): Custom sigmas used to override the timestep spacing strategy of the scheduler. If `sigmas` is passed, `num_inference_steps` and `timesteps` must be `None`. Returns: `Tuple[torch.Tensor, int]`: A tuple where the first element is the timestep schedule from the scheduler and the second element is the number of inference steps. zYOnly one of `timesteps` or `sigmas` can be passed. Please choose one to set custom valuesr$zThe current scheduler class zx's `set_timesteps` does not support custom timestep schedules. Please check whether you are using the correct scheduler.)r$r#r%zv's `set_timesteps` does not support custom sigmas schedules. Please check whether you are using the correct scheduler.)r%r#r#) ValueErrorsetinspect signature set_timesteps parameterskeys __class__r$len) schedulerr"r#r$r%kwargsaccepts_timesteps accept_sigmass c/home/james-whalen/.local/lib/python3.13/site-packages/diffusers/pipelines/pag/pipeline_pag_sd_3.pyretrieve_timestepsr6Ms}>!3tuu'3w/@/@AXAX/Y/d/d/i/i/k+ll .y/B/B.CDab  M)MfM'' !)n  ))   C(9(9):Q:Q(R(](](b(b(d$ee .y/B/B.CD_`  GvGG'' !)n  ))  3MFMfM''  ))c9^\rSrSrSrSr/r/SQrSFS\S\ S\ S\ S \ S \ S \ S \ S \S\\\\44U4SjjjrSGS\\\\4S\S\S\\R,S\\R.4 SjjrSHS\\\\4S\S\\R,S\\S\4 SjjrSIS\\\\4S\\\\4S\\\\4S\\R,S\S\S \\\\\4S!\\\\\4S"\\\\\4S#\\R6S$\\R6S%\\R6S&\\R6S\\S\S'\\4 S(jjrSJS)jrSKS*jr\ S+5r!\ S,5r"\ S-5r#\ S.5r$\ S/5r%\ S05r&\RN"5\("\)5SSSSSS1SS2SSSSSSSSSSS3SSSSS4/SS5S64S\\\\4S\\\\\4S\\\\\4S7\\S8\\S9\S:\\\S;\S \\\\\4S!\\\\\4S"\\\\\4S\\S<\\\RT\\RT4S4\\R6S#\\R6S$\\R6S%\\R6S&\\R6S=\\S>\S?\\+\\,4S\\S@\\-\\\+/S4SA\\S\SB\SC\46SDjj55r.SEr/U=r0$)LStableDiffusion3PAGPipelinea\ [PAG pipeline](https://huggingface.co/docs/diffusers/main/en/using-diffusers/pag) for text-to-image generation using Stable Diffusion 3. Args: transformer ([`SD3Transformer2DModel`]): Conditional Transformer (MMDiT) architecture to denoise the encoded image latents. scheduler ([`FlowMatchEulerDiscreteScheduler`]): A scheduler to be used in combination with `transformer` to denoise the encoded image latents. vae ([`AutoencoderKL`]): Variational Auto-Encoder (VAE) Model to encode and decode images to and from latent representations. text_encoder ([`CLIPTextModelWithProjection`]): [CLIP](https://huggingface.co/docs/transformers/model_doc/clip#transformers.CLIPTextModelWithProjection), specifically the [clip-vit-large-patch14](https://huggingface.co/openai/clip-vit-large-patch14) variant, with an additional added projection layer that is initialized with a diagonal matrix with the `hidden_size` as its dimension. text_encoder_2 ([`CLIPTextModelWithProjection`]): [CLIP](https://huggingface.co/docs/transformers/model_doc/clip#transformers.CLIPTextModelWithProjection), specifically the [laion/CLIP-ViT-bigG-14-laion2B-39B-b160k](https://huggingface.co/laion/CLIP-ViT-bigG-14-laion2B-39B-b160k) variant. text_encoder_3 ([`T5EncoderModel`]): Frozen text-encoder. Stable Diffusion 3 uses [T5](https://huggingface.co/docs/transformers/model_doc/t5#transformers.T5EncoderModel), specifically the [t5-v1_1-xxl](https://huggingface.co/google/t5-v1_1-xxl) variant. tokenizer (`CLIPTokenizer`): Tokenizer of class [CLIPTokenizer](https://huggingface.co/docs/transformers/v4.21.0/en/model_doc/clip#transformers.CLIPTokenizer). tokenizer_2 (`CLIPTokenizer`): Second Tokenizer of class [CLIPTokenizer](https://huggingface.co/docs/transformers/v4.21.0/en/model_doc/clip#transformers.CLIPTokenizer). tokenizer_3 (`T5TokenizerFast`): Tokenizer of class [T5Tokenizer](https://huggingface.co/docs/transformers/model_doc/t5#transformers.T5Tokenizer). z>text_encoder->text_encoder_2->text_encoder_3->transformer->vae)latents prompt_embedsnegative_prompt_embedsnegative_pooled_prompt_embeds transformerr1vae text_encoder tokenizertext_encoder_2 tokenizer_2text_encoder_3 tokenizer_3pag_applied_layersc >[T U]5 URUUUUUUU UUS9 [USS5(a/S[ UR R R5S- -OSUl[URS9Ul [US5(a#URbURROSUl[US 5(a-URb URR R OS Ul[US 5(a-URb URR R$OSUlUR'U [)5[+54S 9 g) N) r@rArCrErBrDrFr?r1r@rr )vae_scale_factorrBMr?)pag_attn_processors)super__init__register_modulesgetattrr0r@configblock_out_channelsrJrimage_processorhasattrrBmodel_max_lengthtokenizer_max_lengthr? sample_sizedefault_sample_size patch_sizeset_pag_applied_layersrr) selfr?r1r@rArBrCrDrErFrGr/s r5rO$StableDiffusion3PAGPipeline.__init__sX  %))###  W^^bdikoVpVpc$((//*L*L&MPQ&Q Rvw0$BWBWX/6t[/I/IdnnNhDNN + +np ! t]++0@0@0L    # # / /  3:$ 2N2NSWScScSoD   # # . .uv  ## 5P5RTlTn4o $ r7Nr promptnum_images_per_promptmax_sequence_lengthr#dtypec U=(d URnU=(d URRn[U[5(aU/OUn[ U5nUR cC[R"Xb-URURRR4UUS9$URUSUSSSS9nURnURUSSS9Rn U RSURS:ag[R "X5(dLURR#U SS2URS - S245n [$R'S US U 35 UR UR)U55S n UR RnU R)XTS 9n U Rupn U R+S US 5n U R-Xb-U S5n U $)Nr#rb max_lengthTpt)paddingre truncationadd_special_tokensreturn_tensorslongestrgrjr zXThe following part of your input was truncated because `max_sequence_length` is set to tokens: rrbr#)_execution_devicerArb isinstancestrr0rEtorchzerosrWr?rRjoint_attention_dimrF input_idsshapeequal batch_decodeloggerwarningtorepeatview)r\r_r`rar#rb batch_size text_inputstext_input_idsuntruncated_ids removed_textr<_seq_lens r5_get_t5_prompt_embeds1StableDiffusion3PAGPipeline._get_t5_prompt_embedss14110**00'44&&[    &;;6--$$++??  &&  *# ' %..**69UY*Zdd   $(<(>4+;+;<"//1D1DE#5 ); '44&&[   00  %..#FIdS]]   $(<(UYZ ,Q/  )77;M)77)a-8HIM%((t/@/@/F/Fv(V %++ 7A%,,Q0EqI %**:+MwXZ[ 3::1>SUVW3889[]_`222r7Tprompt_2prompt_3do_classifier_free_guidancenegative_promptnegative_prompt_2negative_prompt_3r<r=rr> lora_scalec VU=(d URnUbx[U[5(acUUlURb![ (a[ URU5 URb![ (a[ URU5 [U[5(aU/OUnUb [U5nOU RSnU GcU=(d Un[U[5(aU/OUnU=(d Un[U[5(aU/OUnURUUUUSS9unnURUUUUSS9unn[R"UU/SS9nURUUUUS9n[RR R#USURSURS- 45n[R"UU/SS9n [R"UU/SS9n U(GaU GcU=(d S nU=(d UnU =(d Un [U[5(aUU/-OUn[U[5(aUU/-OUn[U [5(aUU /-OU n Ub;[%U5[%U5La$['S [%U5S [%U5S 35eU[U5:wa![)S US[U5SUSUS3 5eURUUUSSS9unnURUUUSSS9unn[R"UU/SS9nURU UUUS9n[RR R#USURSURS- 45n[R"UU/SS9n [R"UU/SS9n URb6[U[5(a![ (a[+URU5 URb6[U[5(a![ (a[+URU5 XX4$)a Args: prompt (`str` or `List[str]`, *optional*): prompt to be encoded prompt_2 (`str` or `List[str]`, *optional*): The prompt or prompts to be sent to the `tokenizer_2` and `text_encoder_2`. If not defined, `prompt` is used in all text-encoders prompt_3 (`str` or `List[str]`, *optional*): The prompt or prompts to be sent to the `tokenizer_3` and `text_encoder_3`. If not defined, `prompt` is used in all text-encoders device: (`torch.device`): torch device num_images_per_prompt (`int`): number of images that should be generated per prompt do_classifier_free_guidance (`bool`): whether to use classifier free guidance or not negative_prompt (`str` or `List[str]`, *optional*): The prompt or prompts not to guide the image generation. If not defined, one has to pass `negative_prompt_embeds` instead. Ignored when not using guidance (i.e., ignored if `guidance_scale` is less than `1`). negative_prompt_2 (`str` or `List[str]`, *optional*): The prompt or prompts not to guide the image generation to be sent to `tokenizer_2` and `text_encoder_2`. If not defined, `negative_prompt` is used in all the text-encoders. negative_prompt_3 (`str` or `List[str]`, *optional*): The prompt or prompts not to guide the image generation to be sent to `tokenizer_3` and `text_encoder_3`. If not defined, `negative_prompt` is used in all the text-encoders. prompt_embeds (`torch.FloatTensor`, *optional*): Pre-generated text embeddings. Can be used to easily tweak text inputs, *e.g.* prompt weighting. If not provided, text embeddings will be generated from `prompt` input argument. negative_prompt_embeds (`torch.FloatTensor`, *optional*): Pre-generated negative text embeddings. Can be used to easily tweak text inputs, *e.g.* prompt weighting. If not provided, negative_prompt_embeds will be generated from `negative_prompt` input argument. pooled_prompt_embeds (`torch.FloatTensor`, *optional*): Pre-generated pooled text embeddings. Can be used to easily tweak text inputs, *e.g.* prompt weighting. If not provided, pooled text embeddings will be generated from `prompt` input argument. negative_pooled_prompt_embeds (`torch.FloatTensor`, *optional*): Pre-generated negative pooled text embeddings. Can be used to easily tweak text inputs, *e.g.* prompt weighting. If not provided, pooled negative_prompt_embeds will be generated from `negative_prompt` input argument. clip_skip (`int`, *optional*): Number of layers to be skipped from CLIP while computing the prompt embeddings. A value of 1 means that the output of the pre-final layer will be used for computing the prompt embeddings. lora_scale (`float`, *optional*): A lora scale that will be applied to all LoRA layers of the text encoder if LoRA layers are loaded. Nr)r_r#r`rrr rmdim)r_r`rar#rz?`negative_prompt` should be the same type to `prompt`, but got z != .z`negative_prompt`: z has batch size z, but `prompt`: zT. Please make sure that passed `negative_prompt` matches the batch size of `prompt`.)r#r`rr)rprqr _lora_scalerArrrCrrr0rwrrscatrnn functionalpadtype TypeErrorr(r)r\r_rrr#r`rrrrr<r=rr>rrarr prompt_embedpooled_prompt_embedprompt_2_embedpooled_prompt_2_embedclip_prompt_embedst5_prompt_embednegative_prompt_embednegative_pooled_prompt_embednegative_prompt_2_embednegative_pooled_prompt_2_embednegative_clip_prompt_embedst5_negative_prompt_embeds r5 encode_prompt)StableDiffusion3PAGPipeline.encode_promptOsD1411  !j7I&J&J)D   ,1A1A!$"3"3Z@"".3C3C!$"5"5zB'44&&  VJ&,,Q/J  )6H%/#%>%>zHH)6H%/#%>%>zHH040L0L&;#!" 1M1 -L-594P4P&;#!" 5Q5 1N1"'L.+Ir!R "88&;$7 9O"'!4!4!8!8"Q(=(=b(ADVD\D\]_D`(`$a" "II'9?&KQSTM#(99.ACX-Y_a#b &+A+I-3O 1 D_  1 D_ AK?\_@`@`jO+<?PRU4V4V /00\m 5??PRU4V4V /00\m !d6l$:O&OUVZ[jVkUlmV ~Q(s?33 )/)::J3K_J`ax/ |<33 CGB^B^&;!" C_C ? !#?GKFbFb!&;!" GcG C #%C+0))5JLc4djl*m ''+'A'A(&;$7 (B( $+0((*=*=*A*A+,22269T9Z9Z[]9^^_+ ' &+YY0KMe/fln%o ",1II-/MNTV- )    ($ 2338H8H#D$5$5zB    *$ 2338H8H#D$7$7D6Jiir7c^UTRTR--S:wd UTRTR--S:waj[STRTR-SUSUSXDTRTR--- SXUTRTR--- S3 5eU bW[U4SjU 55(d=[S TRS U Vs/sHoTR;dMUPM sn35eUbU b[S US U S 35eUbU b[SUS U S 35eUbU b[SUS U S 35eUcU c [S5eUbA[ U[ 5(d,[ U[5(d[S[U535eUbA[ U[ 5(d,[ U[5(d[S[U535eUbA[ U[ 5(d,[ U[5(d[S[U535eUbU b[SUSU S 35eUbU b[SUSU S 35eUbU b[SUSU S 35eU bCU b@U RU R:wa&[SU RSU RS35eU bU c [S5eU bU c [S5eUbUS:a[SU35eggs snf)Nrz-`height` and `width` have to be divisible by z but are z and z.You can use height z and width rc3@># UHoTR;v M g7fN)_callback_tensor_inputs).0kr\s r5 ;StableDiffusion3PAGPipeline.check_inputs..+sF 7Y!-- -7Ysz2`callback_on_step_end_tensor_inputs` has to be in z , but found zCannot forward both `prompt`: z and `prompt_embeds`: z2. Please make sure to only forward one of the two.z Cannot forward both `prompt_2`: z Cannot forward both `prompt_3`: zeProvide either `prompt` or `prompt_embeds`. Cannot leave both `prompt` and `prompt_embeds` undefined.z2`prompt` has to be of type `str` or `list` but is z4`prompt_2` has to be of type `str` or `list` but is z4`prompt_3` has to be of type `str` or `list` but is z'Cannot forward both `negative_prompt`: z and `negative_prompt_embeds`: z)Cannot forward both `negative_prompt_2`: z)Cannot forward both `negative_prompt_3`: zu`prompt_embeds` and `negative_prompt_embeds` must have the same shape when passed directly, but got: `prompt_embeds` z != `negative_prompt_embeds` zIf `prompt_embeds` are provided, `pooled_prompt_embeds` also have to be passed. Make sure to generate `pooled_prompt_embeds` from the same text encoder that was used to generate `prompt_embeds`.zIf `negative_prompt_embeds` are provided, `negative_pooled_prompt_embeds` also have to be passed. Make sure to generate `negative_pooled_prompt_embeds` from the same text encoder that was used to generate `negative_prompt_embeds`.iz8`max_sequence_length` cannot be greater than 512 but is ) rJrZr(allrrqrrlistrrw)r\r_rrheightwidthrrrr<r=rr>"callback_on_step_end_tensor_inputsrars` r5 check_inputs(StableDiffusion3PAGPipeline.check_inputss{$ d++doo= >! C--?@AE?@U@UX\XgXg@g?hhqrxqyy~@EFF&&,9N9NQUQ`Q`9`/a&a%bbmns@D@U@UX\XgXg@gwhohniijk  . 9#F 7YF C C DTEaEaDbbn|^pH|^vwkokGkGbGpq|^pHoIJ   -";08N}o^00  !m&?28*Z+GA#i.AQR&<'gi  u&Vr7cUR$r_guidance_scaler\s r5guidance_scale*StableDiffusion3PAGPipeline.guidance_scales###r7cUR$r) _clip_skiprs r5r%StableDiffusion3PAGPipeline.clip_skip r7c URS:$)Nr rrs r5r7StableDiffusion3PAGPipeline.do_classifier_free_guidances##a''r7cUR$r)_joint_attention_kwargsrs r5joint_attention_kwargs2StableDiffusion3PAGPipeline.joint_attention_kwargss+++r7cUR$r)_num_timestepsrs r5 num_timesteps)StableDiffusion3PAGPipeline.num_timestepss"""r7cUR$r) _interruptrs r5 interrupt%StableDiffusion3PAGPipeline.interruptrr7g@pilr;g@grrr"r%rr output_type return_dictrcallback_on_step_endr pag_scalepag_adaptive_scalec> U=(d URUR-nU=(d URUR-nURUUUUUU U U UUUUUUS9 XlUUlUUlSUlUUlUUlUb[U[5(aSnO3Ub![U[5(a [U5nOURSnURnURbURR!SS5OSnUR#UUUU U U UR$UUUUUUR&U UUS9unnnnUR((a;UR+UUUR$5nUR+UUUR$5nO?UR$(a.[,R."UU/SS9n[,R."UU/SS9n[1UR2UUUS 9unn[5[U5X`R2R6-- S5n [U5UlUR:R<R>n!URAUU -U!UUURBUU U5nUR((a:UR:RDn"URGURHUR$S 9 URKUS 9n#[MU5GH\un$n%URN(aM[,R."U/URSURS--5n&U%RQU&RS5n'UR;U&U'UUURSS 9Sn(UR((a)URSU(UR$URTU%5n(O:UR$(a)U(RWS 5un)n*U)URTU*U)- --n(URBn+UR2RYU(U%USS9SnURBU+:wa>[,RZR\R_5(aURaU+5nUbn0n,UHn-[c5U-U,U-'M U"UU$U%U,5n.U.ReSU5nU.ReSU5nU.ReSU5nU.ReSU5nU$[U5S- :Xd)U$S-U :a0U$S-UR2R6-S:XaU#Rg5 [h(dGMG[jRl"5 GM_ SSS5 US:XaUn/OzXRnR<Rp- URnR<Rr-nURnRuUSS9Sn/URvRyU/US9n/UR{5 UR((aUR:R}W"5 U(dU/4$[U/S9$!,(df  N=f)a Function invoked when calling the pipeline for generation. Args: prompt (`str` or `List[str]`, *optional*): The prompt or prompts to guide the image generation. If not defined, one has to pass `prompt_embeds`. instead. prompt_2 (`str` or `List[str]`, *optional*): The prompt or prompts to be sent to `tokenizer_2` and `text_encoder_2`. If not defined, `prompt` is will be used instead prompt_3 (`str` or `List[str]`, *optional*): The prompt or prompts to be sent to `tokenizer_3` and `text_encoder_3`. If not defined, `prompt` is will be used instead height (`int`, *optional*, defaults to self.unet.config.sample_size * self.vae_scale_factor): The height in pixels of the generated image. This is set to 1024 by default for the best results. width (`int`, *optional*, defaults to self.unet.config.sample_size * self.vae_scale_factor): The width in pixels of the generated image. This is set to 1024 by default for the best results. num_inference_steps (`int`, *optional*, defaults to 50): The number of denoising steps. More denoising steps usually lead to a higher quality image at the expense of slower inference. sigmas (`List[float]`, *optional*): Custom sigmas to use for the denoising process with schedulers which support a `sigmas` argument in their `set_timesteps` method. If not defined, the default behavior when `num_inference_steps` is passed will be used. guidance_scale (`float`, *optional*, defaults to 7.0): Guidance scale as defined in [Classifier-Free Diffusion Guidance](https://huggingface.co/papers/2207.12598). `guidance_scale` is defined as `w` of equation 2. of [Imagen Paper](https://huggingface.co/papers/2205.11487). Guidance scale is enabled by setting `guidance_scale > 1`. Higher guidance scale encourages to generate images that are closely linked to the text `prompt`, usually at the expense of lower image quality. negative_prompt (`str` or `List[str]`, *optional*): The prompt or prompts not to guide the image generation. If not defined, one has to pass `negative_prompt_embeds` instead. Ignored when not using guidance (i.e., ignored if `guidance_scale` is less than `1`). negative_prompt_2 (`str` or `List[str]`, *optional*): The prompt or prompts not to guide the image generation to be sent to `tokenizer_2` and `text_encoder_2`. If not defined, `negative_prompt` is used instead negative_prompt_3 (`str` or `List[str]`, *optional*): The prompt or prompts not to guide the image generation to be sent to `tokenizer_3` and `text_encoder_3`. If not defined, `negative_prompt` is used instead num_images_per_prompt (`int`, *optional*, defaults to 1): The number of images to generate per prompt. generator (`torch.Generator` or `List[torch.Generator]`, *optional*): One or a list of [torch generator(s)](https://pytorch.org/docs/stable/generated/torch.Generator.html) to make generation deterministic. latents (`torch.FloatTensor`, *optional*): Pre-generated noisy latents, sampled from a Gaussian distribution, to be used as inputs for image generation. Can be used to tweak the same generation with different prompts. If not provided, a latents tensor will ge generated by sampling using the supplied random `generator`. prompt_embeds (`torch.FloatTensor`, *optional*): Pre-generated text embeddings. Can be used to easily tweak text inputs, *e.g.* prompt weighting. If not provided, text embeddings will be generated from `prompt` input argument. negative_prompt_embeds (`torch.FloatTensor`, *optional*): Pre-generated negative text embeddings. Can be used to easily tweak text inputs, *e.g.* prompt weighting. If not provided, negative_prompt_embeds will be generated from `negative_prompt` input argument. pooled_prompt_embeds (`torch.FloatTensor`, *optional*): Pre-generated pooled text embeddings. Can be used to easily tweak text inputs, *e.g.* prompt weighting. If not provided, pooled text embeddings will be generated from `prompt` input argument. negative_pooled_prompt_embeds (`torch.FloatTensor`, *optional*): Pre-generated negative pooled text embeddings. Can be used to easily tweak text inputs, *e.g.* prompt weighting. If not provided, pooled negative_prompt_embeds will be generated from `negative_prompt` input argument. output_type (`str`, *optional*, defaults to `"pil"`): The output format of the generate image. Choose between [PIL](https://pillow.readthedocs.io/en/stable/): `PIL.Image.Image` or `np.array`. return_dict (`bool`, *optional*, defaults to `True`): Whether or not to return a [`~pipelines.stable_diffusion_xl.StableDiffusionXLPipelineOutput`] instead of a plain tuple. joint_attention_kwargs (`dict`, *optional*): A kwargs dictionary that if specified is passed along to the `AttentionProcessor` as defined under `self.processor` in [diffusers.models.attention_processor](https://github.com/huggingface/diffusers/blob/main/src/diffusers/models/attention_processor.py). callback_on_step_end (`Callable`, *optional*): A function that calls at the end of each denoising steps during the inference. The function is called with the following arguments: `callback_on_step_end(self: DiffusionPipeline, step: int, timestep: int, callback_kwargs: Dict)`. `callback_kwargs` will include a list of all tensors as specified by `callback_on_step_end_tensor_inputs`. callback_on_step_end_tensor_inputs (`List`, *optional*): The list of tensor inputs for the `callback_on_step_end` function. The tensors specified in the list will be passed as `callback_kwargs` argument. You will only be able to include variables listed in the `._callback_tensor_inputs` attribute of your pipeline class. max_sequence_length (`int` defaults to 256): Maximum sequence length to use with the `prompt`. pag_scale (`float`, *optional*, defaults to 3.0): The scale factor for the perturbed attention guidance. If it is set to 0.0, the perturbed attention guidance will not be used. pag_adaptive_scale (`float`, *optional*, defaults to 0.0): The adaptive scale factor for the perturbed attention guidance. If it is set to 0.0, `pag_scale` is used. Examples: Returns: [`~pipelines.stable_diffusion_3.StableDiffusion3PipelineOutput`] or `tuple`: [`~pipelines.stable_diffusion_3.StableDiffusion3PipelineOutput`] if `return_dict` is True, otherwise a `tuple`. When returning a tuple, the first element is a list with the generated images. ) rrrr<r=rr>rraFNr rscale)r_rrrrrrr<r=rr>r#rr`rarr)r%)rGr)total)rtimestepencoder_hidden_statespooled_projectionsrrr)rr;r<r=r>latent)r)images)@rYrJrrrrr _pag_scale_pag_adaptive_scalerqrrrr0rwrprgetrrrdo_perturbed_attention_guidance%_prepare_perturbed_attention_guidancersrr6r1maxorderrr?rR in_channelsrrbattn_processors_set_pag_attn_processorrG progress_bar enumeraterexpand#_apply_perturbed_attention_guidancerchunkstepbackendsmps is_availabler|localspopupdate XLA_AVAILABLExm mark_stepr@scaling_factor shift_factordecoderT postprocessmaybe_free_model_hooksset_attn_processorr)0r\r_rrrrr"r%rrrrr`rr;r<r=rr>rrrrrrrarrrr#rr$num_warmup_stepsroriginal_attn_procritlatent_model_inputr noise_prednoise_pred_uncondnoise_pred_text latents_dtypecallback_kwargsrcallback_outputsimages0 r5__call__$StableDiffusion3PAGPipeline.__call__sDK433d6K6KKI11D4I4II      +//'#9!5*G/Q 3  " .#'=$##5   *VS"9"9J  Jvt$<$<VJ&,,Q/J''?C>Y>Y>eD ' ' + +GT :ko    +//(,(H(H'#9!5*Gnn"7 3!!    " )(  / / FF5t7W7WM$(#M#M$&CTEeEe$  - -!II'=}&MSTUM#(99.KMa-bhi#j *>&+YYyMB<@EI#'#&&*#jc49n%jT#Y'jT#Y' j & j # j&*j"%T#Y"78j$E#tCy.$9:j$E#tCy.$9:j  1 12j!)):): ;j'u'8'89j(00A0A'BjC=j !!j"UO#jR#!&*+/ ^oT>$$ ((,,## ]]_12)-4848 $##%(, #;?=A=A/0MQ/359>B<@EI%* ;?#'KO9B #&$'9r<c49n%r<5d3i01r<5d3i01 r<  r< } r<!r<e%r<r<"%T#Y"78r<$E#tCy.$9:r<$E#tCy.$9:r< (}r<E%//43H"HIJr<%++,r<   1 12!r<"!)):): ;#r<$'u'8'89%r<&(00A0A'B'r<(c])r<*+r<,!)c3h 8-r<.C=/r<0'xc40@$0F'GH1r<2-1I3r<4!5r<67r<8"9r<3rr=s== 1>_089..O))MM   H %.*.15%)$( 8*!#8* U3 ,- .8*S " 8* T%[ ! 8*vX <"35GI\^fX