oihSSKJr SSKrSSKJr SSKJr SSKJr SSK J r \"SS\55r g) ) annotationsN) dataclass)Optional) PeftConfig)PeftTypec^\rSrSr%SrSrS\S'SrS\S'SrS \S 'S r S \S 'S r S \S 'Sr S\S'Sr S\S'Sr S\S'S rS \S'SrS\S'SrS\S'SrS\S'SrS\S'U4SjrSrU=r$) XLoraConfiga& This is the configuration class to store the configuration of a `XLoraModel`. When the config is reloaded, the paths of the `adapters` field is disregarded in favor of the saved adapters. As such, only the keys matter during loading. Args: hidden_size (`int`): Hidden size of the base model. adapters (`dict`): Mapping of adapter names to the LoRA adapter id, as per PeftModel.load_adapter. *They will be automatically loaded*, to use as LoRA experts. When using from_pretrained, pass the new adapters dict as a keyword argument. enable_softmax (`bool`, *optional*, defaults to `True`): Enable softmax application for the X-LoRA classifier. enable_softmax_topk (`bool`, *optional*, defaults to `False`): Enable softmax application for the top-k LoRA adapters. Mutually exclusive to `enable_softmax` and must only be set if `top_k_lora` is. softmax_temperature (`float`, *optional*, defaults to 1.0): Softmax temperature, lower yields sharper predictions layerwise_scalings (`bool`, *optional*, defaults to `False`): If True, generate scalings for each LoRA adapter (each layer). If this is False, then scalings will be broadcasted, the same, to each layer. top_k_lora (`int`, *optional*, defaults to None): Sparsely select the top_k LoRA experts instead of the default dense method. xlora_depth (`int`, *optional*, defaults to 1): Depth of the X-LoRA classifier. xlora_size (`int`, *optional*, defaults to 2048): Hidden size of the X-LoRA classifier, irrelevant if `xlora_depth=1`. xlora_dropout_p (`float`, *optional*, defaults to 0.2): Dropout probability of the X-LoRA classifier, irrelevant if `xlora_depth=1`. use_trainable_adapters (`bool`, *optional*, defaults to False): Make the adapters trainable. scaling_pass_value (`float`, *optional*, defaults to 0): Scaling pass value. global_scaling_weight (`float`, *optional*, defaults to 1): Weight to multiply output of each LoRA adapter by. Nint hidden_sizezdict[str, str]adaptersTboolenable_softmaxFenable_softmax_topklayerwise_scalings xlora_depthi xlora_sizeg?floatxlora_dropout_puse_trainable_adaptersg?softmax_temperaturez Optional[int] top_k_loragscaling_pass_valueglobal_scaling_weightc6>[TU]5 [RUlUR c[ R"S5 SUlURc[ R"S5 0UlUR(a#URc[ R"S5 UR(a'UR(a[ R"S5 URb(URS:a[ R"S5 ggg)NzqNo value was provided for `hidden_size`. This will be set to 4096 by default, please ensure that this is correct.izhNo value was provided for for `adapters`. This will be set to empty, please ensure that this is correct.z5`enable_softmax_topk` enabled `top_k_lora` is not setzc`enable_softmax_topk` and `enable_softmax` are both enabled. This will result in worse performance.rz&`top_k_lora` value must be at least 1.) super __post_init__rXLORA peft_typer warningswarnr rrr)self __class__s R/home/james-whalen/.local/lib/python3.13/site-packages/peft/tuners/xlora/config.pyrXLoraConfig.__post_init__Ns !    # MMD  $D  == MMz DM  # #(? MMQ R  # #(;(; MMu  ?? &4??Q+> MMB C,? &)r r r )__name__ __module__ __qualname____firstlineno____doc__r __annotations__r rrrrrrrrrrrr__static_attributes__ __classcell__)r$s@r%r r s$LK#Hn#ND %%$$KJ OU #(D(!$$ $J $ ###&5&DDr'r ) __future__rr! dataclassesrtypingr peft.configrpeft.utils.peft_typesrr r'r%r6s:#!"* MD*MD MDr'