-jiTWvSSKrSSKrSSKrSSKrSSKrSSKJr SSKJr SSK J r SSK r SSK r SSK r SSKJs Jr SSKrSSKJrJrJrJrJr SSK JrJr SSK JrJr SSKJr SS KJ r SS K!J"r" SS K#J$r$ SS K%J&r& SS K'J(r( SSK)J*r* SSK+J,r, SSK-J.r. SSK/J0r0J1r1 SSK2J3r3J4r4J5r5J6r6J7r7J8r8J9r9J:r:J;r;Jg)N)version) commonprefix)Path)is_mlu_availableis_musa_availableis_npu_availableis_sdaa_availableis_xpu_available) ModelCard ModelCardData)Trial TrialPruned)ExperimentalWarning) TPESampler)StudyDirection)ValidationError)Choice)install)Analyzer)Settings) Evaluator)AbliterationParametersModel) empty_cacheformat_durationget_readme_introget_trial_parameters load_promptsprintprompt_password prompt_path prompt_select prompt_textc^ ^!^"^#^$^%^&S[R;a'S[R;aS[RS'[S[S535 [S5 [S5 [5 [ [ R 5S:a[S [ R ;aG[ R S RS 5(d [ R RS S 5 [5m$[RR5(a-[S[RR!5S35 GOh[#5(a-[S[R$R!5S35 GO,['5(a,[S[R(R!5S35 O[+5(a,[S[R,R!5S35 O[/5(a,[S[R0R!5S35 O{[35(a([S[RR4S35 OD[R6R8R5(a [S5 O [S5 [R:"S5 S[R<R>l [BRDRG5 [HRDRK[HRDRL5 [NRP"S[RS 9 [UT$5m![5 [S!T$RVRXS"35 [[T$RV5n[S#[ U5S$35 [5 [S%T$R\RXS"35 [[T$R\5n[S#[ U5S$35 T$R^S:XGaE[5 [S&5 SnS nS nUT$R`::a[S'US(3S)S*9 U[bRd"U[ U5- 5-nUSUnT!RgU5 [hRj"5m%T!RgU5n[hRj"5nUV s/sH'n [ T!RnRqU 55PM) n n [sU 5UT%- - n [S-U S.S/35 X:aUnU nUS0-nUT$R`::aMUT$l/[S1T$R^S35 [5 [S25 T!RuUSS3USS3-5n[wU5RyS45T!l=T!RzRS55(aS6T!l=O'T!RzRS75(aS8T!l=T!Rz(a[S9T!Rz<S35 O [S:5 [}T$T!5m T$R~b`[5 [S;T$R~S"35 T$R~T$l@T!R5 [S<5 T R5 g[5 [S=5 [S>5 T!RU5n [S?5 T!RU5n [R"U RSS@9U RSS@9- S0SSA9m#[T$T!X5nT$R(aUR5 T$R(aUR5 A A A[5 Sm&[hRj"5m%SB[SC[[[44U U!U#U$U%U&4SDjjm"SB[SC[[[44U"4SEjjn[HR"[T$RSFSGSH9[R[R/SI9nURUT$RSJ9 UR(d[e[URSKSL9nUVs/sHVn[SMURSNSOSPURSQSRSS[ T R\5STURSUSV3USW9PMX nnUR[SXS)SW95 [5 [SY5 [5 [SZ5 [5 [S[U5nUbUS):Xag[5 [S\URSNS"35 [S]5 T!R5 [S^5 T!RT#URS_URS`5 [5 [Sa/SbQ5nUbUSc:XaGOU=Sd:Xag [Se5nU(dMA[Sf5 T!RRU5 T!RnRU5 [SgUSh35 GO=Si:XGa [R"5nU(d [Sj5nU(dM[R"U5nURSkURSlSm55nURSnSo5n[SpUSqUSr35 [SsUSlSS[T$R5RSt3Su9n[SvSwSx/5nUSx:Hn[Sy5 T!RRUUUSz9 T!RnRUUUSz9 [T$R5R5(Gd<[R"T$R5nURc[5UlkURRc/URlmURRRS{5 URRRS|5 URRRS}5 URRRS~5 [T$UT RT R\5UR-UlpURUUS9 [SUSh35 OS:Xa[5 [S5 ST$RS./n[SSSGS9nU(dOFURSUS.5 [SS)S*9 T!RU5n URSU S.5 MYGMGMD![ann[S UR5S 35 UR5Hn[SUSSSUSS35 M [5 [S5 SnAgSnAff=f![la"nUS:Xae[S+US,35 SnAGMSnAff=fs sn f![a GNf=fs snf![[4a Mf=f![lan[SUS35 SnAGNSnAff=f)NPYTORCH_ALLOC_CONFPYTORCH_CUDA_ALLOC_CONFzexpandable_segments:TrueuW[cyan]█░█░█▀▀░█▀▄░█▀▀░▀█▀░█░█▀▀[/] vz heretic-llmuT[cyan]█▀█░█▀▀░█▀▄░█▀▀░░█░░█░█░░[/]u[cyan]▀░▀░▀▀▀░▀░▀░▀▀▀░░▀░░▀░▀▀▀[/] [blue underline]https://github.com/p-e-w/heretic[/]rz--model-z"[red]Configuration contains [bold]z[/] errors:[/]z[bold]locrz [/]: [yellow]msg[/]zkRun [bold]heretic --help[/] or see [bold]config.default.toml[/] for details about configuration parameters.zGPU type: [bold]zXPU type: [bold]zMLU type: [bold]zSDAA type: [bold]zMUSA type: [bold]zCANN version: [bold]z$GPU type: [bold]Apple Metal (MPS)[/]zN[bold yellow]No GPU or other accelerator detected. Operations will be slow.[/]F@ignore)categoryz Loading good prompts from [bold][/]...z* [bold]z[/] prompts loadedzLoading bad prompts from [bold]z!Determining optimal batch size...z* Trying batch size [bold]z[/]... )endz[red]Failed[/] ()z[green]Ok[/] ([bold]z.0fz [/] tokens/s)z* Chosen batch size: [bold]z&Checking for common response prefix...d zzz<|channel|>analysis<|message|>zR<|channel|>analysis<|message|><|end|><|start|>assistant<|channel|>final<|message|>z* Prefix found: [bold]z * None foundzLoading model [bold]* Evaluating...z+Calculating per-layer refusal directions...z)* Obtaining residuals for good prompts...z(* Obtaining residuals for bad prompts...)dim)pr8trialreturnc >TS- mURST5 URSSS/5nURSS[TR 55S- -S[TR 55S- -5nUS:XaSn0nTR 5HnURUS 3S S 5nURUS 3S [TR 55S- -[TR 55S- 5nURUS3SS5nURUS3SS [TR 55S- -5n[ UUXu-US9X4'M URSU5 URSU5 [5 [STSTRS35 [S5 [U5R5Hup[SU SU S35 M [S5 TR5 [S5 TRTX#5 [S5 TR5upn [R"5T- nUT- TRT- -n[5 [S[!U5S35 TTR:a[S [!U5S35 URS!U 5 URS"U 5 U $)#Nrindexdirection_scopeglobalz per layerdirection_indexg?g?z .max_weightg?g?z.max_weight_positiong333333?z .min_weightgg?z.min_weight_distance) max_weightmax_weight_position min_weightmin_weight_distance parameterszRunning trial [bold]z [/] of [bold]r0z * Parameters:z * z = [bold]r,* Reloading model...* Abliterating...r7z[grey50]Elapsed time: [bold]z[/][/]z([grey50]Estimated remaining time: [bold] kl_divergencerefusals) set_user_attrsuggest_categorical suggest_floatlen get_layersget_abliterable_componentsrr n_trialsritems reload_model abliterate get_scoretime perf_counterr)r:r>r@rE componentrArBrCrDnamevaluescorerHrI elapsed_timeremaining_time evaluatormodelrefusal_directionssettings start_time trial_indexs F/home/james-whalen/.local/lib/python3.13/site-packages/heretic/main.py objectiverun..objectives q  G[133    --  3u'')*Q. / 3u'')*Q. /  k )"O 99;I,,+[)J #("5"5+12s5++-.23E$$&'!+# ,,+[)J #("5"5+12s5++-.23#  %;%$7&3$7 %J !9KD Diwc2 3? $%  !" +_I  )2)<)<)>&h((*Z7 &4    +   ,_\-J,K6RS ** * :?>;Z:[[ab  O]; J1 cz>T"U5$![a% URR5 [5ef=f)N)KeyboardInterruptstudystopr)r:rds rcobjective_wrapperrun..objective_wrapperas: U# #  KK   -  s /:T)n_startup_trialsn_ei_candidates multivariate)sampler directions)rPc URS$)NrI) user_attrs)r:s rcrun..s%**:6rf)keyz[Trial r=z>3z ] Refusals: rIz>2/z, KL divergence: rHz.4f)titlerYzNone (exit program)z%[bold green]Optimization finished![/]aThe following trials resulted in Pareto optimal combinations of refusals and KL divergence. After selecting a trial, you will be able to save the model, upload it to Hugging Face, or chat with it to test how well it works. You can return to this menu later to select a different trial. [yellow]Note that KL divergence values above 1 usually indicate significant damage to the original model's capabilities.[/]zWhich trial do you want to use?z!Restoring model from trial [bold]rFrGr@rEz1What do you want to do with the decensored model?) Save the model to a local folder Upload the model to Hugging FaceChat with the model(Nothing (return to trial selection menu)r}rzzPath to the folder:zSaving model...zModel saved to [bold]z[/].r{zHugging Face access token:fullnamerXz unknown useremailzno email foundzLogged in as [bold]z (z)[/]zName of repository:z-heretic)defaultz+Should the repository be public or private?PublicPrivatezUploading model...)privatetokenheretic uncensored decensored abliterated)rzModel uploaded to [bold]r|z8[cyan]Press Ctrl+C at any time to return to the menu.[/]system)rolecontentzUser:>)qmarkunsafeuserz[bold]Assistant:[/] assistantz [red]Error: )tosenvironr rrMsysargv startswithinsertrr error_counterrorstorchcuda is_availableget_device_namer xpurmlur sdaarmusarcannbackendsmpsset_grad_enabled_dynamoconfigcache_size_limit transformersloggingset_verbosity_erroroptuna set_verbosityWARNINGwarningsfilterwarningsrr good_promptsdatasetr bad_prompts batch_sizemax_batch_sizemathceil get_responsesrUrV Exception tokenizerencodesumget_responses_batchedrrstripresponse_prefixrevaluate_modelr^rRrTget_residuals_batchedF normalizemeanrprint_residual_geometryplot_residualsrr tuplefloat create_studyrrnrMINIMIZEoptimizerPrh best_trialssortedrrtappendr#rSr"save_pretrainedhuggingface_hub get_tokenr!whoamigetr$rrX push_to_hubexistsr loaddatar tagsr base_refusalstext system_promptstream_chat_responseEOFError)'errorrrrbest_batch_sizebest_performanceprompts responsesend_timeresponseresponse_lengths performancegood_residuals bad_residualsanalyzerrkrirr:choicesactionsave_directoryrrr~rrepo_id visibilityrcardchatmessager]r^rdr_r`rarbs' @@@@@@@rcrunr4s  BJJ. %RZZ 7+E '( cdklydzc{ |} `a  T G CHH  SXX % '',, I& : zz    !;!;!= >cBC     !:!:!< =SAB     !:!:!< =SAB    !%**"<"<">!?sCD    !%**"<"<">!?sCD    $U]]%7%7$8<=    ( ( * * 45 \  5! -/EMM),,. NN  !7!78 H/BC (OE G ,X-B-B-J-J,K6 RS 5 56L HS&''9 :; G +H,@,@,H,H+I PQx334K HS%&&8 9:a  12 H333 .zl'B K"TYYzC TcAR,RSI)3::3?E '' 22 1    ) )*J K K t  &u'<'<&?sCD n(E*I*  $X%<%<$=VDE!00    G 78 5600>N 45// >  %GH''((*!  xMK""$Jaa5#6aaF  5+>    %66 #++^-D-DE  E  (83D3DE     6K! !E %**73B78"--j9"=Qs9CXCX?Y>Z[""'"2"2?"CC!HJ  !  NN'  G 12 G  J  ?I =ERK   1%2B2B72K1LFST $%  !"     . /   \ *  G"CF~+U!U p 1;)45J)K-$/0 33NC77G 5n5ETJK;!0 9 9 ;$$34P$QE$$.55e<#'88& HHV^<$!%2B C 3H:RwdKL"-1'+F|nAd8>>6J6O6O5PPX$Y# &3I ( )& #- "923 //#$+"'0 33#$+"'4 $HNN3::<<#,>>(..#AD#yy0,9O #yy~~513  IINN11)< IINN11,? IINN11,? IINN11-@ 0$,$)$-$;$;$-$9$9 !" #')) !,!I!,,WE,B 8 FG.V &.(:P:PQ #&*5$+*-+/+" (/$) $ V,P Q %&<" E+0+E+Ed+K $ [X,V W#/K% g   253D3D3F2G~VW\\^E F5<?+=ucJ K$  y   j ?(q12  J    " \%6x#@& %& 1 UG3/00 1s3 u, A w'.x;xAx,&yAy6y Iy!+y x1 Ax1#y, w$6A$ww$' x1xx x)(x)1yyyy y,y''y,c[5 [5 g![aTn[U[5(d[UR [5(a[ 5 [ S5 SnAgeSnAff=f)Nz[red]Shutting down...[/])rr BaseException isinstancerh __context__r )rs rcmainr;s_ I     e. / /:   04 4  G , - -  s  A5A A0/A00A5)?rrrrUrimportlib.metadataros.pathrpathlibrrrrtorch.nn.functionalnn functionalrraccelerate.utilsrrrr r r r r roptuna.exceptionsroptuna.samplersr optuna.studyrpydanticr questionaryrrich.tracebackrrrrrr]rr^rrutilsrrrrrr r!r"r#r$rrrfrcrs| &  5%1&'$" 0   D1Nrf