hSSKrSSKJrJr SSKJr SSKJr SSKr SSK J r "SS\5r "SS \ 5r "S S \ 5r"S S \ 5rg)N)ABCabstractmethod)Iterable)Optional) DTypeLikecf^\rSrSrSrSU4SjjrSSjr\S\R4Sj5r Sr U=r $) ActionNoise z The action noise base class returnc">[TU]5 gN)super__init__)self __class__s X/home/james-whalen/.local/lib/python3.13/site-packages/stable_baselines3/common/noise.pyrActionNoise.__init__s cg)z) Call end of episode reset for the noise Nrs rresetActionNoise.resets rc[5er )NotImplementedErrorrs r__call__ActionNoise.__call__s !##rrr N) __name__ __module__ __qualname____firstlineno____doc__rrrnpndarrayr__static_attributes__ __classcell__rs@rr r s1 $"**$$rr c ^\rSrSrSr\R 4S\RS\RS\SS4U4Sjjjr S\R4S jr S\ 4S jr S r U=r$) NormalActionNoisez A Gaussian action noise. :param mean: Mean value of the noise :param sigma: Scale of the noise (std here) :param dtype: Type of the output noise meansigmadtyper NcF>XlX lX0l[TU]5 gr )_mu_sigma_dtyperr)rr,r-r.rs rrNormalActionNoise.__init__&s   rc[RRURUR5R UR 5$r )r$randomnormalr0r1astyper2rs rrNormalActionNoise.__call__,s0yy$++6==dkkJJrc<SURSURS3$)NzNormalActionNoise(mu=, sigma=)r0r1rs r__repr__NormalActionNoise.__repr__/s&txxj QGGr)r2r0r1)rr r!r"r#r$float32r%rrrstrr=r&r'r(s@rr*r*shPRzzRZZ 9^b K"**KH#HHrr*c^\rSrSrSrSSS\R 4S\RS\RS\S \S \ \RS \ S S4U4S jjjr S \R4Sjr SSjr S \4SjrSrU=r$)OrnsteinUhlenbeckActionNoise3a An Ornstein Uhlenbeck action noise, this is designed to approximate Brownian motion with friction. Based on http://math.stackexchange.com/questions/1287634/implementing-ornstein-uhlenbeck-in-matlab :param mean: Mean of the noise :param sigma: Scale of the noise :param theta: Rate of mean reversion :param dt: Timestep for the noise :param initial_noise: Initial value for the noise output, (if None: 0) :param dtype: Type of the output noise g333333?g{Gz?Nr,r-thetadt initial_noiser.r c>X0lXlX lX@lX`lXPl[ R"UR5UlUR5 [TU]-5 gr ) _thetar0r1_dtr2rFr$ zeros_like noise_prevrrr)rr,r-rDrErFr.rs rr%OrnsteinUhlenbeckActionNoise.__init__AsL   *--1  rcURURURUR- -UR--UR[ R "UR5-[ RRURRS9--nXlURUR5$)N)size) rKrHr0rIr1r$sqrtr5r6shaper7r2rnoises rr%OrnsteinUhlenbeckActionNoise.__call__Ts OOkkTXX78488C DkkBGGDHH-- 0@0@dhhnn0@0UU V   ||DKK((rcURbURUlg[R"UR5Ulg)z= reset the Ornstein Uhlenbeck noise, to the initial position N)rFr$rJr0rKrs rr"OrnsteinUhlenbeckActionNoise.reset]s5150B0B0N$,,TVTaTabfbjbjTkrc<SURSURS3$)Nz OrnsteinUhlenbeckActionNoise(mu=r:r;r<rs rr=%OrnsteinUhlenbeckActionNoise.__repr__cs 1$((8DKK=PQRRr)rIr2r0r1rHrFrKr)rr r!r"r#r$r?r%floatrrrrrr@r=r&r'r(s@rrBrB3s ".2::jjzz      +  &)"**)l S#SSrrBc\rSrSrSrS\S\SS4SjrSS\\ \SS4S jjr S\ 4S jr S\ R4S jr\S\4S j5r\R$S\SS4S j5r\S\\4Sj5r\R$S\\SS4Sj5rSrg)VectorizedActionNoisegz A Vectorized action noise for parallel environments. :param base_noise: Noise generator to use :param n_envs: Number of parallel environments base_noisen_envsr Nc0[U5UlURS:deXl[ U5Vs/sH#n[R"UR 5PM% snUl g![[4an[ SUS35UeSnAff=fs snf)NrzExpected n_envs=z& to be positive integer greater than 0) intr] TypeErrorAssertionError ValueErrorr\rangecopydeepcopynoises)rr\r]e_s rrVectorizedActionNoise.__init__os gf+DK;;? "?%?DV}M}!t}}T__5}M >* g/x7]^_ef f gNs"A+*B+B;B  BindicescUc[[UR55nUH nURUR5 M" g)z Reset all the noise processes, or those listed in indices. :param indices: The indices to reset. Default: None. If the parameter is None, then all processes are reset to their initial position. N)rclenrfr)rrjindexs rrVectorizedActionNoise.resetys; ?C ,-GE KK  $ $ &rcPSUR<S[UR5S3$)NzVecNoise(BaseNoise=z ), n_envs=r;)r\rlrfrs rr=VectorizedActionNoise.__repr__s'$T__$7z#dkkBRASSTUUrcz[R"URVs/sH o"5PM sn5nU$s snf)z= Generate and stack the action noise from each noise object. )r$stackrfrQs rrVectorizedActionNoise.__call__s1t{{;{e%'{;< Expected base_noise to be an instance of ActionNoise, not Nonez9Expected base_noise to be an instance of type ActionNoise)rbr isinstancer`ru)rr\s rr\rvs9  ]_jk k*k22WYde e%rcUR$r )_noisesrs rrfVectorizedActionNoise.noisess ||rrfc [U5n[U5UR:Xd!SURS[U5S35e[U5VVs/sH-up#[ U[ UR 55(aM+UPM/ nnn[U5(a#[SUS3[ UR 55eXlUHnUR5 M gs snnf)NzExpected a list of z ActionNoises, found .zNoise instances at indices z# don't match the type of base_noise) listrlr] enumeraterxtyper\rbrzr)rrfirRdifferent_typess rrfr{sf6{dkk)q-@ Mbcfgmcnboop+qq)-6v->o->jQVX\]a]l]lXmFn1->o   -o->>abdhimixixdy  E KKMps *CC)rurzr\r]rfr )rr r!r"r#r r_rrrrr@r=r$r%rpropertyr\setterr~rfr&rrrrZrZgsN;NNN 'Xhsm4 ' 'V#V"** K  &[&T&&[) ]] T+. 4  rrZ)rdabcrrcollections.abcrtypingrnumpyr$ numpy.typingrr r*rBrZrrrrsN #$"$#$&H H,1S;1ShGKGr