h~SrSSKJr SSKrSSKrSSKrSSKrSSKJrJ r SSK J r SSK J r SSKJr SSKJr SS KJr SS KJr SSKrSS KJrJr SS KJrJrJrJr SS KJ r J!r!J"r"J#r# SSK$J%r% SSK&J'r'J(r(J)r)J*r*J+r+J,r,J-r-J.r.J/r/J0r0 SSK1J2r2J3r3J4r4 SS/r5"SS\ 5r6"SS\45r7SSjr8g)zAn async vector environment.) annotationsN)CallableSequence)deepcopy)Enum)Queue) Connection)SynchronizedArray)Any)Spacelogger)ActTypeEnvObsType RenderFrame)AlreadyPendingCallErrorClosedEnvironmentErrorCustomSpaceErrorNoAsyncCallError)is_space_dtype_shape_equiv) CloudpickleWrapperbatch_differing_spaces batch_spaceclear_mpi_env_vars concatenatecreate_empty_arraycreate_shared_memoryiterateread_from_shared_memorywrite_to_shared_memory) ArrayType AutoresetMode VectorEnvAsyncVectorEnv AsyncStatec(\rSrSrSrSrSrSrSrSr g) r%.z?The AsyncVectorEnv possible states given the different actions.defaultresetstepcallN) __name__ __module__ __qualname____firstlineno____doc__DEFAULT WAITING_RESET WAITING_STEP WAITING_CALL__static_attributes__r,[/home/james-whalen/.local/lib/python3.13/site-packages/gymnasium/vector/async_vector_env.pyr%r%.sIGMLLr7c\rSrSrSrSSSSSS\R 4SSjjr\SSj5r \SSj5r SSS .S S jjr S!S"S jjr S#S$S jjr S%S jrS&SjrS#S'SjjrS(SjrS)SjrS*SjrS#S+SjjrS,SjrS-SjrS.S/SjjrS#S0SjjrSrSrS1SjrSrSrg)2r$7aVectorized environment that runs multiple environments in parallel. It uses ``multiprocessing`` processes, and pipes for communication. Example: >>> import gymnasium as gym >>> envs = gym.make_vec("Pendulum-v1", num_envs=2, vectorization_mode="async") >>> envs AsyncVectorEnv(Pendulum-v1, num_envs=2) >>> envs = gym.vector.AsyncVectorEnv([ ... lambda: gym.make("Pendulum-v1", g=9.81), ... lambda: gym.make("Pendulum-v1", g=1.62) ... ]) >>> envs AsyncVectorEnv(num_envs=2) >>> observations, infos = envs.reset(seed=42) >>> observations array([[-0.14995256, 0.9886932 , -0.12224312], [ 0.5760367 , 0.8174238 , -0.91244936]], dtype=float32) >>> infos {} >>> _ = envs.action_space.seed(123) >>> observations, rewards, terminations, truncations, infos = envs.step(envs.action_space.sample()) >>> observations array([[-0.1851753 , 0.98270553, 0.714599 ], [ 0.6193494 , 0.7851154 , -1.0808398 ]], dtype=float32) >>> rewards array([-2.96495728, -1.00214607]) >>> terminations array([False, False]) >>> truncations array([False, False]) >>> infos {} TNsamec XlX lX0lX@lXPlX`lXpl[U[5(aUO [U5Ul [U5Ul US"5n U RUl URURS'U RUl U RUl[!URUR5Ul[U["5(aS[U5S:XaD[US[$5(de[US[$5(deUuUlUlOUS:Xa7U R&Ul[!UR(UR5UlOYUS:XaEURV s/sHo"5R&PM n n U SUl[+U 5UlO[-SU35eU R/5 A [0R2"U5n UR(aD[5UR(URU S9n [7UR(XRS 9UlO4S n [=UR(UR[>R@S 9Ul//sUl!Ul"U RG5Ul$U=(d [Jn[M5 [OUR5HunnU RQ5unnU RSUS [UU5RVSU3U[YU5UUU URHUR4S9nURBR[U5 URDR[U5 UUlUR]5 UR/5 M S S S 5 [^R`Ul1URe5 g s sn f![:an[-S 5UeS nAff=f!,(df  NW=f)aG Vectorized environment that runs multiple environments in parallel. Args: env_fns: Functions that create the environments. shared_memory: If ``True``, then the observations from the worker processes are communicated back through shared variables. This can improve the efficiency if the observations are large (e.g. images). copy: If ``True``, then the :meth:`AsyncVectorEnv.reset` and :meth:`AsyncVectorEnv.step` methods return a copy of the observations. context: Context for `multiprocessing`. If ``None``, then the default context is used. daemon: If ``True``, then subprocesses have ``daemon`` flag turned on; that is, they will quit if the head process quits. However, ``daemon=True`` prevents subprocesses to spawn children, so for some environments you may want to have it set to ``False``. worker: If set, then use that worker in a subprocess instead of a default one. Can be useful to override some inner vector env logic, for instance, how resets on termination or truncation are handled. observation_mode: Defines how environment observation spaces should be batched. 'same' defines that there should be ``n`` copies of identical spaces. 'different' defines that there can be multiple observation spaces with different parameters though requires the same shape and dtype, warning, may raise unexpected errors. Passing a ``Tuple[Space, Space]`` object allows defining a custom ``single_observation_space`` and ``observation_space``, warning, may raise unexpected errors. autoreset_mode: The Autoreset Mode used, see https://farama.org/Vector-Autoreset-Mode for more information. Warnings: worker is an advanced mode option. It provides a high degree of flexibility and a high chance to shoot yourself in the foot; thus, if you are writing your own worker, it is recommended to start from the code for ``_worker`` (or ``_async_worker``) method, and add changes. Raises: RuntimeError: If the observation space of some sub-environment does not match observation_space (or, by default, the observation space of the first sub-environment). ValueError: If observation_space is a custom space (i.e. not a default space in Gym, such as gymnasium.spaces.Box, gymnasium.spaces.Discrete, or gymnasium.spaces.Dict) and shared_memory is True. rautoreset_moder; differentzwInvalid `observation_mode`, expected: 'same' or 'different' or tuple of single and batch observation space, actual got )nctx)rAzUsing `AsyncVector(..., shared_memory=True)` caused an error, you can disable this feature with `shared_memory=False` however this is slower.N)rAfnzWorker-)targetnameargs)3env_fns shared_memorycopycontextdaemonworkerobservation_mode isinstancer"r=lennum_envsmetadata render_mode action_spacesingle_action_spacertupler observation_spacesingle_observation_spacer ValueErrorclosemultiprocessing get_contextrr observationsrrnpzeros parent_pipes processesr error_queue _async_workerr enumeratePipeProcesstyper-rappendstartr%r2_state _check_spaces)selfrGrHrIrJrKrLrMr= dummy_envenv env_spacesrB _obs_buffererDidxenv_fn parent_pipe child_pipeprocesss r8__init__AsyncVectorEnv.__init__\s^ *    0.-88 ~.  G  AJL "** *.*=*= &'$00#,#9#9 '(@(@$--P & . .37G3HA3M.q1599 99.q1599 99DT AD "D$A6)090K0K-)4114==*&"[0BFN#ce55 N0:1 -)? )K& NO_N`a  ))'2    211T]] %<11;--%!K 2--288!D -/)4>99;(=  !(6 V*-((*' Z++!"4:#6#6"7r#?*62"##((++& !!((5%%g.!'   "+ 7"0!((  yO,$  d " !s,OAOCO7 O4# O//O47 Pc$URS5$)z`options['reset_mask': mask]` must have `dtype=np.bool_`, got zK`options['reset_mask': mask]` must contain a boolean array, got reset_mask=rr)) reset-noopN)_assert_is_runningrangerPrNintrOrir%r2rvaluestrpopr]ndarrayrfshapedtypebool_anyzipr_sendr3) rkrr_irpipeenv_seed env_reset env_kwargss r8rAsyncVectorEnv.reset_async s& ! <"' "67"6QD"6D7D c " "&+DMM&:;&:1H&:D; I & w J4==/Yijmnrjsittu v w & ;;*,, ,)MdkkN_N_M``mnDKK%%&   <7#: \2JBJJ ^J4PZK[J\] ^## ( mA$--PYZdZjZjYkl m  BHH, cOPZP`P`Oab c,66 j\]g\hi j.11B1BD-U) *2!GJIIw 34II23 .V#&d&7&7">&.C  7J/0#?!.. O8;s J&Jc&UR5 UR[R:wa$[ S[RR 5eUR U5(d/[RUl[R"SUS35e[URVs/sHo"R5PM sn6up4URU5 0n[U6up6[U5HupxURXXU5nM UR (d%[#UR$X0R&5Ul[RUlUR((a[+UR&5U4$UR&U4$s snf)a/Waits for the calls triggered by :meth:`reset_async` to finish and returns the results. Args: timeout: Number of seconds before the call to ``reset_wait`` times out. If `None`, the call to ``reset_wait`` never times out. Returns: A tuple of batched observations and list of dictionaries Raises: ClosedEnvironmentError: If the environment was closed (if :meth:`close` was previously called). NoAsyncCallError: If :meth:`reset_wait` was called without any prior call to :meth:`reset_async`. TimeoutError: If :meth:`reset_wait` timed out. z=Calling `reset_wait` without any prior call to `reset_async`.z-The call to `reset_wait` has timed out after second(s).)rrir%r3rr_poll_pipe_envsr2rZ TimeoutErrorrr_recv_raise_if_errorsrc _add_inforHrrWr\rIr) rktimeoutrresults successesinfos info_datarinfos r8rAsyncVectorEnv.reset_waitLsV" ! ;;*22 2"R((..  ##G,,$,,DK!..?y T !4;L;L"M;L499;;L"MN i( '] +GANN52E,!! +--w8I8I!D !(( /3yy**+RWWWd>O>ORWWW#Ns+FcDURU5 UR5$)zTake an action for each parallel environment. Args: actions: element of :attr:`action_space` batch of actions. Returns: Batch of (observations, rewards, terminations, truncations, infos) ) step_async step_wait)rkactionss r8r*AsyncVectorEnv.stepzs  ~~r7cUR5 UR[R:waA[ SURR S3[ URR 55e[URU5n[URUSS9Hup4URSU45 M [RUlg)aSend the calls to :meth:`Env.step` to each sub-environment. Args: actions: Batch of actions. element of :attr:`VectorEnv.action_space` Raises: ClosedEnvironmentError: If the environment was closed (if :meth:`close` was previously called). AlreadyPendingCallError: If the environment is already waiting for a pending call to another method (e.g. :meth:`reset_async`). This can be caused by two consecutive calls to :meth:`step_async`, with no call to :meth:`step_wait` in between. z:Calling `step_async` while waiting for a pending call to `` to complete.T)strictr*N) rrir%r2rrrrrSrr_rr4)rkr iter_actionsractions r8rAsyncVectorEnv.step_asyncs ! ;;*,, ,)LT[[M^M^L__mnDKK%%&  t00':  1 1<MLD IIvv& 'N -- r7cUR5 UR[R:wa$[ S[RR 5eUR U5(d/[RUl[R"SUS35e////04up#pEn/n[UR5HupU R5upURU 5 U (dM1URU S5 URU S5 URU S5 URU S5 URXjSU5nM URU5 UR (d&[#UR$UUR&5Ul[RUlUR((a[+UR&5O UR&[,R."U[,R0S 9[,R."U[,R2S 9[,R."U[,R2S 9U4$) a>Wait for the calls to :obj:`step` in each sub-environment to finish. Args: timeout: Number of seconds before the call to :meth:`step_wait` times out. If ``None``, the call to :meth:`step_wait` never times out. Returns: The batched environment step information, (obs, reward, terminated, truncated, info) Raises: ClosedEnvironmentError: If the environment was closed (if :meth:`close` was previously called). NoAsyncCallError: If :meth:`step_wait` was called without any prior call to :meth:`step_async`. TimeoutError: If :meth:`step_wait` timed out. z;Calling `step_wait` without any prior call to `step_async`.z,The call to `step_wait` has timed out after rrr?r>)r)rrir%r4rrrr2rZrrcr_rrgrrrHrrWr\rIrr]arrayfloat64r) rkrr\rewards terminations truncationsrrenv_idxrenv_step_returnsuccesss r8rAsyncVectorEnv.step_waits ! ;;*11 1"P''--  ##G,,$,,DK!..>wi{S CEb"bRTBT? |% &t'8'89MG'+yy{ $O   W %w##OA$67q12##OA$67""?1#56ua.@'J: i(!! +--!!!D  !(( +/99HT&& '$:K:K HHWBJJ / HH\ 2 HH[ 1    r7cNUR"U/UQ70UD6 UR5$)adCall a method from each parallel environment with args and kwargs. Args: name (str): Name of the method or property to call. *args: Position arguments to apply to the method call. **kwargs: Keyword arguments to apply to the method call. Returns: List of the results of the individual calls to the method or property for each environment. ) call_async call_wait)rkrErFkwargss r8r+AsyncVectorEnv.calls' .t.v.~~r7c$URS5$)z8Returns a list of rendered frames from the environments.renderr+r|s r8rAsyncVectorEnv.rendersyy""r7c\UR5 UR[R:waA[ SURR S3[ URR 55eURHnURSXU445 M [RUlg)aCalls the method with name asynchronously and apply args and kwargs to the method. Args: name: Name of the method or property to call. *args: Arguments to apply to the method call. **kwargs: Keyword arguments to apply to the method call. Raises: ClosedEnvironmentError: If the environment was closed (if :meth:`close` was previously called). AlreadyPendingCallError: Calling `call_async` while waiting for a pending call to complete z:Calling `call_async` while waiting for a pending call to `r_callN) rrir%r2rrrr_rr5)rkrErFrrs r8rAsyncVectorEnv.call_asyncs ! ;;*,, ,)LT[[M^M^L__mnDKK%%&  %%D IIwV 45 6& -- r7cUR5 UR[R:wa$[ S[RR 5eUR U5(d/[RUl[R"SUS35e[URVs/sHo"R5PM sn6up4URU5 [RUlU$s snf)aCalls all parent pipes and waits for the results. Args: timeout: Number of seconds before the call to :meth:`step_wait` times out. If ``None`` (default), the call to :meth:`step_wait` never times out. Returns: List of the results of the individual calls to the method or property for each environment. Raises: NoAsyncCallError: Calling :meth:`call_wait` without any prior call to :meth:`call_async`. TimeoutError: The call to :meth:`call_wait` has timed out after timeout second(s). z;Calling `call_wait` without any prior call to `call_async`.z,The call to `call_wait` has timed out after r)rrir%r5rrrr2rZrrr_rr)rkrrrrs r8rAsyncVectorEnv.call_waits ! ;;*11 1"M''--  ##G,,$,,DK!..>wi{S !4;L;L"M;L499;;L"MN i( ((  #Ns+C2c$URU5$)zGet a property from each parallel environment. Args: name (str): Name of the property to be get from each individual environment. Returns: The property with name r)rkrEs r8r{AsyncVectorEnv.get_attr'syyr7cUR5 [U[[45(d$[ UR 5Vs/sHo2PM nn[ U5UR :wa%[S[ U5SUR S35eUR[R:waA[SURRS3[URR55e[URU5HupEUR!SX445 M [URVs/sHoDR#5PM sn6up6UR%U5 gs snfs snf)a$Sets an attribute of the sub-environments. Args: name: Name of the property to be set in each individual environment. values: Values of the property to be set to. If ``values`` is a list or tuple, then it corresponds to the values for each individual environment, otherwise a single value is set for all environments. Raises: ValueError: Values must be a list or tuple with length equal to the number of environments. AlreadyPendingCallError: Calling :meth:`set_attr` while waiting for a pending call to complete. zUValues must be a list or tuple with length equal to the number of environments. Got `z ` values for z environments.z8Calling `set_attr` while waiting for a pending call to `r_setattrN)rrNlistrUrrPrOrXrir%r2rrrrr_rrr)rkrEvaluesrrrrs r8set_attrAsyncVectorEnv.set_attr2s6 !&4-00&+DMM&:;&:f&:F; v;$-- 'F }M$--P  ;;*,, ,)J4;;K\K\J]]klDKK%%&  t00&9KD IIzD=1 2:T5F5FG5FTYY[5FGH  i(!<Hs  E$3E)cJU(aSOUnUR[R:waX[R"SURR S35 [ XRR S35nU"U5 U(a;URH*nUR5(dMUR5 M, OwURH,nUcMUR(aMURS5 M. URH+nUcMUR(aMUR5 M- URHnUcMUR!5 M URHnUR#5 M g![Ra SnGNf=f)aClose the environments & clean up the extra resources (processes and pipes). Args: timeout: Number of seconds before the call to :meth:`close` times out. If ``None``, the call to :meth:`close` never times out. If the call to :meth:`close` times out, then all processes are terminated. terminate: If ``True``, then the :meth:`close` operation is forced and all processes are terminated. Raises: TimeoutError: If :meth:`close` timed out. rz5Calling `close` while waiting for a pending call to `r_waitTN)rYN)rir%r2r warnrgetattrrZrr`is_alive terminater_closedrrrYjoin)rkrrfunctionrurs r8 close_extrasAsyncVectorEnv.close_extrasSsG!!g {{j000 KDKKL]L]K^^lm#4KK,=,=+>e)DE! >>##%%%%'*))$t{{{IIo.*))$t{{{IIK*%%D &~~G LLN&%++ I sA6FF"!F"c"UR5 Ucg[R"5U-nURHSn[ U[R"5- S5nUc gUR (dUR U5(aMS g g)NTrF)rtime perf_counterr_maxrpoll)rkrend_timerdeltas r8rAsyncVectorEnv._poll_pipe_envs|sx ! ?$$&0%%D4#4#4#66:E|{{499U#3#3 &r7cUR5 URH7nURSURURUR 445 M9 [ URVs/sHoR5PM sn6up#URU5 [ U6upE[U5(d&URS:Xa [S5e[S5e[U5(d[SUR S35egs snf)Nrjr;zAsyncVectorEnv(..., observation_mode='same') however some of the sub-environments observation spaces are not equivalent. If this is intentional, use `observation_mode='different'` instead.zAsyncVectorEnv(..., observation_mode='different' or custom space) however the sub-environment's observation spaces do not share a common shape and dtype.z7Some environments have an action space different from `zT`. In order to batch actions, the action spaces from all environments must be equal.) rr_rrMrWrTrrrall RuntimeError)rkrrrsame_observation_spacessame_action_spacess r8rjAsyncVectorEnv._check_spacess !%%D II#--5500 &!4;L;L"M;L499;;L"MN i(697m3*++$$."S#p%&&I$JbJbIcddd '#Ns+DcjUR(a"[S[U5RS35eg)NzTrying to operate on `z`, after a call to `close()`.)rrrfr-r|s r8r!AsyncVectorEnv._assert_is_runnings3 ;;((d)<)<(==Z[  r7c[U5(agUR[U5- nUS:de[U5HnURR 5upEpg[ R"SUS35 [ R"U5 URUR5 SURU'X2S- :XdM[ R"S5 [RUl U"U5e g)Nrz)Received the following error from Worker-z - Shutting it downr?z4Raising the last exception back to the main process.) rrPsumrragetr errorr_rYr%r2ri)rkr num_errorsrindexexctypertraces r8rAsyncVectorEnv._raise_if_errorss y>> ]]S^3 A~~z"A+/+;+;+?+?+A (EE LL;E7BUV  LLE7 $   e $ * * ,'+D  e $N" ST(00 en$#r7cl[USS5(d"[US5(aURSS9 ggg)zEOn deleting the object, checks that the vector environment is closed.rTri)rN)rhasattrrYr|s r8__del__AsyncVectorEnv.__del__s4tXt,,x1H1H JJJ &2I,r7)rirSr=rJrIrKrGrarQrPrMrVr\r_r`rRrHrTrWrL)rGzSequence[Callable[[], Env]]rHboolrIrrJz str | NonerKrrLzTCallable[[int, Callable[[], Env], Connection, Connection, bool, Queue], None] | NonerMz str | Spacer=zstr | AutoresetMode)returnztuple[int, ...])rztuple[np.random.Generator, ...])rint | list[int | None] | Nonerzdict[str, Any] | Nonertuple[ObsType, dict[str, Any]])NN)rrrz dict | None)N)rint | float | Nonerr)rrrz?tuple[ObsType, ArrayType, ArrayType, ArrayType, dict[str, Any]])rz np.ndarray)rrrz;tuple[np.ndarray, np.ndarray, np.ndarray, np.ndarray, dict])rErrFr rr rtuple[Any, ...])rztuple[RenderFrame, ...] | None)rEr)rrrr)rErrr)rErrzlist[Any] | tuple[Any] | objectNF)rrrr)rz int | None)rzlist[bool] | tuple[bool])r-r.r/r0r1r" NEXT_STEPrvpropertyryrr)rrr*rrr+rrrr{rrrrjrrrr6r,r7r8r$r$7s"N#" (..;.E.ES,SS S  S  S S&S,Sj//**/3)- !,!' ! ( !(/3#=/+=/=/B'+,X#,X (,X\    H  .4-1: ): D: x  #..B )B'R !F %,'r7cU"5nURnURn Sn Sn UR5 UR5upU S:XaAUR"S0U D6upU(a[ XX5 Sn Sn UR X4S45 GOCU S:XaUR U 04S45 GO&U S:XGaU[R:XaCU (aUR 5upSunnnOURU 5un nnnnU=(d Un OU[R:XaBURU 5un nnnnU(dU(aUR 5unnUU S.UEnUn OAU[R:XaU SLdeURU 5un nnnnO[SU35eU(a[ XX5 Sn UR XUUU4S45 GOU S :XaUR S 5 OU S :XamU unnnUS ;a[S USUS35eURU5n[U5(aUR U"U0UD6S45 OUR US45 OxU S:Xa)U unnURUU5 UR S 5 OIU S:Xa4U unnnUR US:XaUU:HO [!UU5UU :H4S45 O[#SU S35eGMUR5 g![$[&4aW [(R*"5unnn[,R."5nUR1UUUU45 UR S5 Nwf=f!UR5 f=f)NFTr)rr*)rFF) final_info final_obszUnexpected autoreset_mode: rY)NTr)r)r*rYrrjzTrying to call function `z` with `call`, use `z` directly instead.rrjr;zReceived unknown command `zS`. Must be one of [`reset`, `step`, `close`, `_call`, `_setattr`, `_check_spaces`].r r,)rVrSrYrr)r rr"r r* SAME_STEPDISABLEDrXget_wrapper_attrcallableset_wrapper_attrrrKeyboardInterrupt Exceptionsysexc_info traceback format_excput) rrrrrsrHrar=rmrVrS autoreset observationcommanddatarreward terminated truncatedreset_observation reset_inforErFrattrrobs_modesingle_obs_spacerT error_type error_messagerrs r8rbrbs (C--##LIKr IIKMG'!$'II$5$5!  *)+#'K %I K.56L( K,d34F"!]%<%<< ,/IIK) 8G5 I HHTN '"&% * 7iI#}'>'>> #"!"Y8; 5):+/)4 )  '8 #}'='==$--- #"!%'B>BR%STT *)+#'K KYMtTUG# ,'G#%)"dFRR$3D69MdVSfg++D1D>>IItT4V4d;<IItTl+J&" e$$T51 ,'O+BF?*,? $,v#5!14E E%?$46G&"0<?   #0 :MNOb  y )!'*||~$ M1$$& M5AB - ! s2F1K&&M'C.K&&A$M  M M  MM")rrrrrrr rsr rHz4SynchronizedArray | dict[str, Any] | tuple[Any, ...]rarr=r")9r1 __future__rrZrrrcollections.abcrrrIrenumrrmultiprocessing.connectionr multiprocessing.sharedctypesr typingr numpyr] gymnasiumr r gymnasium.corerrrrgymnasium.errorrrrrgymnasium.spaces.utilsrgymnasium.vector.utilsrrrrrrrrrr gymnasium.vector.vector_envr!r"r#__all__r%r$rbr,r7r8r7s"" .!1:#== >   LK \ *W 'YW 'tC C C C C H C  C"Cr7