hg P%SSKrSSKrSSKrSSKrSSKJr SSKJr SSKJ r J r J r J r J r JrJrJrJrJrJrJrJrJr SSKrSSKJrJrJrJrJr SSKJr SSK J!r! SS K"J#r# SS K$J%r%J&r&J'r'J(r(J)r) \"S 5r*\"S 5r+\"S SS9r,\"S0S9r-\\.\/S'S$Sjr0"SS\ \*\+45r1\RdS\ S\ S\3S\1S\44 Sj5r5\RdS\ S\ S\3S\1S\ 4 Sj5r6\"S\1S9r7S\7S\ \3\ \3\ 44S\74Sjr8S/4S\7S\9S\74S jjr:S\1S!\ \1/\74S\74S"jr;/S#Qrjr>S{S<\\<S?\\=SS4S@jjr?S<\r@N)r:dimsparamslayersshimsattrsrefsr7forwardrBrCrDrErFrGcXlUc[[U5n[USU5 [USU5 U bU O [ 5Ul[ 5Ul[U5Ul [U5Ul [U 5Ul [U5Ul [U5Ul[R  [=R"S- sl[R"UlSSS5 0UlUR)5H*upSUR&U'U cMUR+X5 M, g!,(df  NT=f)zInitialize a new model.Nr9r:r)r6rr0setattrrr7rr;dictr<r?rAlistr=r>r$r5r4r8r@items set_param) selfr6rHr:rBrCrDrErFrGr7values r/__init__Model.__init__Us <:t,Dgw'fd#/3/@"} $Z 5k $Z F| 5k  ! ! OOq OooDG"!<<>KD%)D  T " t+* " !s 7/D44 Er)cUR$)z]A list of child layers of the model. You can append to it to add layers but not reassign it. )r=rOs r/rD Model.layers|s ||r1cUR$r+)r>rTs r/rE Model.shimss {{r1cUR$)zVA dict of the model's attrs. You can write to it to update attrs but not reassign it. )r?rTs r/rF Model.attrss {{r1.cH[URR55$)z8Get the names of registered parameter (including unset).)tupler@keysrTs r/ param_namesModel.param_namessT%%**,--r1c[URVs/sHoRU5(dMUPM sn5$s snf)zHGet the names of parameters with registered gradients (including unset).)r[r]has_gradrOr6s r/ grad_namesModel.grad_namess2t'7'7O'7t==;Nd'7OPPOs>>cH[URR55$)z9Get the names of registered dimensions (including unset).)r[r<r\rTs r/ dim_namesModel.dim_namesTZZ__&''r1cH[URR55$)z>Get the names of registered node references (including unset).)r[rAr\rTs r/ ref_namesModel.ref_namesrgr1 operatorsc## URR[U55nSv URRU5 g7f)zBind arbitrary binary functions to Python operators, for use in any `Model` instance. Can (and should) be used as a contextmanager. EXAMPLE: with Model.define_operators({">>": chain}): model = Relu(512) >> Relu(512) >> Softmax() N)_context_operatorssetrKreset)clsrktokens r/define_operatorsModel.define_operatorss8&&**4 ?;  $$U+sAAcFXR;agURUbgg)z~Check whether the model has a dimension of a given name. If the dimension is registered but the value is unset, returns None. FNT)r<ras r/has_dim Model.has_dim& zz ! ZZ  )r1cXR;a[SUSURS35eURUnUcSUSURS3n[U5eU$)z4Retrieve the value of a dimension of the given name.zCannot get dimension ' ' for model ''z': value unset)r<KeyErrorr6 ValueErrorrOr6rPerrs r/get_dim Model.get_dimsf zz !3D6tyykQRST T 4  =*4& dii[WCS/ !Lr1F)forcerPrcXR;a[SUSURS35eURUn[SURR 555nUSL=(a XB:g=(a U(+=(d U=(a UnU(a#SUSURSUSU3n[ U5eX RU'g) zSet a value for a dimension.zCannot set unknown dimension 'ry'.c3<# UHup[U5v M g7fr+)bool).0xys r/ Model.set_dim..sF-ETQa-EsNzAttempt to change dimension 'z' from z to )r<r{r6anyr@rMr|)rOr6rPr old_value has_paramsinvalid_changer~s r/set_dim Model.set_dims zz !0mDII;bQ JJt$ FT-=-=-C-C-EFF #4/FI4F I --:  1$}TYYKwW`VaaefkelmCS/ ! 4r1cTURU5(aURU5$S$)z=Retrieve the value of a dimension of the given name, or None.N)rurras r/ maybe_get_dimModel.maybe_get_dim$%)\\$%7%7t||D!ATAr1cFXR;agURUbgg)zCheck whether the model has a weights parameter of the given name. Returns None if the parameter is registered but currently unset. FNT)r@ras r/ has_paramModel.has_params* '' '   d # /r1c2XR;a[SUSURS35eURR UR U5(d[SUSURS35eURR UR U5$)z%Retrieve a weights parameter by name.zUnknown param: 'ryrz Parameter 'z' has not been allocated yet.)r@r{r6r;rr8 get_paramras r/rModel.get_params '' '-dV= 2NO O||%%dggt44dV= ;XY ||%%dggt44r1cTURU5(aURU5$S$)z.Retrieve a weights parameter by name, or None.N)rrras r/maybe_get_paramModel.maybe_get_params$'+~~d';';t~~d#EEr1cUcSURU'gURRURX5 SURU'g)z Set a weights parameter's value.NT)r@r;rNr8rOr6rPs r/rNModel.set_params? =%)D  T " LL " "477D 8%)D  T "r1cNURRURU5$)z@Check whether the model has a non-zero gradient for a parameter.)r;r`r8ras r/r`Model.has_grad||$$TWWd33r1cNURRURU5$)zGet a gradient from the model.)r;get_gradr8ras r/rModel.get_gradrr1cPURRURX5 g)z#Set a gradient value for the model.N)r;set_gradr8rs r/rModel.set_grad dggt3r1cTURU5(aURU5$S$)z%Retrieve a gradient by name, or None.N)r`rras r/maybe_get_gradModel.maybe_get_grads$&*mmD&9&9t}}T"CtCr1cPURRURX5 g)z1Increment the gradient of a parameter by a value.N)r;inc_gradr8rs r/rModel.inc_grad rr1cFXR;agURUbgg)z~Check whether the model has a reference of a given name. If the reference is registered but the value is unset, returns None. FNT)rAras r/has_ref Model.has_refrwr1cXR;a[SUSURS35eURUnUcSUSURS3n[U5eU$)z4Retrieve the value of a reference of the given name.zCannot get reference 'ryrz': value unset.)rAr{r6r|r}s r/get_ref Model.get_refsf zz !3D6tyykQSTU U 4  =*4& dii[XCS/ !Lr1cTURU5(aURU5$S$)z8Retrieve the value of a reference if it exists, or None.N)rrras r/ maybe_get_refModel.maybe_get_ref&rr1cUcX RU'gX R5;aX RU'g[S5e)zSet a value for a reference.Nz)Cannot add reference to node not in tree.)rAwalkr|rs r/set_ref Model.set_ref*s7 =$JJt  iik !$JJt HI Ir1Xis_trainc"URXUS9$)zvCall the model's `forward` function, returning the output and a callback to compute the gradients via backpropagation.rr9)rOrrs r/__call__Model.__call__3szz$Hz55r1Yc[R"5(a![URURX5 UR bUR XUS9 U$)z}Finish initialization of the model, optionally providing a batch of example input and output data to perform shape inference.)rr)rgetr r6r9r:)rOrrs r/ initializeModel.initialize8sF    %diiQ B 99 IId1I % r1c"URXSS9$)aHRun the model over a batch of data, returning the output and a callback to complete the backward pass. A tuple (Y, finish_update), where Y is a batch of output data, and finish_update is a callback that takes the gradient with respect to the output and an optimizer function, and returns the gradient with respect to the input. TrrrOrs r/ begin_updateModel.begin_updateAszz$Dz11r1c(URXSS9S$)zCall the model's `forward` function with `is_train=False`, and return only the output, instead of the `(output, callback)` tuple. Frrrrs r/predict Model.predictJszz$Ez2155r1 optimizerc UR5H'nURHnURU5 M M) UR5HunURHbnUR U5(dMU"UR U4UR U5URU55upVURXE5 Md Mw g)zqUpdate parameters with current gradients. The optimizer is called with each parameter and gradient of the model. N) rrE finish_updater]r`r8rrrN)rOrnodeshimr6paramgrads r/rModel.finish_updatePsIIKD ""9-# IIKD((==&&"+$)=t}}T?R#KENN4/ ) r1c#D# 0nURH?nURU4nXA;dMURU5X#'URX1U5 MA [R "5nUR H#nURURU55 M% URH#nURURU55 M% Sv SSS5 U(a+UR5Hup8URX85 M gg!,(df  NA=f7f)zContext manager to temporarily set the model's parameters to specified values. The params are a dictionary keyed by model IDs, whose values are arrays of weight values. N) r]r8rrN contextlib ExitStackrD enter_context use_paramsrErM) rOrCbackupr6keystacklayerrrs r/rModel.use_params_s $$D77D/C}#~~d3 tC[1 %  ! ! #u##E$4$4V$<=% ##DOOF$;<#  $ %||~ t+ .  $ #s$#D AD )A+D;D  DD bfsorderrcUS:XaUR5$US:XaURSS9$US:XaURSS9$[S5e)zIterate out layers of the model. Nodes are returned in breadth-first order by default. Other possible orders are "dfs_pre" (depth-first search in preorder) and "dfs_post" (depth-first search in postorder).rdfs_preF) post_orderdfs_postTz5Invalid order, must be one of: bfs, dfs_pre, dfs_post) _walk_bfs _walk_dfsr|)rOrs r/r Model.walkvsV E>>># # i >>U>3 3 j >>T>2 2TU Ur1c## U/n[5nUHMn[U5U;aMUR[U55 Uv URUR5 MO g7f)z/Iterate out layers of the model, breadth-first.N)rnr8addextendrD)rOqueueseenrs r/rModel._walk_bfssQD$x4 HHRX J LL % sA"A$rc## [5nU/n[UR5U[U5'U(dUv U(aq[ U[US55n[U5U;a=U(dUv UR U5 [UR5U[U5'U(aMpgg![ a! U(aUSv UR5 N5f=f7f)z-Iterate out layers of the model, depth-first.N)rKiterrDr8nextappend StopIterationpop)rOrrr next_childs r/rModel._walk_dfss-1Vdkk*RXJ !$r%)}"56 *~-%((LL,+/ 0A0A+BDJ(e! )O  s1AC#A&B5*C#3C#5(C C#C  C#c[UR55H@nXR;dMURRU5 XR;aM,MB [ UR55nUHEnUR H2nUR U5nUcMXS;dM URUS5 M4 MG g)a5Remove a node from all layers lists, and then update references. References that no longer point to a node within the tree will be set to `None`. For instance, let's say a node has its grandchild as a reference. If the child is removed, the grandchild reference will be left dangling, so will be set to None. N)rLrrDremovernrirr)rOrchildtreer6refs r/ remove_nodeModel.remove_nodes$))+&E,,& ##D),,&'499;Dll4(?sLLt,'r1)r:c8[USU5 [USU5 g)Nr9r:)rJ)rOrHr:s r/replace_callbacksModel.replace_callbackss gw'fd#r1oldnewc&Sn[URSS95HmnXALaSnM URVs/sH oUULaUOUPM snUlURH*nUR U5ULdMUR Xb5 M, Mo U$s snf)zrReplace a node anywhere it occurs within the model. Returns a boolean indicating whether the replacement was made.FrrT)rLrr=rirr)rOrrrrrr6s r/ replace_nodeModel.replace_nodes 45D{AE  @LuC>$3G3G4>>$/TFL%&( [[E%yD $$T%bi%AB${{40 ".RY$$\2 ! JJD$x4##DtBtH~$>?"iik !,RX##K0 $) II JJ==(tzz*-- ,  $ OOD OOD--"5":":"< =$E6""r1gpu_idcSSKnURRRU5 UR [ 55 SSS5 g!,(df  g=f)z)Transfer the model to a given GPU device.rN)cupy.cuda.devicecudadeviceDevice_to_opsr)rOrcupys r/to_gpu Model.to_gpus7 YY   $ $V , LL #- , ,s A  Ac6UR[55 g)zTransfer the model to CPU.N)r!rrTs r/to_cpu Model.to_cpus XZ r1c UR5HnXlURHnURU5(a/UR X1R UR U555 URU5(dM`URX1R URU555 M URH)nURURUR5 M+ M g)z Common method for to_cpu/to_gpu.N)rr7r]rrN asarray_frr`rrrE to_device device_type device_id)rOr7rr6rs r/r! Model._to_opssIIKDH((>>$''NN4t~~d7K)LM==&&MM$ dmmD6I(JK )  s ># r1cUR5n[URRSS9n[ [ X!5n[ R"U5$)a9Serialize the model to a bytes representation. Models are usually serialized using msgpack, so you should be able to call msgpack.loads() on the data and get back a dictionary with the contents. Serialization should round-trip identically, i.e. the same bytes should result from loading and serializing a model. <) byte_order)to_dictrr7to_numpyrrsrsly msgpack_dumps)rOmsg to_numpy_les r/to_bytesModel.to_bytes&sBllndhh//C@  [>""3''r1pathc[U[5(a [U5OUnURS5nUR UR 55 SSS5 g!,(df  g=f)zSerialize the model to disk. Most models will serialize to a single file, which should just be the bytes contents of model.to_bytes(). wbN) isinstancestrropenwriter7)rOr9file_s r/to_disk Model.to_disk3sD(c22tDz YYt_ KK  (__s A A+c////S.n[UR55n[U5VVs0sHup4URU_M nnn[U5Hup40n/nURHcnUR U5(dSXh'MUR U5n U RU;aXYRXh'MRURU5 Me U(a[SU35e0n URH.n URU 5(aURU 5OSX'M0 USRX4RXS.5 M UHKn0n URR5Hup[XX5X'M USRU 5 MM UH?nUSRUR"Vs/sHoR%5PM sn5 MA UHpn0nUR&HGnUR)U5(a*[+[,[.UR1U55X'MCSX'MI USRU5 Mr U$s snnf![ a GMf=fs snf) zSerialize the model to a dict representation. Serialization should round-trip identically, i.e. the same dict should result from loading and serializing a model. )nodesrFrCrENzCannot get references: rD)indexr6rBrGrFrErC)rLr enumerater8rirrrr|rerurr6rFrMserialize_attr TypeErrorrEr7r]rrr rr)rOr5rDir node_to_irG invalid_refsr6rrBdimrFrPrrCs r/r1 Model.to_dict;s:*,bBQSTTYY[! 09/?@/?GATWWaZ/? @ 'GA-/D&(L||D))!%DJ,,t,Cvv*%.vv%6 $++D1' #:<.!IJJD~~15c1B1BDLL- & L  YYK #((DE#zz//1 "0t"JEK 2 L   &D L  TZZ HZTZ H ID46F((>>$''#'(:DNN4I2 I/.I/ bytes_datac[R"U5n[[URR U5nUR U5$)a=Deserialize the model from a bytes representation. Models are usually serialized using msgpack, so you should be able to call msgpack.loads() on the data and get back a dictionary with the contents. Serialization should round-trip identically, i.e. the same bytes should result from loading and serializing a model. )r3 msgpack_loadsrrr7asarray from_dict)rOrNr5s r/ from_bytesModel.from_bytests;!!*- TXX-=-=sC~~c""r1c[U[5(a [U5OUnURS5nUR 5nSSS5 UR W5$!,(df  N=f)zDeserialize the model from disk. Most models will serialize to a single file, which should just be the bytes contents of model.to_bytes(). rbN)r<r=rr>readrS)rOr9r@rNs r/ from_diskModel.from_disksO(c22tDz YYt_Jz**_s A A,r5cSUR5;a Sn[U5e[UR55n[ US5[ U5:wa [S5e[ U5GHyupEUSUnUSUlUSR5HupxUcM URXx5 M USR5H0upU cURU S5 MURXU 5 M2 USUR5H:upURRU 5n [XX5n XRU 'M< USUR5HBupUb)URRU5R5nUR!X5 MD [ US U5H#upOUR"UR%U5 M% GM| U$) NrDzMTrying to read a Model that was created with an incompatible version of Thincz.Cannot deserialize model: mismatched structurer6rBrGrFrCrE)r\r|rLrlenrFr6rMrrrFrdeserialize_attrr7rQrrNrErS)rOr5r~rDrIrinforLrPr ref_indexattr default_value loaded_value param_name shim_bytess r/rRModel.from_dicts #((* $aCS/ !TYY[! s7| E *MN N 'GAw<?DV DI"6l002 $LL,3#'v,"4"4"6$LLd+LLI&67 #7 #7|A446  $ t 4 / dQ #/ 4  7&)]1%5%;%;%=! $ HH,,U388:Ez1&>"+3w<?!;  1 ((4"<'(* r1Tstrictrfc2[U[5(a [U5OUnUR5(dUR 5(dgUR S5nUR 5nSSS5 URWUS9$!,(df  N=f)zCheck whether serialized data on disk is compatible with the model. If 'strict', the function returns False if the model has an attribute already loaded that would be changed. FrVNre)r<r=ris_direxistsr>rWcan_from_bytes)rOr9rfr@rNs r/ can_from_diskModel.can_from_disksn (c22tDz ;;==  YYt_J"":f"==_s B Bcn[R"U5nURX2S9$![a gf=f)zCheck whether the bytes data is compatible with the model. If 'strict', the function returns False if the model has an attribute already loaded that would be changed. Fre)r3rPr| can_from_dict)rOrNrfr5s r/rjModel.can_from_bytessA  %%j1C!!#!55  s ' 44cSUR5;ag[UR55n[US5[U5:wag[ U5GHupEUSUnU(aUSUR :wa g[USU5[UR 5:wa gUSR5H?upxURU5n U SLa gU (dM'URU5U:wdM> g USUR5HZupURU 5n U SLa gU (dM'UcM,URU 5n U RUR:wdMY g U(dGM(USUR5HFupXR;dM[URU URU X5nX:wdME g GM g![a M]f=f) zCheck whether a dictionary is compatible with the model. If 'strict', the function returns False if the model has an attribute already loaded that would be changed. rDFr6rErBrCrFT)r\rLrr[rFr6rErMrurrrshaperFrGrH)rOr5rfrDrIrr]rLrPrurbrrr_ serializeds r/rnModel.can_from_dicts #((* $TYY[! s7| E * 'GAw<?D$v,$))33w<?#s4::6"6l002 ,,s+e# Wc!2e!; 3 &)]1%5%;%;%=!  NN:6 % Y5#4 NN:6E{{ekk1$&>v#&w<?#8#8#:KDzz)%)7 $ 4 0$**T2BD*J &.#($;/(D )%$%s+'G$$ G21G2othercSURR5;a [S5eURR5S"X5$)z-Apply the function bound to the '+' operator.+zUndefined operator: +rmrrHrOrts r/__add__ Model.__add__D d--113 334 4&&**,S1$>>r1cSURR5;a [S5eURR5S"X5$)z-Apply the function bound to the '-' operator.-zUndefined operator: -rwrxs r/__sub__ Model.__sub__r{r1cSURR5;a [S5eURR5S"X5$)z-Apply the function bound to the '*' operator.*zUndefined operator: *rwrxs r/__mul__ Model.__mul__r{r1cSURR5;a [S5eURR5S"X5$)z-Apply the function bound to the '@' operator.@zUndefined operator: @rwrxs r/ __matmul__Model.__matmul__r{r1cSURR5;a [S5eURR5S"X5$z-Apply the function bound to the '/' operator./zUndefined operator: /rwrxs r/__div__ Model.__div__r{r1cSURR5;a [S5eURR5S"X5$rrwrxs r/ __truediv__Model.__truediv__ r{r1cSURR5;a [S5eURR5S"X5$)z.Apply the function bound to the '//' operator.z//zUndefined operator: //rwrxs r/ __floordiv__Model.__floordiv__D t..224 445 5&&**,T24??r1cSURR5;a [S5eURR5S"X5$)z-Apply the function bound to the '%' operator.%zUndefined operator: %rwrxs r/__mod__ Model.__mod__r{r1c SURR5;a [S5eURR5S"X5$)z.Apply the function bound to the '**' operator.z**zUndefined operator: **rw)rOrtr.s r/__pow__ Model.__pow__rr1cSURR5;a [S5eURR5S"X5$)z.Apply the function bound to the '<<' operator.z<>' operator.z>>zUndefined operator: >>rwrxs r/ __rshift__Model.__rshift__)rr1cSURR5;a [S5eURR5S"X5$)z-Apply the function bound to the '&' operator.&zUndefined operator: &rwrxs r/__and__ Model.__and__/r{r1cSURR5;a [S5eURR5S"X5$)z-Apply the function bound to the '^' operator.^zUndefined operator: ^rwrxs r/__xor__ Model.__xor__5r{r1cSURR5;a [S5eURR5S"X5$)z-Apply the function bound to the '|' operator.|zUndefined operator: |rwrxs r/__or__ Model.__or__;r{r1) r?r<r@r=r;rAr>r8r6r7)NN)F)rr$r)Nr+)r)N)m__name__ __module__ __qualname____firstlineno____doc__r4int__annotations__ threadingLockr5r&rmr=rrrrr r rrr __slots__rr rrrrQpropertyrDrErFrr]rbreri classmethodrcontextmanagerrrrurrrrrrrNr`rrrrrrrrr!r"rrrrrrrr rrrrrr r r#rrr#r&r!bytesr7rrAr1rSrXrRrkrjrnryr~rrrrrrrrrrrr__static_attributes__r,r1r/r$r$1s-9Is%.^^%5NINN5* I H G O N  Xc]" ## '] J cNc8D>)** I($()+02$& "-/26%,%,%, x %, 3 %& %,S(8,,-%,!%,Dz%,CH~%,3))*%,eHg-. /%,NW  tDztCH~ .U38_..QE#s(OQQ(5c?(((5c?(( ,c8m)< , , C HTN  C C ?D!C!!t!! B#B(3-B c htn 5c5h5FCFHX,>F*c*(8*<**4S4T44S4X44S44d4D3D8H+=D4S44d4 C HTN  C G B#B(7*;BJCJ(9JdJ6#66%h2G6 HSMXd^w2c2eD(D63;2G,G&H2666 0y 0T 0,eCHox&?!@,,,$) VS VXg-> V &8G, &DXg5F,-$@D$$*28*<$ $ g$* tE#s(OU8X;M5N$NO 5UHL'#'##DeGTM.B)B$CD'# '#R$S$T$! ?3 ?4 ? (% ()E$),))77r #U #w #+eD#I.+7+Tg<GK >%c "2 >t >t >CG 6 64 64 6:>--$-$-^?S?W? ?S?W? ?S?W? ??? ?S?W? ??? @#@'@ ?S?W? @S@w@ @@@ @@@ ?S?W? ?S?W? ?C?G?r1_rPr6c.[R"U5$)zSerialize an attribute value (defaults to msgpack). You can register custom serializers using the @serialize_attr.register decorator with the type to serialize, e.g.: @serialize_attr.register(MyCustomObject). )r3r4rrPr6r(s r/rGrGB   u %%r1c.[R"U5$)zDeserialize an attribute value (defaults to msgpack). You can register custom deserializers using the @deserialize_attr.register decorator with the type to deserialize, e.g.: @deserialize_attr.register(MyCustomObject). )r3rPrs r/r\r\Krr1_ModelTmappingcUR5H[nURU;dMXRnUR5H$upEXBR;dMXRRU'M& M] U$)zWalk over the model's nodes, changing the value of attributes using the provided mapping, which maps node names to attr names to attr values. )rr6rMrF)r(rrrFr_rPs r/change_attr_valuesrWs[  99 II&E${{} ::%',JJt$ - Lr1 dropout_ratedropcUR5H+nUH"nXCR;dMXRU'M$ M- U$)zWalk over the model's nodes, setting the dropout rate. You can specify one or more attribute names, by default it looks for ["dropout_rate"]. )rrF)r(rrFrr_s r/set_dropout_raterds; Dzz!#' 4  Lr1wrapperc[UR55HnURX!"U55 M U"U5$)zKRecursively wrap a model and its submodules. The model is updated in-place.)rLrr )r(rrs r/wrap_model_recursiveros9UZZ\" 4/# 5>r1)r$rGr\rrr)r(r$r)r$)=rr functoolsr contextvarsrpathlibrtypingrrrrr r r r r rrrrrr3backendsrrrrr optimizersrrErtypesrutilrrrrr r!r"r#r&rKrr0r$singledispatchr=rrGr\rrfloatrr__all__r,r1r/rs "" JJ!envw'&01Db&Q:d#QN ?GCI N ?b &c&#&S&&5&& &&C&s&5&S&& )5 ) g S$sCx.5H0I g :H8HG5W%'9I0Jw r1