hT SrSSKrSSKJr SSKrSSKJrJrJ r SSK J r "SS5r \S:Xa\"S5 \"S5 \"S 5 \ "S S S /S S SSS9r\R#SSSS9 \R%5 \R'SS9r\"S5 \"S5 \"S 5 \"S5 \"S\SSS35 \"S\SSS35 \"S5 gg) z7 MAML Meta-Training - Learn the optimal initialization N)MAML MAMLModelcreate_classification_taskc`\rSrSrSrSSS/SSSS4SjrSS jrSS jrSS jrSS jr S r Sr g) MAMLTrainer z%Train MAML on a distribution of tasks({Gz?MbP?cj[XU5Ul[URUUUS9Ul/Ulg)N)inner_lrouter_lr inner_steps)rmodelrmaml train_history)self input_size hidden_sizes output_sizerrrs S/home/james-whalen/eden-agi-project/real_capabilities/learning/meta/maml_trainer.py__init__MAMLTrainer.__init__ s8zE  JJ#    cv/n[U5H'nX$-n[USS9upgpURXgX45 M) U$)z)Generate batch of tasks for meta-trainingr  n_samples)rangerappend) rn_tasks task_offset task_batchitask_id support_x support_yquery_xquery_ys rgenerate_task_batchMAMLTrainer.generate_task_batch sM wA!oG5O26 2I'   yWF G  rc [S5 [S5 [SUSU35 [S5 [U5HnXB-nURX%5nURR U5upxUR R UUUS.5 US-U-S:XdMb[S US-S US US S US-SS3 5 URSS9n [SU S-SS35 M [S5 g)z* Meta-train MAML on distribution of tasks G ======================================================================zMETA-TRAINING MAMLz Iterations: z | Tasks per batch: F======================================================================) iterationlossaccuracyrz Iteration /z - Loss: z.4fz - Acc: d.2f%)r"z Eval on new tasks: u ✅ Meta-training complete!N)printr r+rmeta_train_steprr!evaluate_on_new_tasks) r n_iterationstasks_per_batch eval_everyr0r#r$r1acceval_accs r meta_trainMAMLTrainer.meta_train-s m "# \N*>>OPQ f |,I#5K11/OJ 11*=ID    % %&' A +q0 9Q;-q?#CjS Q@A 55b5A-hsl3-?qAB+-. -.rcSn[U5H7nSU-n[USS9upVpxURRXVXx5upX*- nM9 X!- $)z;Evaluate on completely new tasks (not seen during training)ri'r r)r rr evaluate_task) rr" total_accr%r&r'r(r)r*_ acc_afters rr;!MAMLTrainer.evaluate_on_new_tasksOsd wAaiG5O26 2I' 9922gLA  "I ""rc[S5 [S5 [S5 /n/n/n[U5HnSU-n[USS9upxpURR XxX5upUR U 5 UR U 5 [ SSS/S5n [U S S S 9nUR XxX5unnUR U5 M [R"U5S -n[R"U5S -n[R"U5S -nUU- nUU- n[S US35 [S5 [SUSS35 [SUSSUSS35 [SUSS35 [S5 [SUSS35 US:a(US:a"[S5 [S5 [S5 O[S5 [S5 UUUUS.$)z- Compare MAML vs baseline (no meta-learning) r.zCOMPARING MAML VS BASELINEr/i Nr rrr r r )rrr5z Results on z new tasks:zMAML (before adaptation): r6r7zMAML (after 5 steps): z% (+z%)zBaseline (after 5 steps): zMAML vs Baseline: +Uu 🎯 GOAL ACHIEVED!u" ✅ >85% accuracy after 5 stepsu' ✅ >30% improvement from adaptationu ⚠️ Goal not yet metz( Need: >85% accuracy, >30% improvement) maml_before maml_afterbaseline improvement) r9r rrrDr!rrnpmean)r n_test_tasksrLrMbaseline_afterr%r&r'r(r)r* acc_beforerGbaseline_model baseline_mamlrF baseline_accmaml_before_avgmaml_after_avgbaseline_after_avgrO vs_baselines rcompare_with_baseline!MAMLTrainer.compare_with_baselineas  m *+ f   |$AaiG5O26 2I' %)II$;$;g% !J   z *   i ('rB8Q7N $ANM+99gOA|  ! !, /'%,''+.4,s2WW^4s:$6 $'99  l^;78  +OC+@BC +N3+?tKPSCTTVWX +,>s+C1EF  ,[,=Q?@ R K2$5 ) + 6 8 ; = . 0 < >+(*&   rcURVs/sHoSPM nnURVs/sH oSS-PM nnURVs/sHoSPM nn[R"SSSS9unupgURX#S SS 9 UR S 5 UR S 5 UR S 5 URSSS9 URSSSSSS9 UR5 URX$SSS 9 UR S 5 UR S5 UR S5 URSSS9 [R"5 [R"SSS9 [S5 gs snfs snfs snf)zPlot training progressr0r2r5r1r3r )r )figsizeblue)color linewidthzMeta-Training IterationzQuery Set Accuracy (%)z'MAML: Meta-Training Progress (Accuracy)Tg333333?)alpharJgreenz--g?z Goal: 85%)yrb linestylerdlabelredzQuery Set Lossz#MAML: Meta-Training Progress (Loss)z1real_capabilities/learning/meta/maml_training.png)dpiuO 📊 Training plot saved to: real_capabilities/learning/meta/maml_training.pngN) rpltsubplotsplot set_xlabel set_ylabel set_titlegridaxhlinelegend tight_layoutsavefigr9)rh iterations accuracieslossesfigax1ax2s rvisualize_trainingMAMLTrainer.visualize_trainings^.2.@.@A.@ n.@ A373E3EF3Ea mc)3E F%)%7%78%7F)%78,,q!W=Zc vC 01 /0 ?@ S! b4s+ V  5A> 01 '( ;< S!  GSQ `b1BF8sE:E?F)rrrN)r)ir5)r8)2) __name__ __module__ __qualname____firstlineno____doc__rr+rAr;r\r~__static_attributes__rrrr s>/"X &  /D#$? Bcrr__main__r.z.MAML META-LEARNING: FULL TRAINING & EVALUATIONr/rr r r r r )rrrrrrir)r<r=r>r)rRzWEEK 3 COMPLETE!u Meta-Learning Capability: ✅zFast adaptation in 5 steps: rMz.1fr7z Improvement: rOz Total Capabilities: 3/30 (10%))rtorchtorch.nnnnnumpyrPrrrrmatplotlib.pyplotpyplotrlrrr9trainerrAr~r\resultsrrrrs  <<rcrcj z - :; &M"X G D!L  +++s(C1 EF M'-05Q 78 ,-=r