љiSSKJr SSKrSSKrSSKJr SSKrSSKJrJrJ r J r J r J r SSK JrJr SSKJrJr SS KJr \R*"\5r"S S \5r"S S \5r"SS\5r"SS5rSSS.S\ S\S\4Sjjrg))datetimeN)List) APIRouterDependsFastAPI HTTPExceptionstatusBackgroundTasks) BaseModelField)DialogEvaluatorScenario)create_api_key_dependencyc2\rSrSr%\"SS9r\\\S'Sr g)EvaluationRequestzList of evaluation scenarios description scenariosN __name__ __module__ __qualname____firstlineno__r rrr__annotations____static_attributes__rS/home/james-whalen/.local/lib/python3.13/site-packages/aiavatar/admin/evaluation.pyrrs %2P QItH~Qr rc2\rSrSr%\"SS9r\\\S'Sr g)EvaluationResponsez.List of evaluation scenarios including resultsrrrNrrr r!r#r#s %2b cItH~cr r#c,\rSrSr%\"SS9r\\S'Srg)EvaluationStartResponsez!Id to retrieve evaluation resultsr evaluation_idrN) rrrrr r(strrrrr r!r&r&s+NOM3Or r&c.\rSrSrSS\4SjjrSrSrg) EvaluationAPIN evaluatorcXlgNr-)selfr-s r!__init__EvaluationAPI.__init__s #r c >^^[5nS[S[[4U4SjjmUR S[ S/SSSS S 0S S 0S .S 9S[ S[S[ 4UU4Sjj5nURSS/SSSS S0S S0S S 0S.S9S[S[4U4Sjj5nU$)Nr(rc&># TRRUSS9IShvN n[R"SSS9 TRR USUS35 gN:![ a%n[ RSUSU35 SnAgSnAff=f7f) NT)datasetdetailedevaluation_results)exist_okevaluation_results/.jsonzEvaluation failed : )r-runosmakedirs save_results Exceptionloggererror)r(rresultsexr1s r!run_evaluation_task5EvaluationAPI.get_router..run_evaluation_task$s I $ 2 29t 2 TT 04@++G7J=/Y^5_`U I 1-2$GHH Is>BAA9ABA B)B B BBz /evaluate EvaluationzStart dialog evaluationzzStart dialog evaluation in the background task. You can retrieve the results with evaluation_id after evaluation finished.z"Id to retrieve evaluation results.rzSuccessfully start evaluationzInternal server error))response_modeltagssummaryrresponse_description responsesrequestbackground_tasksreturnc># TR(d[[RSS9eSn[R "5R S5S[[R"55SS3nURTX R5 [US9$![a8n[RSUSU35 [[RS S9eSnAff=f7f) NEvaluator is not set status_codedetailz %Y%m%d_%H%M%S_)r(zStarting evaluation failed r<z/Internal server error while starting evaluation)r-rr HTTP_500_INTERNAL_SERVER_ERRORrnowstrftimer)uuiduuid4add_taskrr&rArBrC)rPrQr(rErFr1s r!evaluate*EvaluationAPI.get_router..evaluate,s >># & E E1 !M #+<<>#:#:?#K"LAcRVR\R\R^N_`babNcMd e  ))*=}N_N_`.]KK  :=/B4PQ# & E EL s),C"A,BC" C'3CCC"z/evaluate/{evaluation_id}zGet dialog evaluation resultsz1Get dialog evaluation results with evaluation_id.z.List of evaluation scenario including results.z'Successfully returns evaluation resultszResults not found)rIrJ)rLrMrrNrOc># TR(d[[RSS9eSUS3n[R R U5(d [SSS9eTRRU5n[US9$![a8n[RSUS U35 [[RS S9eSnAff=f7f) NrTrUr:r;rbzEvaluation not found)rz%Retrieving evaluation results failed r<z9Internal server error while retrieving evaluation results) r-rr rZr>pathexists load_resultsr#rArBrC)r(filepathrDrEr1s r!get_evaluation_status7EvaluationAPI.get_router..get_evaluation_statusNs>># & E E1 -]O5AH77>>(++# =DG-g6 7 8D}y9DDFUYZr )rloggingr>typingrr]fastapirrrrr r pydanticr r eval.dialogrrauthr getLoggerrrBrr#r&r+r)rurr r!r}s  WW%3+   8 $R RddPiPVVx"& [ [[ [r