^hzVSSKrSSKJr SSKJr SSKJrJrJr SSK 7 "SS5r g)N)Dict)+_convert_vertex_datetime_to_openai_datetime)BatchBatchJobStatusCreateBatchRequest)*c\rSrSrSr\S\S\4Sj5r\S\ S\ 4Sj5r \S\ S\ 4Sj5r \S\ S\ 4S j5r\S\ S\4S j5r\S \ S\ 4S j5r\S \ S\ 4Sj5rSrg)VertexAIBatchTransformation z Transforms OpenAI Batch requests to Vertex AI Batch requests API Ref: https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/batch-prediction-gemini requestreturnc S[R"53nURS5nUc [S5e[ [ US9SS9nUR U5n[S[URU5S9S9n[UUUUS 9$) z> Transforms OpenAI Batch requests to Vertex AI Batch requests zlitellm-vertex-batch- input_file_idz+input_file_id is required, but not provided)urisjsonl) gcsSourceinstancesFormat)outputUriPrefix)predictionsFormatgcsDestination) inputConfig outputConfigmodel displayName) uuiduuid4get ValueError InputConfig GcsSource_get_model_from_gcs_file OutputConfigGcsDestination_get_gcs_uri_prefix_from_fileVertexAIBatchPredictionJob)clsr request_display_namer input_configr output_configs g/home/james-whalen/.local/lib/python3.13/site-packages/litellm/llms/vertex_ai/batches/transformation.py9transform_openai_batch_request_to_vertex_ai_batch_requestUVertexAIBatchTransformation.transform_openai_batch_request_to_vertex_ai_batch_requests"7tzz|nE O4  JK K$/]3W% 11-@&2%) # A A- P' *$&,   responsec [URSS5S[URSS5S9SURU5SUR U5SUR U5S9 $)Nname24hrs createTime)vertex_datetimebatch) idcompletion_window created_atendpointrobjectstatus error_file_idoutput_file_id)rrr0_get_input_file_id_from_vertex_ai_batch_response3_get_batch_job_status_from_vertex_ai_batch_response1_get_output_file_id_from_vertex_ai_batch_response)r&r.s r*;transform_vertex_ai_batch_response_to_openai_batch_responseWVertexAIBatchTransformation.transform_vertex_ai_batch_response_to_openai_batch_response/su||FB'%B ( \2 >NNJJ8TPP  r-cSnURS5nUcU$URS5nUcU$URSS5n[U5S:XaU$US$)z: Gets the input file id from the Vertex AI Batch response r1rrrr)rlen)r&r.rr( gcs_sourcers r*r>LVertexAIBatchTransformation._get_input_file_id_from_vertex_ai_batch_responseEsi ||M2   !%%k2   ~~fb) t9> Awr-cSnURS5nUcU$URS5nUcU$URSS5nU$)z; Gets the output file id from the Vertex AI Batch response r1rrrr)r&r.r=r)gcs_destinationoutput_uri_prefixs r*r@MVertexAIBatchTransformation._get_output_file_id_from_vertex_ai_batch_response[sZ! ^4  ! !'++,<=  "! !+//0A2F  r-c LSSSSSSSSSSSSS. nURS S 5nX#$) z Gets the batch job status from the Vertex AI Batch response ref: https://cloud.google.com/vertex-ai/docs/reference/rest/v1/JobState failed validating in_progress completed cancelling cancelledexpired) JOB_STATE_UNSPECIFIEDJOB_STATE_QUEUEDJOB_STATE_PENDINGJOB_STATE_RUNNINGJOB_STATE_SUCCEEDEDJOB_STATE_FAILEDJOB_STATE_CANCELLINGJOB_STATE_CANCELLEDJOB_STATE_PAUSEDJOB_STATE_EXPIREDJOB_STATE_UPDATINGJOB_STATE_PARTIALLY_SUCCEEDEDstaterTrH)r&r. state_mapping vertex_states r*r?OVertexAIBatchTransformation._get_batch_job_status_from_vertex_ai_batch_responsensK&. ,!-!.#. ($0#. -!*"/-8 4  ||G-DE **r-rc0URSS5nUS$)a Gets the gcs uri prefix from the input file id Example: input_file_id: "gs://litellm-testing-bucket/vtx_batch.jsonl" returns: "gs://litellm-testing-bucket" input_file_id: "gs://litellm-testing-bucket/batches/vtx_batch.jsonl" returns: "gs://litellm-testing-bucket/batches" /r)rsplit)r&r path_partss r*r$9VertexAIBatchTransformation._get_gcs_uri_prefix_from_files #))#q1 !}r- gcs_file_uricSSKJn U"U5nURS5SnURS5nSSRUSS53nU$)a Extracts the model from the gcs file uri When files are uploaded using LiteLLM (/v1/files), the model is stored in the gcs file uri Why? - Because Vertex Requires the `model` param in create batch jobs request, but OpenAI does not require this gcs_file_uri format: gs://litellm-testing-bucket/litellm-vertex-files/publishers/google/models/gemini-1.5-flash-001/e9412502-2c91-42a6-8e61-f5c294cc0fc8 returns: "publishers/google/models/gemini-1.5-flash-001" r)unquotez publishers/rfreN) urllib.parserlsplitjoin)r&rjrl decoded_uri model_pathpartsrs r*r!4VertexAIBatchTransformation._get_model_from_gcs_filesW )l+  &&}5a8   %chhuRay123 r-N)__name__ __module__ __qualname____firstlineno____doc__ classmethodrr%r+VertexBatchPredictionResponserrAstrr>r@rr?r$r!__static_attributes__rur-r*r r s  #  $  8 4   *4 *!4! !!$+4+ ++4 # #  CCr-r ) rtypingr#litellm.llms.vertex_ai.common_utilsrlitellm.types.llms.openairrrlitellm.types.llms.vertex_air rur-r*rs( PO*ccr-