h cSSKJr SSKrSSKrSSKrSSKrSSKJrJrJ r SSK J r SSK J r SSKJrJrJrJr \(a8SSKJr SSKJr SSKrSS KJr SS KJrJr SS KJr SS KJrJr SS K J!r! SSK"J#r# \RH"\%5 SSK&J'r' \'RP"\\\\S9 SSS5 "SS5r)"SS5r*SSjr+g!,(df  N.=f)) annotationsN) TYPE_CHECKINGAnyLiteral)issue_unstable_warning)wrap_ldf) CatalogInfo ColumnInfo NamespaceInfo TableInfo) Generator)datetime) SchemaDict)DataSourceFormat TableType) DataFrame)CredentialProviderFunction CredentialProviderFunctionReturnCredentialProviderBuilder) LazyFrame)PyCatalogClient)catalog_info_clsnamespace_info_clstable_info_clscolumn_info_clsc\rSrSrSrSSS.S SjjrS!SjrS"SjrS#S jrS$S jr S%S jr S S S SS S.S&Sjjr SS S S SS.S'Sjjr S S S.S(Sjjr SS.S)SjjrS S S.S*SjjrSS.S+SjjrS S S S S.S,SjjrS-SjrS.Sjr\S/Sj5rSrg )0Catalog-z Unity catalog client. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. autoT) bearer_token require_httpsc[S5 U(a'URS5(dSUS3n[U5eUS:XdhUS:XarS[R;a^URS5(aHUR S5R SS 5S RS 5(aUR5nUS:XaS n[R"X5Ul g ) as Initialize a catalog client. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- workspace_url URL of the workspace, or alternatively the URL of the Unity catalog API endpoint. bearer_token Bearer token to authenticate with. This can also be set to: * "auto": Automatically retrieve bearer tokens from the environment. * "databricks-sdk": Use the Databricks SDK to retrieve and use the bearer token from the environment. require_https Require the `workspace_url` to use HTTPS. z/`Catalog` functionality is considered unstable.zhttps://z%a non-HTTPS workspace_url was given (z5). To allow non-HTTPS URLs, pass require_https=False.zdatabricks-sdkr DATABRICKS_RUNTIME_VERSION/rz.cloud.databricks.comN) r startswith ValueErrorosenviron removeprefixsplitendswith_get_databricks_tokenrnew_client)self workspace_urlr!r"msgs U/home/james-whalen/.local/lib/python3.13/site-packages/polars/catalog/unity/client.py__init__Catalog.__init__6s8 PQ !9!9*!E!E7 GBB S/ ! + + F "- :((44**:6sAq"123  557L 6 !L&**=G c6URR5$)z List the available catalogs. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. )r0 list_catalogs)r1s r4r9Catalog.list_catalogsos||))++r7c8URRU5$)a List the available namespaces (unity schema) under the specified catalog. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. )r0list_namespaces)r1 catalog_names r4r<Catalog.list_namespacesys||++L99r7c8URRX5$)a; List the available tables under the specified schema. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. namespace Name of the namespace (unity schema). )r0 list_tables)r1r= namespaces r4r@Catalog.list_tabless||'' @@r7c:URRXU5$)aU Retrieve the metadata of the specified table. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. namespace Name of the namespace (unity schema). table_name Name of the table. )r0get_table_infor1r=rA table_names r4rDCatalog.get_table_infos&||**`_ * `gcp `_ * `azure `_ * Hugging Face (`hf://`): Accepts an API key under the `token` parameter: `{'token': '...'}`, or by setting the `HF_TOKEN` environment variable. If `storage_options` is not provided, Polars will try to infer the information from environment variables. credential_provider Provide a function that can be called to provide cloud storage credentials. The function is expected to return a dictionary of credential keys along with an optional credential expiry time. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. retries Number of retries if accessing a cloud instance fails. scan tableFzCatalog.scan_tablerJ caller_nameDELTA DELTASHARINGr) scan_delta)versionrPrQrRNz3cannot apply delta_table_version for table of type z3cannot apply delta_table_options for table of type )rR cloud_optionsrS) rD!_extract_location_and_data_format_init_credentialspolars.io.deltar[r(listitemsrr0 scan_table)r1r=rArFrOrPrQrRrS table_infostorage_locationdata_source_formatr[r3s r4rcCatalog.scan_tablesv((*M /P  0 ,04/E/E   , 0F0 , !: : 2 +$7 /$7    *E%&( S/ !  *E%&( S/ ! "?#8#8#:;O#O LL # #$7- $   r7error) delta_modedelta_write_optionsdelta_merge_optionsrQrRc URX#U5n [U S5upURU UU SSS9upU S;aURU UU UUUS9$SUSUSUS U S 3 n [ U 5e) a Write a DataFrame to a catalog table. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- df DataFrame to write. catalog_name Name of the catalog. namespace Name of the namespace (unity schema). table_name Name of the table. delta_mode : {'error', 'append', 'overwrite', 'ignore', 'merge'} (For delta tables) How to handle existing data. - If 'error', throw an error if the table already exists (default). - If 'append', will add new data. - If 'overwrite', will replace table with new data. - If 'ignore', will not write anything if table already exists. - If 'merge', return a `TableMerger` object to merge data from the DataFrame with the existing data. delta_write_options (For delta tables) Additional keyword arguments while writing a Delta lake Table. See a list of supported write options `here `__. delta_merge_options (For delta tables) Keyword arguments which are required to `MERGE` a Delta lake Table. See a list of supported merge options `here `__. storage_options Options that indicate how to connect to a cloud provider. The cloud providers currently supported are AWS, GCP, and Azure. See supported keys here: * `aws `_ * `gcp `_ * `azure `_ * Hugging Face (`hf://`): Accepts an API key under the `token` parameter: `{'token': '...'}`, or by setting the `HF_TOKEN` environment variable. If `storage_options` is not provided, Polars will try to infer the information from environment variables. credential_provider Provide a function that can be called to provide cloud storage credentials. The function is expected to return a dictionary of credential keys along with an optional credential expiry time. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. rUTzCatalog.write_tablerVrX)rQrRmoderjrkzwrite_table: table format of .z (z) is unsupported.)rDr^r_ write_deltaNotImplementedError)r1dfr=rArFrirjrkrQrRrdrerfr3s r4 write_tableCatalog.write_table%sT((*M /P  0 ,04/E/E   - 0F0 , !: :>> /$7$7$7 " 0.)Aj\:&''8:  &c* *r7)comment storage_rootc6URRXUS9$)aQ Create a catalog. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. comment Leaves a comment about the catalog. storage_root Base location at which to store the catalog. )r=rtru)r0create_catalog)r1r=rtrus r4rwCatalog.create_catalogs%.||**%\+  r7F)forcec6URRXS9 g)a Delete a catalog. Note that depending on the table type and catalog server, this may not delete the actual data files from storage. For more details, please consult the documentation of the catalog provider you are using. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. force Forcibly delete the catalog even if it is not empty. )r=ryN)r0delete_catalog)r1r=rys r4r{Catalog.delete_catalogs0 ###Kr7c:URRUUUUS9$)a Create a namespace (unity schema) in the catalog. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. namespace Name of the namespace (unity schema). comment Leaves a comment about the table. storage_root Base location at which to store the namespace. )r=rArtru)r0create_namespace)r1r=rArtrus r4r~Catalog.create_namespaces,4||,,%% -  r7c8URRXUS9 g)aE Delete a namespace (unity schema) in the catalog. Note that depending on the table type and catalog server, this may not delete the actual data files from storage. For more details, please consult the documentation of the catalog provider you are using. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. namespace Name of the namespace (unity schema). force Forcibly delete the namespace even if it is not empty. )r=rAryN)r0delete_namespace)r1r=rArys r4rCatalog.delete_namespaces 6 %%%% & r7)rfrtru propertiescURRUUUUUUUU[U =(d 0R55S9 $)aW Create a table in the catalog. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. namespace Name of the namespace (unity schema). table_name Name of the table. schema Schema of the table. table_type Type of the table data_source_format Storage format of the table. comment Leaves a comment about the table. storage_root Base location at which to store the table. properties Extra key-value metadata to store. ) r=rArFschema table_typerfrtrur)r0 create_tablerarb) r1r=rArFrrrfrtrurs r4rCatalog.create_tablesOR||((%!!1%Z-24467)  r7c:URRUUUS9 g)a Delete the table stored at this location. Note that depending on the table type and catalog server, this may not delete the actual data files from storage. For more details, please consult the documentation of the catalog provider you are using. If you would like to perform manual deletions, the storage location of the files can be found using `get_table_info`. .. warning:: This functionality is considered **unstable**. It may be changed at any point without it being considered a breaking change. Parameters ---------- catalog_name Name of the catalog. namespace Name of the namespace (unity schema). table_name Name of the table. )r=rArFN)r0 delete_tablerEs r4rCatalog.delete_table8s$: !!%! " r7c SSKJn US:waU(aUR"U5U4$SU4$[R"S5S:Hn[ XR US9nUR5n [U 5n U (a0U=(d 0EU EnU Hn M U(a;URn UR n SU <SU <S 3n[U[RS 9 UR"U5U4$![aTnU(aCURn UR n S U<S U <SU <S U<S 3 n[U[RS 9 SnAOSnAff=fSSKJn U"SURX%5U4$)Nrrr POLARS_VERBOSE1rJz9auto-selected CatalogCredentialProvider for table_name = z (table_id = ))filez3error auto-initializing CatalogCredentialProvider: z table_name = z ) (write = )!_init_credential_provider_builder),polars.io.cloud.credential_provider._builderrfrom_initialized_providerr)getenvCatalogCredentialProviderrI_credentials_iternextnameprintsysstderr Exceptionrre)r1rRrQrdrJrWrverbosecatalog_credential_providervstorage_update_options_rFrIr3ers r4r_Catalog._init_credentials[s  & ("0JJ'"##_,,)),-4&? %%U' # +==?A%)!W "%"Wo&;"W@V"W'__ %..%!o^}A7c +,FF+ ' ,'__ %..I!O%!o^}LzDc + ,6 1 J//  s:C** E4A EEc[RRS5c Sn[U5e[R"S5R nUS"5"US"55"5SSS$)Nzdatabricks.sdkz?could not get Databricks token: databricks-sdk is not installedzdatabricks.sdk.coreDefaultCredentialsConfig Authorization) importlibutil find_spec ImportError import_module__dict__)clsr3ms r4r.Catalog._get_databricks_tokensj >> # #$4 5 =SCc" "  # #$9 : C C%&(879/J12NNr7)r0)r2strr! str | Noner"boolreturnNone)rzlist[CatalogInfo])r=rrzlist[NamespaceInfo])r=rrArrzlist[TableInfo])r=rrArrFrrr )rIrrJrrz1tuple[dict[str, str] | None, dict[str, str], int])r=rrArrFrrOzint | str | datetime | NonerPdict[str, Any] | NonerQrrR3CredentialProviderFunction | Literal['auto'] | NonerSintrr)rqrr=rrArrFrriz:Literal['error', 'append', 'overwrite', 'ignore', 'merge']rjrrkrrQdict[str, str] | NonerRrrz"None | deltalake.table.TableMerger)r=rrtrrurrr )r=rryrrr) r=rrArrtrrurrr )r=rrArryrrr)r=rrArrFrrzSchemaDict | NonerrrfzDataSourceFormat | Nonertrrurrrrr )r=rrArrFrrr) rRrrQrrdr rJrrWrrz>tuple[CredentialProviderBuilder | None, dict[str, Any] | None])rr)__name__ __module__ __qualname____firstlineno____doc__r5r9r<r@rDrLrcrrrwr{r~rrrr_ classmethodr.__static_attributes__r7r4rr-si$*" 7H7H! 7H  7H  7Hr, :A"PP,/P=@P P*RR'+R :R<@5915 p p p  p 9 p 3p /p  @p p  p v 595915g+ g+g+ g+  g+ g+3g+3g+/g+g+ ,!g+Z##'     !    > LL L  L>##'      !    L        N7;"#',03 3 3  3 " 3 3 43 3 !3 *3  3 j! ! !  !  ! FIPI/I I  II IVOOr7rc:\rSrSrSrSSjrS SjrS SjrSrg) rizGRetrieves credentials from the Unity catalog temporary credentials API.c(XlX lX0lgNcatalogrIrJ)r1rrIrJs r4r5"CatalogCredentialProvider.__init__s   r7c2UR5unup#X#4$r)r)r1rcredsexpirys r4__call__"CatalogCredentialProvider.__call__s!335?E}r7c## URRURURS9upnUv U(dURnSU<3n[ U5eX4v g7f)NrzJdid not receive credentials from temporary credentials API for table_id = )rrLrIrJr)r1rrrrIr3s r4r+CatalogCredentialProvider._credentials_iterso15 0S0S MM1T1 -v%$}}H-! C. msA A"rN)rrrIrrJrrr)rr)rzGenerator[Any]) rrrrrr5rrrrr7r4rrsQ  r7rcURcSUS3n[U5eURcSUS3n[U5eURUR4$)Nzcannot z: no storage_location foundz: no data_source_format found)rer(rf)rd operationr3s r4r^r^se""* {"=>o$$, {"?@o  & & (E(E EEr7)rdr rrrztuple[str, DataSourceFormat]), __future__r contextlibrr)rtypingrrrpolars._utils.unstablerpolars._utils.wraprpolars.catalog.unity.modelsr r r r collections.abcr r deltalakepolars._typingrrrpolars.dataframe.framerpolars.io.cloudrrrrpolars.lazyframersuppressr polars._plrr init_classesrrr^rr7r4rs" ..9')!)G0W*%+  $( " &B OB OJ@ F F&) F! Fa&%s C  C