?hfdZddlmZddlZddlZddlZddlZddlmZm Z ddl m Z m Z m Z mZmZmZddlmZddlZddlmZddlmZdd lmZmZdd lmZdd lmZdd lm Z m!Z!m"Z"dd l#m$Z$ddl%m&Z&ddl'm(Z(ddl)m*Z*m+Z+ddl,m-Z-ddl.m/Z/m0Z0m1Z1ddl2m3Z3 ddl4Z4ddl5m6Z6dZ7ee9e:fZ;eejxjzefZ=ee-e-fZ>dZ?GddZ@ddZAddZBy#e8$rdZ7YGwxYw)z Connection class definition. ) annotationsN)ThreadEvent)AnyDictOptionalTupleUnioncast)urlparse) OAuth2Session) HTTPAdapter)ConnectionError ReadTimeout) HTTPError)JSONDecodeError)AuthCredentialsAuthClientCredentials AuthApiKey)ConnectionConfig)_Auth) EmbeddedDB)AuthenticationFailedExceptionWeaviateStartUpError)NUMBERS)_check_positive_numis_weaviate_domain_decode_json_response_dict) _Warnings)weaviate_pb2_grpcTFg?ceZdZdZ d ddZddZddZddZdddZddZ dd Z d d d Z d d!d Z d d!d Z d d!d Z d" d#dZ d d$dZed%dZej&d&dZeddZd'dZed(dZeddZd)dZy)* ConnectionzF Connection class used to communicate to a weaviate instance. Nc jd|_||_||_| |_d|_t r| t |j} tjtjtj} | jd| j| j| f| jd| jtj | jd| } t#j$| |_ddi|_|]t/|t0st3dt5|d |j7D]"\}}||j,|j9<$t;|||_d |j,vr1|/t?j@|j,jCd |,t/|tDrd |jFz|j,d <|d|_$|$tK|d tLd |jO||jQ||jS||jUd|_+|jVdkr t?jX|jVyy#t&t(tj*f$r| jYwxYw)a Initialize a Connection class instance. Parameters ---------- url : str URL to a running weaviate instance. auth_client_secret : weaviate.auth.AuthCredentials, optional Credentials to authenticate with a weaviate instance. The credentials are not saved within the client and authentication is done via authentication tokens. timeout_config : tuple(float, float) or float, optional Set the timeout configuration for all requests to the Weaviate server. It can be a float or, a tuple of two floats: (connect timeout, read timeout). If only one float is passed then both connect and read timeout will be set to that value. proxies : dict, str or None, optional Proxies to be used for requests. Are used by both 'requests' and 'aiohttp'. Can be passed as a dict ('requests' format: https://docs.python-requests.org/en/stable/user/advanced/#proxies), str (HTTP/HTTPS protocols are going to use this proxy) or None. trust_env : bool, optional Whether to read proxies from the ENV variables: (HTTP_PROXY or http_proxy, HTTPS_PROXY or https_proxy). NOTE: 'proxies' has priority over 'trust_env', i.e. if 'proxies' is NOT None, 'trust_env' is ignored. additional_headers : Dict[str, Any] or None Additional headers to include in the requests, used to set OpenAI key. OpenAI key looks like this: {'X-OpenAI-Api-Key': 'KEY'}. startup_period : int or None How long the client will wait for weaviate to start before raising a RequestsConnectionError. If None the client will not wait at all. Raises ------ ValueError If no authentication credentials provided but the Weaviate server has an OpenID configured. z/v1Ng?:z content-typezapplication/jsonz?'additional_headers' must be of type dict or None. Given type: . authorizationBearer startup_periodF) include_zeroversionz1.14)-_api_version_pathurltimeout_config embedded_db _grpc_stubhas_grpcr socketAF_INET SOCK_STREAM settimeoutconnecthostnameshutdownclosegrpcinsecure_channelr WeaviateStubConnectionRefusedError TimeoutErrortimeout_headers isinstancedict TypeErrortypeitemslower _get_proxies_proxiesrauth_header_and_auth_secretpoprapi_key_shutdown_background_eventrintwait_for_weaviate_create_sessions_add_adapter_to_sessionget_meta_server_versionweaviate_server_older_than_1_14)selfr-auth_client_secretr.proxies trust_envadditional_headersr)connection_configr/ grcp_port parsed_urlschannelkeyvalues Y/home/chris/cleankitchens-env/lib/python3.12/site-packages/weaviate/connect/connection.py__init__zConnection.__init__;sbh"'3A&DH  -!$((+J fnnf.@.@AA  S! :.. :; 1  //:3F3F2Gq 0TU"3"@"@"I();<  )0$7UVZ[mVnUoopq1668 3 U-2 ciik* 3%Wi8  dmm +0B0N  1 1 3 MM  o .  )j9KZ.X-69K9S9S-SDMM/ * ;?'  % 0@#TY Z  " "> 2 01 $$%67#}}y9   & (  5 5d6J6J K )M'    s4B J.J21J2c|*t|trtj|_yd|j vr|tj|_y|j |jzdz}tj||j|j|j}|jdk(r |j}|et|tsUt#|||}|j%|_t|t&r|j)|y|j)yd|j d}t+|j r|dz }t-||jd k(r0|.tj.tj|_ytj|_y#t$r1tj |tj|_YywxYw) aDCreates a async httpx session and a sync request session. Either through authlib.oauth2 if authentication is enabled or a normal request session otherwise. Raises ------ ValueError If no authentication credentials provided but the Weaviate server has OpenID configured. Nr'z!/.well-known/openid-configuration)headersr?rVz9"No login credentials provided. The weaviate instance at z requires login credentials. Please check our documentation at https://weaviate.io/developers/weaviate/client-libraries/python#authentication for more information about how to use authentication.a You can instantiate the client with login credentials for WCS using client = weaviate.Client( url=YOUR_WEAVIATE_URL, auth_client_secret=weaviate.AuthClientPassword( username = YOUR_WCS_USER, password = YOUR_WCS_PW, )) i)rArrequestsSession_sessionr@r-r,get_get_request_header_timeout_configrH status_codejsonrrauth_cannot_parse_oidc_configrget_auth_sessionr _create_background_token_refreshrrauth_with_anon_weaviate)rTrUoidc_urlresponseresp_authmsgs r`rOzConnection._create_sessionss  )j9KZ.X$,,.DM  dmm +0B0J$,,.DM 88d4447ZZ<< ,,.((MM     3 & }} "-jASU_6`d$6= % 6 6 8 02GH99%@99;STXT\T\S]^JM &dhh/  C4C88  ! !S (-?-K  - - /$,,.DM$,,.DMK# 77A ( 0 0 2  s>G7G=<G=cd|jvr|jdSt|jtrd|jjdSy)Nr'r( access_token)r@rArgr tokenrTs r`get_current_bearer_tokenz#Connection.get_current_bearer_tokensK dmm +==1 1  } 5T]]00@AB Bct|j|j}|jj d||jj d|y)N)pool_connections pool_maxsizezhttp://zhttps://)rsession_pool_connectionssession_pool_maxsizergmount)rTrYadapters r`rPz"Connection._add_adapter_to_sessionsH.GG*??  Iw/ J0r|c,tjtsJdjjvr|yjjj dd}t _d fd }t|||fdd}|jy) aCreate a background thread that periodically refreshes access and refresh tokens. While the underlying library refreshes tokens, it does not have an internal cronjob that checks every X-seconds if a token has expired. If there is no activity for longer than the refresh tokens lifetime, it will expire. Therefore, refresh manually shortly before expiration time is up. refresh_tokenN expires_in<cTtjt|dz djEjj s) dt t jjvrtjt sJjjjjdj_jjjddz }n3|J|j}|jj_tjt|djjj s'yyyy#tt f$r!}d}t#j$|Yd}~vd}~wwxYw)Nrtoken_endpointr)timesleepmaxrLis_setr r rgryrArmetadatarhrn fetch_tokenRequestsHTTPErrorrrtoken_refresh_failed) refresh_timert new_sessionexcrTs r`periodic_refresh_tokenzKConnection._create_background_token_refresh..periodic_refresh_tokensZ JJs<",a0 1//;77>>@8&$}dmm*L*R*RR)$--GGG.2mm.I.I MM223CD/ +(,}}':':'>'>|'Lr'Q  %000&+&<&<&> .9.E.E.G +  3|Q/0-//;77>>@<@<"*;78#$L223778s CE77F'F""F'T TokenRefresh)targetargsdaemonname)rrMrtOptional[_Auth]returnNone) rArgr ryrhrrLrstart)rTrtrrdemons` r`roz+Connection._create_background_token_refreshs $--777 $--"5"5 5%- ----11 " +0'' 16)e$    r|ct|dr&|j|jjt|dr|jj yy)z%Shutdown connection class gracefully.rLNrg)hasattrrLsetrgr9rzs r`r9zConnection.close4sL D6 7//;  + + / / 1 4 $ MM   ! %r|c|jS)z Returns the correct headers for a request. Returns ------- dict Request header as a dict. )r@rzs r`rizConnection._get_request_header?s}}r|c |j|jj|j|jz|z}|jj |||j |j|j|S)a Make a DELETE request to the Weaviate server instance. Parameters ---------- path : str Sub-path to the Weaviate resources. Must be a valid Weaviate sub-path. e.g. '/meta' or '/objects', without version. weaviate_object : dict, optional Object is used as payload for DELETE request. By default None. params : dict, optional Additional request parameters, by default None Returns ------- requests.Response The response, if request was successful. Raises ------ requests.ConnectionError If the DELETE request could not be made. r-rlrcr?rVparams) r/ensure_runningr-r,rgdeleterirjrHrTpathweaviate_objectr request_urls r`rzConnection.deleteJs|:    '    + + -hh!7!77$> }}## ,,.((MM $  r|c |j|jj|j|jz|z}|jj |||j |j|j|S)a Make a PATCH request to the Weaviate server instance. Parameters ---------- path : str Sub-path to the Weaviate resources. Must be a valid Weaviate sub-path. e.g. '/meta' or '/objects', without version. weaviate_object : dict Object is used as payload for PATCH request. params : dict, optional Additional request parameters, by default None Returns ------- requests.Response The response, if request was successful. Raises ------ requests.ConnectionError If the PATCH request could not be made. r) r/rr-r,rgpatchrirjrHrs r`rzConnection.patchts|8    '    + + -hh!7!77$> }}"" ,,.((MM #  r|c |j|jj|j|jz|z}|jj |||j |j|j|S)a Make a POST request to the Weaviate server instance. Parameters ---------- path : str Sub-path to the Weaviate resources. Must be a valid Weaviate sub-path. e.g. '/meta' or '/objects', without version. weaviate_object : dict Object is used as payload for POST request. params : dict, optional Additional request parameters, by default None external_url: Is an external (non-weaviate) url called Returns ------- requests.Response The response, if request was successful. Raises ------ requests.ConnectionError If the POST request could not be made. r) r/rr-r,rgpostrirjrHrs r`rzConnection.posts|<    '    + + -hh!7!77$> }}!! ,,.((MM "  r|c |j|jj|j|jz|z}|jj |||j |j|j|S)a Make a PUT request to the Weaviate server instance. Parameters ---------- path : str Sub-path to the Weaviate resources. Must be a valid Weaviate sub-path. e.g. '/meta' or '/objects', without version. weaviate_object : dict Object is used as payload for PUT request. params : dict, optional Additional request parameters, by default None Returns ------- requests.Response The response, if request was successful. Raises ------ requests.ConnectionError If the PUT request could not be made. r) r/rr-r,rgputrirjrHrs r`rzConnection.puts|8    '    + + -hh!7!77$> }}   ,,.((MM !  r|c|j|jj|i}|r|}n|j|jz|z}|jj ||j |j||jS)a]Make a GET request. Parameters ---------- path : str Sub-path to the Weaviate resources. Must be a valid Weaviate sub-path. e.g. '/meta' or '/objects', without version. params : dict, optional Additional request parameters, by default None external_url: Is an external (non-weaviate) url called Returns ------- requests.Response The response if request was successful. Raises ------ requests.ConnectionError If the GET request could not be made. )r-rcr?rrV) r/rr-r,rgrhrirjrH)rTrr external_urlrs r`rhzConnection.gets0    '    + + - >F K((T%;%;;dBK}}  ,,.((MM !  r|c |j|jj|j|jz|z}|jj ||j |j|j|S)a Make a HEAD request to the server. Parameters ---------- path : str Sub-path to the resources. Must be a valid sub-path. e.g. '/meta' or '/objects', without version. params : dict, optional Additional request parameters, by default None Returns ------- requests.Response The response to the request. Raises ------ requests.ConnectionError If the HEAD request could not be made. )r-rcr?rVr) r/rr-r,rgheadrirjrH)rTrrrs r`rzConnection.headsy4    '    + + -hh!7!77$> }}!!,,.((MM "  r|c|jS)aQ Getter/setter for `timeout_config`. Parameters ---------- timeout_config : tuple(float, float), optional For Setter only: Set the timeout configuration for all requests to the Weaviate server. It can be a float or, a tuple of two floats: (connect timeout, read timeout). If only one float is passed then both connect and read timeout will be set to that value. Returns ------- Tuple[float, float] For Getter only: Requests Timeout configuration. rjrzs r`r.zConnection.timeout_configAs(###r|c||_y)zW Setter for `timeout_config`. (docstring should be only in the Getter) Nr)rTr.s r`r.zConnection.timeout_configWs .r|c|jSN)rHrzs r`rVzConnection.proxies_s }}r|c|j|jzdz}t|D]<} tj||j t jy tj||j t jy#tttf$rtjdYwxYw#tttf$r"}td|d|jd|d}~wwxYw)a Waits until weaviate is ready or the timelimit given in 'startup_period' has passed. Parameters ---------- startup_period : int Describes how long the client will wait for weaviate to start in seconds. Raises ------ WeaviateStartUpError If weaviate takes longer than the timelimit to respond. z/.well-known/ready)rcr?NrzWeaviate did not start up in z" seconds. Either the Weaviate URL zQ is wrong or Weaviate did not start up in the interval given in 'startup_period'.)r-r,rangererhriINIT_CHECK_TIMEOUTraise_for_statusrRequestsConnectionErrorrrrr)rTr) ready_url_ierrors r`rNzConnection.wait_for_weaviatecsHHt5558LL ' B  t'?'?'AK]""$    LL4#;#;#=GY  &'> L  1  "#:KH &//??abfbjbjakl}~  s)8B!(8C!)C  C D$DDc|jSr)r0rzs r` grpc_stubzConnection.grpc_stubs r|c|jS)z3 Version of the weaviate instance. )rRrzs r`server_versionzConnection.server_versions ###r|cJ|jd}t|d}|J|S)z, Returns the meta endpoint. z/meta)rz Meta endpoint)rhr)rTrrress r`rQzConnection.get_metas/888)(?C r|)NN)r-strrUOptional[AuthCredentials]r.TIMEOUT_TYPE_RETURNrVUnion[dict, str, None]rWboolrXOptional[Dict[str, Any]]r) Optional[int]rYrr/zOptional[EmbeddedDB]rZr)rUrrr)rr)rYrrrr)rtrrr)rr)rrB)rrrzOptional[JSONPayload]rrrrequests.Response)rrr JSONPayloadrrrr)NF)rrrrrrrr)rrrrrr)rr)r.rrr)r)rMrr)rz(Optional[weaviate_pb2_grpc.WeaviateStub])rzDict[str, str])__name__ __module__ __qualname____doc__rarOr{rPror9rirrrrrhrpropertyr.setterrVrNrrrQr|r`r"r"6s>-1#'nL nL6nL, nL ( nL  nL5nL&nL,nL*nL!nL`E/N10d " 26+/ ( ( /( ) (  ( \,0 ' ' %' ) '  ' Z,0 ) ) %) ) )  ) ^,0 ' ' %' ) '  ' TX]( ( !9( PT( ( Z,0$ $ )$   $ L$$*..!F$$ r|r"ctjj}ttj|j |j dz zS)zp Get the current epoch time as an integer. Returns ------- int Current epoch time. g.A)datetimeutcnowroundrmktime timetuple microsecond)dtss r`_get_epoch_timers@    " " $C S]]_-#0EE FFr|c |?t|tr||dSt|tr|Stdt |d|siSt j jdt j jdf}t j jdt j jdf}t||zsiSi}t|r|dr|dn|d |d <t|r|dr|dn|d |d <|S) ag Get proxies as dict, compatible with 'requests' library. NOTE: 'proxies' has priority over 'trust_env', i.e. if 'proxies' is NOT None, 'trust_env' is ignored. Parameters ---------- proxies : dict, str or None The proxies to use for requests. If it is a dict it should follow 'requests' library format (https://docs.python-requests.org/en/stable/user/advanced/#proxies). If it is a URL (str), a dict will be constructed with both 'http' and 'https' pointing to that URL. If None, no proxies will be used. trust_env : bool If True, the proxies will be read from ENV VARs (case insensitive): HTTP_PROXY/HTTPS_PROXY. NOTE: It is ignored if 'proxies' is NOT None. Returns ------- dict A dictionary with proxies, either set from 'proxies' or read from ENV VARs. )httphttpszFIf 'proxies' is not None, it must be of type dict or str. Given type: r& HTTP_PROXY http_proxy HTTPS_PROXY https_proxyrrrr) rArrBrCrDosenvironrhany)rVrWrrs r`rGrGs0 gs #   gt $N =/ ,   **... |0LMJ::>>-0"**..2OPK zK' ( G :+5a=*Q-jm ;-8^;q>Q Nr|)rrM)rVrrWrrrB)Cr __future__rrrr2r threadingrrtypingrrrr r r urllib.parser re$authlib.integrations.requests_clientr requests.adaptersrrequests.exceptionsrrrrrr weaviate.authrrrweaviate.configrweaviate.connect.authenticationrweaviate.embeddedrweaviate.exceptionsrrweaviate.typesr weaviate.utilrrrweaviate.warningsrr:weaviate.proto.v1r r1 ImportErrorrBlistrsessionsrfrrr"rrGrr|r`rs# #::!>)W>/LL,1(# (3H D$J !!))=8 9GW,-b b J G4{Hs C C*)C*