Google
Edit File: http_utils.cpython-36.pyc
3 !S�i � @ s� d dl Z d dlZd dlZd dlZd dlmZ ddlmZmZmZm Z m Z ddl m Z m Z mZmZmZmZ dd� Zdd d �Zd d � Zd d� Zddd�Zdd� Zdd� Ze� Ze jed�ddd��ZdS )� N)�SSLError� )�config� constants�errors� log_utils�utils)� HTTPError�Request�URLError�httplib� std_urlopen�urlparsec O s� t | d�r| j� }n | }t| �} |jdi �}|jtjtjd�� x |j� D ]\}}| j ||� qJW t j dj ||�� yltj r�d|kr�tj|d< tj r�ttdd �r�tj� }d|_tj|_||d< t| f|�|�S t| f|�|�S tk �r. } z0|jd k�r tj|j |j|j |j |j ��� W Y d d }~X n~ t k �r� } z`|j!�r�t |j!d d ��r�|j!d j"t"j#k�r�tj| d t$|�d d ��d j ||�|_%||_ � W Y d d }~X nX d S ) N� get_full_url�headers)z KC-VersionzKC-Patch-Versionz#Requesting url: `{0}`. Headers: {1}�timeout�HAS_SNIF�contexti� r �errnoz Request for `{0}` failed: {1})&�hasattrr r �pop�updater �VERSION�KC_PATCH_VERSION�items� add_headerr �logdebug�format�PY2_6r � HTTP_TIMEOUT�CHECK_SSL_CERTS�getattr�ssl�create_default_context�check_hostname� CERT_NONE� verify_moder r �coder �NotFound�url�msg�hdrs�fpr �argsr �ENOENT�str�reason) r) r- �kwargsZ request_urlr �header�value�ctx�ex� r6 �0/usr/libexec/kcare/python/kcarectl/http_utils.py� urlopen_base s> .r8 Tc s � fdd�}|S )Nc sb t | t�r� o| jdkS t | ttjttjf�r2dS t | d�r^t | j �dkr^| j d t j kr^dS d S )Ni� Tr- � r )� isinstancer r' r r � HTTPExceptionr �socketr r �lenr- r Z ECONNRESET)�e�state)� retry_on_500r6 r7 �check_functionD s (z3check_urlopen_retry_factory.<locals>.check_functionr6 )r@ rA r6 )r@ r7 �check_urlopen_retry_factoryC s rB c C s t | d�r| j� } | jd�S )Nr zfile:)r r � startswith)r) r6 r6 r7 � is_local_urlP s rD c O sV |j dd�}|j dtj�}t| �r2t| f|�|�S tjt|d�|d�t�| f|�|�S )Nr@ T� retry_count)r@ )�count)r r � RETRY_COUNTrD r8 r �retryrB )r) r- r1 r@ rE r6 r6 r7 �urlopenV s rI c C sH t | |d�}tj r*|r*|jddj|�� tj rD|rD|jtj|� |S )N)�method� Authorizationz Basic {0})r r �UPDATE_FROM_LOCALr r r �AUTH_TOKEN_HEADER)r) � auth_string� auth_tokenrJ �requestr6 r6 r7 � http_request^ s rQ c C s< | dkr t jd�pt jd�S | dkr8t jd�p6t jd�S d S )N�httpZ http_proxyZ HTTP_PROXY�httpsZ https_proxyZ HTTPS_PROXY)�os�getenv)�schemer6 r6 r7 �get_proxy_from_envi s rW c C s t td��pt td��S )NrR rS )�boolrW r6 r6 r6 r7 � proxy_is_usedp s rY )Z check_retryc C s� t jj| �}|s tdj| ���ttj|��}|j}|j }|jp@d}|dkrRtd��|dkrl|j dkrhdnd}|j dkr~t j }n|j dkr�t j }ntd ��tjr�i nd tji} |||f| �} i } |r�d j|�| d < d | d< t|�| d< tj| d< z�| jd|� x"| j� D ]\} } | j| | � �qW | j� t| d��}| j|� W dQ R X | j� }|jdk�r�y |j � }W n t k �r� d}Y nX dj|j�}|dk �r�|dj|�7 }t j |� t ||j|dd��W d| j!� X dS )a� Upload a file to the given URL using HTTP PUT with chunked streaming. Note: The standard library urllib doesn't support PUT with data We need to use httplib directly for this This function uses streaming upload to support large files up to 1GB without loading the entire file into memory. :param file_path: Path to the file to upload :param upload_url: Full URL to upload the file to. Query params are ignored. :param auth_string: Optional authentication string for Basic Auth :return: None if upload succeeded :raises HTTPError: If upload fails with HTTP status >= 400 :raises ValueError: If URL is invalid z"Refusing to upload empty file: {0}�/Nz Invalid URL: missing hostnamerS i� �P rR z Invalid URL: unsupported schemer z Basic {0}rK zapplication/octet-streamz Content-TypezContent-Lengthz KC-Version�PUT�rbi� z Failed to upload file: HTTP {0}z - {0})"rT �path�getsize� ValueErrorr r r �nstr�hostname�portrV r �HTTPConnection�HTTPSConnectionr r r �HTTP_UPLOAD_TIMEOUTr/ r � putrequestr � putheader� endheaders�open�send� getresponse�status�read� Exceptionr �logerrorr �close)Z file_path� upload_urlrN Z file_size�parsed�hostrc Zurl_pathZconn_clsZ conn_kwargs�connr r2 r3 �f�responseZ error_body� error_msgr6 r6 r7 � upload_filew sV ry )T)NN)N) r rT r< r" r � r r r r r �py23r r r r r r r8 rB rD rI rQ rW rY �check_urlopen_retryrH ry r6 r6 r6 r7 �<module> s 1