U
+ �aΛ � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
ZddlZddlZddlZddlmZ ddlZddlmZmZmZmZmZm Z m Z m Z m Z m Z m!Z!m"Z"m#Z# ddl$m%Z% ddl&m'Z' ddl(m)Z) ddl*m+Z+ dd l,m-Z- e�.d
�Z/e�.d ej0�Z1e�.d �Z2e�.d
ej0�j3Z4d�5� Z6ddddgZ7dZ8dZ9e9j:dj:ej;� ed�Z<dd� Z=dd� Z>dd� Z?dAd d�Z@dBd d �ZAdCd d �ZBdedfd!d�ZCd"d#� ZDe�.d$ej0�ZEeDd%d&� �ZFG d'd(� d(�ZGG d)d*� d*eG�ZHG d+d� de �ZIe�.d,�jJZKd-d.� ZLd/d0� ZMdDd1d2�ZNd3d4� ZOG d5d6� d6�ZPG d7d8� d8e jQ�ZRejSjTfd9d:�ZUd;d<� ZVeNe8�eU�ZUd=d>� ZWd?d@� ZXdS )Ez#PyPI and direct package downloading� N��wraps)
�
CHECKOUT_DIST� Distribution� BINARY_DIST�normalize_path� SOURCE_DIST� Environment�find_distributions� safe_name� safe_version� to_filename� Requirement� DEVELOP_DIST�EGG_DIST)�log)�DistutilsError)� translate)�Wheel��unique_everseenz^egg=([-A-Za-z0-9_.+!]+)$zhref\s*=\s*['"]?([^'"> ]+)z�<a href="([^"#]+)">([^<]+)</a>\n\s+\(<a (?:title="MD5 hash"\n\s+)href="[^?]+\?:action=show_md5&digest=([0-9a-f]{32})">md5</a>\)z([-+.a-z0-9]{2,}):z .tar.gz .tar.bz2 .tar .zip .tgz� PackageIndex�distros_for_url�parse_bdist_wininst�interpret_distro_name� z<setuptools/{setuptools.__version__} Python-urllib/{py_major}z{}.{})Zpy_major�
setuptoolsc
C sD z t �| �W S tk
r> } ztd| f �|�W 5 d }~X Y nX d S )Nz1Not a URL, existing file, or requirement spec: %r)r �parse�
ValueErrorr )�spec�e� r! �@/tmp/pip-install-1bd_1mtk/setuptools/setuptools/package_index.py�parse_requirement_arg6 s ��r# c C s� | � � }d\}}}|�d�r�|�d�r8| dd� }d}nn|�dd�rb| d d
� }| dd� }d}nD|�d �r~| dd � }d
}n(|�dd�r�| d d
� }| dd� }d
}|||fS )z=Return (base,pyversion) or (None,None) for possible .exe name)NNN�.exez
.win32.exeNi�����win32z .win32-pyi�i�������z.win-amd64.exei�z win-amd64z
.win-amd64-pyi��)�lower�endswith�
startswith)�namer' �base�py_ver�platr! r! r" r ? s$
c C sx t j�| �}|\}}}}}}t j�|�d�d �}|dkrX|dkrXt j�|�d�d �}d|krp|�dd�\}}||fS )N�/���zsourceforge.net�download����#� )�urllibr �urlparse�unquote�split) �url�parts�scheme�server�path�
parameters�query�fragmentr+ r! r! r" �egg_info_for_urlW s r@ c c s\ t | �\}}t| ||�D ]
}|V q|rXt�|�}|rXt| |�d�|td�D ]
}|V qLdS )zEYield egg or source distribution objects that might be found at a URLr3 )�
precedenceN)r@ �distros_for_location� EGG_FRAGMENT�matchr �groupr )r8 �metadatar+ r? �distrD r! r! r" r b s
�
c C s� |� d�r|dd� }|� d�r8d|kr8t�| ||�gS |� d�rxd|krxt|�}|�� s^g S t| |j|jtd d�gS |� d �r�t|�\}}}|dk r�t | |||t
|�S t D ]0}|� |�r�|dt |� � }t | ||� S q�g S )
z:Yield egg or source distribution objects based on basename�.egg.zipNr& z.egg�-z.whlr3 )�location� project_name�versionrA r$ )
r( r �
from_locationr �
is_compatiblerK rL r r r r �
EXTENSIONS�len)rJ �basenamerF �wheelZwin_baser, �platform�extr! r! r" rB p s<
�
�
rB c C s t t| �tj�| �|�S )zEYield possible egg or source distribution objects based on a filename)rB r �osr< rQ )�filenamerF r! r! r" �distros_for_filename� s
�rW c
c s| |� d�}|s,tdd� |dd� D ��r,dS tdt|�d �D ]8}t| |d�|d|� �d�||d� �|||d�V q>dS )z�Generate alternative interpretations of a source distro name
Note: if `location` is a filesystem filename, you should call
``pkg_resources.normalize_path()`` on it before passing it to this
routine!
rI c s s | ]}t �d |�V qdS )z py\d\.\d$N)�rerD )�.0�pr! r! r" � <genexpr>� s z(interpret_distro_name.<locals>.<genexpr>� Nr3 )�
py_versionrA rS )r7 �any�rangerP r �join)rJ rQ rF r] rA rS r9 rZ r! r! r" r � s
�c s t � �� fdd��}|S )zs
Wrap a function returning an iterable such that the resulting iterable
only ever yields unique items.
c s t � | |��S �Nr )�args�kwargs��funcr! r" �wrapper� s z unique_values.<locals>.wrapperr )re rf r! rd r" �
unique_values� s rg z(<([^>]*\srel\s*=\s*['"]?([^'">]+)[^>]*)>c c s� t �|�D ]d}|�� \}}tttj|�� �d���}d|ksDd|kr
t �|�D ] }t
j � | t
|�d���V qNq
dD ]@}|�|�}|dkrtt �||�}|rtt
j � | t
|�d���V qtdS )zEFind rel="homepage" and rel="download" links in `page`, yielding URLs�,Zhomepager0 r3 )z
<th>Home Pagez<th>Download URLr/ N)�REL�finditer�groups�set�map�str�stripr' r7 �HREFr4 r �urljoin�
htmldecoderE �find�search)r8 �pagerD �tag�relZrels�posr! r! r" �find_external_links� s
ry c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �ContentCheckerzP
A null content checker that defines the interface for checking content
c C s dS )z3
Feed a block of data to the hash.
Nr! ��self�blockr! r! r" �feed� s zContentChecker.feedc C s dS )zC
Check the hash. Return False if validation fails.
Tr! �r| r! r! r" �is_valid� s zContentChecker.is_validc C s dS )zu
Call reporter with information about the checker (hash name)
substituted into the template.
Nr! )r| �reporter�templater! r! r" �report� s zContentChecker.reportN)�__name__�
__module__� __qualname__�__doc__r~ r� r� r! r! r! r" rz � s rz c @ sB e Zd Ze�d�Zdd� Zedd� �Zdd� Z dd � Z
d
d � Z d S )
� HashCheckerzK(?P<hash_name>sha1|sha224|sha384|sha256|sha512|md5)=(?P<expected>[a-f0-9]+)c C s || _ t�|�| _|| _d S ra )� hash_name�hashlib�new�hash�expected)r| r� r� r! r! r" �__init__� s zHashChecker.__init__c C s> t j�|�d }|st� S | j�|�}|s0t� S | f |�� �S )z5Construct a (possibly null) ContentChecker from a URLr/ )r4 r r5 rz �patternrt � groupdict)�clsr8 r? rD r! r! r" �from_url s zHashChecker.from_urlc C s | j �|� d S ra )r� �updater{ r! r! r" r~ s zHashChecker.feedc C s | j �� | jkS ra )r� � hexdigestr� r r! r! r" r� s zHashChecker.is_validc C s || j }||�S ra )r� )r| r� r� �msgr! r! r" r� s
zHashChecker.reportN) r� r� r� rX �compiler� r� � classmethodr� r~ r� r� r! r! r! r" r� � s �
r� c sD e Zd ZdZdLdd�ZdMd d
�ZdNd d �ZdOd
d�Zdd� Zdd� Z dd� Z
dd� Z dd� Z dPdd�Z
dd � ZdQ� fd d � Zd d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� ZdRd)d*�ZdSd+d,�Zd-d.� Zd/Zd0d1� Zd2d3� ZdTd4d5�Zd6d7� Z d8d9� Z d:d;� Z d<d=� Z d>d?� Z e!dUd@dA��Z"dBdC� Z#dDdE� Z$dFdG� Z%dHdI� Z&dJdK� Z'� Z(S )Vr z;A distribution index that scans web pages for download URLs�https://pypi.org/simple/��*NTc O sl t j| f|�|� |dd |�d� � | _i | _i | _i | _t�d� t
t |���j | _
g | _tjj| _d S )Nr. �|)r r� r( � index_url� scanned_urls� fetched_urls�
package_pagesrX r� r` rm r rD �allows�to_scanr4 �request�urlopen�opener)r| r� �hostsZ ca_bundleZ
verify_sslrb �kwr! r! r" r� s zPackageIndex.__init__Fc C s� || j kr|sdS d| j |< t|�s2| �|� dS tt|��}|r\| �|�sPdS | �d|� |sn|rn|| jkr�tt| j |�� dS | �|�s�d| j|< dS | �
d|� d| j|< d}| � ||| �}|dkr�dS t |t
jj�r�|jdkr�| �
d|j � d| j|j< d|j�d d
��� k�r(|�� dS |j}|�� }t |t��svt |t
jj��rXd }n|j�d ��phd }|�|d
�}|�� t� |�D ](} t
j � |t | � d���}
| �!|
� �q�|�"| j#��r�t$|dd�dk�r�| �%||�}dS )z<Evaluate a URL as a possible download, and maybe retrieve itNTzFound link: %sz
Reading %sz<Download error on %s: %%s -- Some packages may not be found!i� zAuthentication error: %s�html� content-type� zlatin-1�charset�ignorer3 �code� )&r� �
URL_SCHEME�process_filename�listr �url_ok�debugr� rm �add�info�open_url�
isinstancer4 �error� HTTPErrorr� r� r8 �headers�getr' �close�readrn � get_param�decoderp rj r rq rr rE � process_urlr) r� �getattr�
process_index) r| r8 �retrieve�dists�tmpl�fr+ ru r� rD �linkr! r! r" r� * sT
zPackageIndex.process_urlc C s� t j�|�s | �d|� d S t j�|�r^|s^t j�|�}t �|�D ]}| �t j�||�d� qBt |�}|r�| �
d|� t t | j
|�� d S )Nz
Not found: %sTz Found: %s)rU r< �exists�warn�isdir�realpath�listdirr� r` rW r� r� rm r� )r| �fn�nestedr< �itemr� r! r! r" r� _ s z PackageIndex.process_filenamec C sb t |�}|o |�d��� dk}|s8| �tj�|�d �r<dS d}|rRt|| ��n | �||� d S )Nr3 �fileTzN
Note: Bypassing %s (disallowed host; see http://bit.ly/2hrImnY for details).
) r� rE r' r� r4 r r5 r r� )r| r8 �fatal�s�is_filer� r! r! r" r� o s �zPackageIndex.url_okc C s2 t tjj|�}dd� |D �}tt�| j|�� d S )Nc s s0 | ](}t �|�D ]}|�d �r||fV qqdS )z .egg-linkN)rU r� r( )rY r< �entryr! r! r" r[ ~ s
�z.PackageIndex.scan_egg_links.<locals>.<genexpr>)�filterrU r< r� r� � itertools�starmap�
scan_egg_link)r| � search_path�dirsZ egg_linksr! r! r" �scan_egg_links| s
�zPackageIndex.scan_egg_linksc C s� t tj�||��� }ttd ttj|���}W 5 Q R X t |�dkrDd S |\}}t
tj�||��D ](}tjj|f|�� |_ t |_
| �|� q^d S )Nr\ )�openrU r< r` r� r� rm rn ro rP r
rJ r rA r� )r| r< r� Z raw_lines�linesZegg_pathZ
setup_pathrG r! r! r" r� � s zPackageIndex.scan_egg_linkc C s� d}|� | j�s|S tttjj|t| j�d � �d���}t|�dksRd|d krV|S t |d �}t
|d �}d| j � |�
� i �|< t|�t|�fS )N)NNr. r\ r2 r3 r T)r) r� r� rm r4 r r6 rP r7 r r r� �
setdefaultr' r
)r| r� ZNO_MATCH_SENTINELr9 �pkg�verr! r! r" �_scan� s � zPackageIndex._scanc
C s� t �|�D ]<}z"| �tj�|t|�d���� W q
tk
rD Y q
X q
| �|�\}}|s^dS t ||�D ]H}t
|�\}}|� d�r�|s�|r�|d||f 7 }n
| � |� | �
|� qht�dd� |�S )z#Process the contents of a PyPI pager3 r� �.pyz
#egg=%s-%sc S s d| � ddd� S )Nz<a href="%s#md5=%s">%s</a>r3 � r\ )rE )�mr! r! r" �<lambda>� � z,PackageIndex.process_index.<locals>.<lambda>)rp rj r� r4 r rq rr rE r ry r@ r( �need_version_info�scan_url�PYPI_MD5�sub) r| r8 ru rD r� r� �new_urlr+ �fragr! r! r" r� � s& "
�zPackageIndex.process_indexc C s | � d|� d S )NzPPage at %s links to .py file(s) without version info; an index scan is required.)�scan_all�r| r8 r! r! r" r� � s �z PackageIndex.need_version_infoc G s: | j | jkr*|r | j|f|�� | �d� | �| j � d S )Nz6Scanning index of all packages (this may take a while))r� r� r� r� r� �r| r� rb r! r! r" r� � s �zPackageIndex.scan_allc C sz | � | j|j d � | j�|j�s:| � | j|j d � | j�|j�sR| �|� t| j�|jd��D ]}| � |� qfd S )Nr. r! ) r� r� � unsafe_namer� r� �keyrK �not_found_in_indexr� )r| � requirementr8 r! r! r" �
find_packages� s
zPackageIndex.find_packagesc sR | � � | �|� | |j D ]"}||kr0| S | �d||� q tt| ��||�S )Nz%s does not match %s)�prescanr� r� r� �superr �obtain)r| r� � installerrG �� __class__r! r" r� � s
zPackageIndex.obtainc C sL |� | jd| � |�� sH|�� t�|� td|jjtj �
|�f ��dS )z-
checker is a ContentChecker
z Validating %%s checksum for %sz7%s validation failed for %s; possible download problem?N) r� r� r� r� rU �unlinkr r� r* r< rQ )r| �checkerrV �tfpr! r! r" �
check_hash� s �
��zPackageIndex.check_hashc C sN |D ]D}| j dks0t|�r0|�d�s0tt|��r<| �|� q| j �|� qdS )z;Add `urls` to the list that will be prescanned for searchesN�file:)r� r� r) r� r r� �append)r| �urlsr8 r! r! r" �add_find_links� s ���
� zPackageIndex.add_find_linksc C s" | j rtt| j| j �� d| _ dS )z7Scan urls scheduled for prescanning (e.g. --find-links)N)r� r� rm r� r r! r! r" r� s zPackageIndex.prescanc C s< | |j r| jd }}n | jd }}|||j� | �� d S )Nz#Couldn't retrieve index page for %rz3Couldn't find index page for %r (maybe misspelled?))r� r� r� r� r� )r| r� �methr� r! r! r" r� s
� z PackageIndex.not_found_in_indexc C s~ t |t�sjt|�}|rR| �|�d�||�}t|�\}}|�d�rN| �|||�}|S tj �
|�rb|S t |�}t | �
||�dd�S )a Locate and/or download `spec` to `tmpdir`, returning a local path
`spec` may be a ``Requirement`` object, or a string containing a URL,
an existing local filename, or a project/version requirement spec
(i.e. the string form of a ``Requirement`` object). If it is the URL
of a .py file with an unambiguous ``#egg=name-version`` tag (i.e., one
that escapes ``-`` as ``_`` throughout), a trivial ``setup.py`` is
automatically created alongside the downloaded file.
If `spec` is a ``Requirement`` object or a string containing a
project/version requirement spec, this method returns the location of
a matching distribution (possibly after downloading it to `tmpdir`).
If `spec` is a locally existing file or directory name, it is simply
returned unchanged. If `spec` is a URL, it is downloaded to a subpath
of `tmpdir`, and the local filename is returned. Various errors may be
raised if a problem occurs during downloading.
r3 r� rJ N)r� r r� �
_download_urlrE r@ r( � gen_setuprU r< r� r# r� �fetch_distribution)r| r �tmpdirr: �foundr+ r? r! r! r" r0 s
zPackageIndex.downloadc s� �� d|� i �d}d
� ����fdd� }|rH��� ��|� ||�}|s^|dk r^|||�}|dkr��jdk rx��� ||�}|dkr�|s���|� ||�}|dkr���d�r�dp�d|� n�� d|� |j|jd �S dS ) a| Obtain a distribution suitable for fulfilling `requirement`
`requirement` must be a ``pkg_resources.Requirement`` instance.
If necessary, or if the `force_scan` flag is set, the requirement is
searched for in the (online) package index as well as the locally
installed packages. If a distribution matching `requirement` is found,
the returned distribution's ``location`` is the value you would have
gotten from calling the ``download()`` method with the matching
distribution's URL or filename. If no matching distribution is found,
``None`` is returned.
If the `source` flag is set, only source distributions and source
checkout links will be considered. Unless the `develop_ok` flag is
set, development and system eggs (i.e., those using the ``.egg-info``
format) will be ignored.
zSearching for %sNc s� |d kr �}|| j D ]v}|jtkrF� sF|�kr��d|� d�|< q|| ko\|jtkp\� }|r��|j��}||_tj �
|j�r| S qd S )Nz&Skipping development or system egg: %sr3 ) r� rA r r� r r0 rJ �download_locationrU r< r� )�req�envrG �test�loc��
develop_okr| �skipped�sourcer r! r" rs U s& ��z-PackageIndex.fetch_distribution.<locals>.findz:No local packages or working download links found for %s%sza source distribution of r� zBest match: %s)rJ )N)r� r� r� r� r� �cloner ) r| r� r �
force_scanr r Z local_indexrG rs r! r
r" r = s2
� z PackageIndex.fetch_distributionc C s" | � ||||�}|dk r |jS dS )a3 Obtain a file suitable for fulfilling `requirement`
DEPRECATED; use the ``fetch_distribution()`` method now instead. For
backward compatibility, this routine is identical but returns the
``location`` of the downloaded distribution instead of a distribution
object.
N)r rJ )r| r� r r r rG r! r! r" �fetch� s zPackageIndex.fetchc
C s� t �|�}|r*dd� t||�d�d �D �p,g }t|�dkr�tj�|�}tj�|�|kr�tj� ||�}ddl
m } |||�s�t �
||� |}ttj� |d�d��2} | �d|d j|d jtj�|�d f � W 5 Q R X |S |r�td ||f ��ntd
��d S ) Nc S s g | ]}|j r|�qS r! )rL )rY �dr! r! r" �
<listcomp>� s �z*PackageIndex.gen_setup.<locals>.<listcomp>r3 r )�samefilezsetup.py�wzIfrom setuptools import setup
setup(name=%r, version=%r, py_modules=[%r])
z�Can't unambiguously interpret project/version identifier %r; any dashes in the name or version should be escaped using underscores. %rzpCan't process plain .py files without an '#egg=name-version' suffix to enable automatic setup script generation.)rC rD r rE rP rU r< rQ �dirnamer` Z setuptools.command.easy_installr �shutil�copy2r� �writerK rL �splitextr )
r| rV r? r rD r� rQ �dstr r� r! r! r" r � sB
��
������zPackageIndex.gen_setupi c C s | � d|� d }z�t�|�}| �|�}t|tjj�rJt d||j
|j f ��|� � }d}| j }d}d|kr�|�
d�} ttt| ��}| �|||||� t|d��V}
|�|�} | r�|�| � |
�| � |d7 }| �|||||� q�q�q�| �|||
� W 5 Q R X |W �S |�r|�� X d S ) NzDownloading %szCan't download %s: %s %sr r/ zcontent-lengthzContent-Length�wbr3 )r� r� r� r� r� r� r4 r� r� r r� r� � dl_blocksize�get_all�maxrm �int�
reporthookr� r� r~ r r� ) r| r8 rV �fpr� r� �blocknum�bs�sizeZsizesr� r} r! r! r" � _download_to� s:
�
zPackageIndex._download_toc C s d S ra r! )r| r8 rV r% Zblksizer' r! r! r" r# � s zPackageIndex.reporthookc
C s� |� d�rt|�S zt|| j�W S ttjjfk
r� } z>d�dd� |j D ��}|rb| �
||� nt d||f �|�W 5 d }~X Y �n t j
jk
r� } z | W Y �S d }~X Y n� t j
jk
�r } z,|r�| �
||j� nt d||jf �|�W 5 d }~X Y n� tjjk
�rP } z.|�r,| �
||j� nt d||jf �|�W 5 d }~X Y nT tjjtj
fk
�r� } z*|�r�| �
||� nt d||f �|�W 5 d }~X Y nX d S )Nr� � c S s g | ] }t |��qS r! )rn )rY �argr! r! r" r � s z)PackageIndex.open_url.<locals>.<listcomp>z%s %szDownload error for %s: %sz;%s returned a bad status line. The server might be down, %s)r) �
local_open�open_with_authr� r �http�client�
InvalidURLr` rb r� r r4 r� r� �URLError�reason�
BadStatusLine�line�
HTTPException�socket)r| r8 �warning�vr� r! r! r" r� � sJ
$����� ��zPackageIndex.open_urlc C s� t |�\}}|r0d|kr4|�dd��dd�}qnd}|�d�rJ|d d� }tj�||�}|dksj|�d �rv| �||�S |d
ks�|�d �r�| �||�S |�d �r�| � ||�S |d
kr�t
j � t
j
�|�d �S | �|d� | �||�S d S )Nz..�.�\�_Z__downloaded__rH r& �svnzsvn+�gitzgit+zhg+r� r\ T)r@ �replacer( rU r< r` r) �
_download_svn�
_download_git� _download_hgr4 r� � url2pathnamer r5 r� �_attempt_download)r| r: r8 r r* r? rV r! r! r" r s$
zPackageIndex._download_urlc C s | � |d� d S )NT)r� r� r! r! r" r� ) s zPackageIndex.scan_urlc C s6 | � ||�}d|�dd��� kr.| �|||�S |S d S )Nr� r� r� )r( r� r' �_download_html)r| r8 rV r� r! r! r" rB , s z PackageIndex._attempt_downloadc C sn t |�}|D ]>}|�� r t�d|�rF|�� t�|� | �||� S qLq |�� t�|� td| ��d S )Nz <title>([^- ]+ - )?Revision \d+:z Unexpected HTML page found at ) r� ro rX rt r� rU r� r> r )r| r8 r� rV r� r3 r! r! r" rC 3 s
zPackageIndex._download_htmlc C s t �dt� |�dd�d }d}|�� �d�r�d|kr�tj�|�\}}}}}} |s�|�d�r�d |d
d � kr�|d
d � �d d�\}}t |�\}
} |
r�d |
kr�|
�d d�\} }
d | |
f }nd
|
}| }|||||| f}tj�
|�}| � d||� t �
d|||f � |S )Nz"SVN download support is deprecatedr2 r3 r r� zsvn:�@z//r. r\ �:z --username=%s --password=%sz --username=z'Doing subversion checkout from %s to %szsvn checkout%s -q %s %s)�warningsr� � UserWarningr7 r' r) r4 r r5 �
_splituser�
urlunparser� rU �system)r| r8 rV �credsr: �netlocr< rZ �qr� �auth�host�user�pwr9 r! r! r" r> B s& zPackageIndex._download_svnc C sp t j�| �\}}}}}|�dd�d }|�dd�d }d }d|krR|�dd�\}}t j�||||df�} | |fS )N�+r3 r/ r2 r rD r� )r4 r �urlsplitr7 �rsplit�
urlunsplit)r8 �
pop_prefixr: rL r< r> r� �revr! r! r" �_vcs_split_rev_from_urlX s z$PackageIndex._vcs_split_rev_from_urlc C sl |� dd�d }| j|dd�\}}| �d||� t�d||f � |d k rh| �d|� t�d ||f � |S )
Nr2 r3 r T�rV z Doing git clone from %s to %szgit clone --quiet %s %szChecking out %sz git -C %s checkout --quiet %s�r7 rX r� rU rJ �r| r8 rV rW r! r! r" r? j s �zPackageIndex._download_gitc C sl |� dd�d }| j|dd�\}}| �d||� t�d||f � |d k rh| �d|� t�d ||f � |S )
Nr2 r3 r TrY z Doing hg clone from %s to %szhg clone --quiet %s %szUpdating to %szhg --cwd %s up -C -r %s -qrZ r[ r! r! r" r@ z s �zPackageIndex._download_hgc G s t j|f|�� d S ra )r r� r� r! r! r" r� � s zPackageIndex.debugc G s t j|f|�� d S ra )r r� r� r! r! r" r� � s zPackageIndex.infoc G s t j|f|�� d S ra )r r� r� r! r! r" r� � s zPackageIndex.warn)r� r� NT)F)F)F)N)N)FFFN)FF)N)F))r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r� r� r0 r r r r r( r# r� r r� rB rC r> � staticmethodrX r? r@ r� r� r� �
__classcell__r! r! r� r" r sZ �
5
# �
L
)$
# z!&(#(\d+|x[\da-fA-F]+)|[\w.:-]+);?c C s | � d�}t�|�S )Nr )rE r� �unescape)rD �whatr! r! r" �
decode_entity� s
r` c C s
t t| �S )a
Decode HTML entities in the given text.
>>> htmldecode(
... 'https://../package_name-0.1.2.tar.gz'
... '?tokena=A&tokenb=B">package_name-0.1.2.tar.gz')
'https://../package_name-0.1.2.tar.gz?tokena=A&tokenb=B">package_name-0.1.2.tar.gz'
)�
entity_subr` )�textr! r! r" rr � s rr c s � fdd�}|S )Nc s � �fdd�}|S )Nc s2 t �� }t ��� z� | |�W �S t �|� X d S ra )r5 �getdefaulttimeout�setdefaulttimeout)rb rc Z old_timeout)re �timeoutr! r" �_socket_timeout� s
z@socket_timeout.<locals>._socket_timeout.<locals>._socket_timeoutr! )re rf �re rd r" rf � s z'socket_timeout.<locals>._socket_timeoutr! )re rf r! rg r" �socket_timeout� s rh c C s2 t j�| �}|�� }t�|�}|�� }|�dd�S )a9
Encode auth from a URL suitable for an HTTP header.
>>> str(_encode_auth('username%3Apassword'))
'dXNlcm5hbWU6cGFzc3dvcmQ='
Long auth strings should not cause a newline to be inserted.
>>> long_auth = 'username:' + 'password'*10
>>> chr(10) in str(_encode_auth(long_auth))
False
�
r� )r4 r r6 �encode�base64� b64encoder� r= )rN Zauth_sZ
auth_bytesZ
encoded_bytes�encodedr! r! r" � _encode_auth� s
rn c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �
Credentialz:
A username/password pair. Use like a namedtuple.
c C s || _ || _d S ra ��username�password)r| rq rr r! r! r" r� � s zCredential.__init__c c s | j V | jV d S ra rp r r! r! r" �__iter__� s zCredential.__iter__c C s dt | � S )Nz%(username)s:%(password)s)�varsr r! r! r" �__str__� s zCredential.__str__N)r� r� r� r� r� rs ru r! r! r! r" ro � s ro c @ s0 e Zd Zdd� Zedd� �Zdd� Zdd� Zd S )
�
PyPIConfigc C sP t �dddgd�}tj�| |� tj�tj�d�d�}tj� |�rL| �
|� dS )z%
Load from ~/.pypirc
rq rr �
repositoryr� �~z.pypircN) �dict�fromkeys� configparser�RawConfigParserr� rU r< r` �
expanduserr� r� )r| �defaults�rcr! r! r" r� � s
zPyPIConfig.__init__c s& � fdd�� � � D �}tt� j|��S )Nc s g | ]}� � |d ��� r|�qS )rw )r� ro )rY �sectionr r! r" r � s �z2PyPIConfig.creds_by_repository.<locals>.<listcomp>)�sectionsry rm �_get_repo_cred)r| Zsections_with_repositoriesr! r r" �creds_by_repository� s
�z PyPIConfig.creds_by_repositoryc C s6 | � |d��� }|t| � |d��� | � |d��� �fS )Nrw rq rr )r� ro ro )r| r� �repor! r! r" r� � s
�zPyPIConfig._get_repo_credc C s* | j �� D ]\}}|�|�r
| S q
dS )z�
If the URL indicated appears to be a repository defined in this
config, return the credential for that repository.
N)r� �itemsr) )r| r8 rw �credr! r! r" �find_credential� s
zPyPIConfig.find_credentialN)r� r� r� r� �propertyr� r� r� r! r! r! r" rv � s
rv c C s< t j�| �}|\}}}}}}|�d�r2tj�d��|dkrHt|�\} }
nd} | s�t� � | �} | r�t
| �} | j | f} t j
d | �� | r�dt| � } ||
||||f}
t j�|
�}t j�|�}|�d| � n t j�| �}|�dt� ||�}| �r8t j�|j�\}}}}}}||k�r8||
k�r8||||||f}
t j�|
�|_|S )
z4Open a urllib2 request, handling HTTP authenticationrE znonnumeric port: '')r- �httpsN�*Authenticating as %s for %s (from .pypirc)zBasic �
Authorizationz
User-Agent)r� )r4 r r5 r( r- r. r/ rH rv r� rn rq r r� rn rI r� �Request�
add_header�
user_agentr8 )r8 r� �parsedr: rL r< �paramsr> r� rN �addressr� r� r9 r� r� r$ �s2�h2�path2Zparam2Zquery2Zfrag2r! r! r" r, s8
r, c C s | � d�\}}} |r|nd| fS )zNsplituser('user[:passwd]@host[:port]')
--> 'user[:passwd]', 'host[:port]'.rD N)�
rpartition)rO rP �delimr! r! r" rH 4 s rH c C s | S ra r! )r8 r! r! r" �
fix_sf_url? s r� c
C s t j�| �\}}}}}}t j�|�}tj�|�r<t j�| �S |� d�r�tj�
|�r�g }t� |�D ]d} tj� || �}
| dkr�t
|
d��} | �� } W 5 Q R X q�ntj�
|
�r�| d7 } |�dj| d�� q`d}
|
j| d� |�d�} d \}}n
d
\}}} d d i}t�| �}t j�| ||||�S )
z7Read a local path, with special support for directoriesr. z
index.html�rz<a href="{name}">{name}</a>)r* zB<html><head><title>{url}</title></head><body>{files}</body></html>ri )r8 �files)�� �OK)r� zPath not foundz Not foundr� z text/html)r4 r r5 r� rA rU r< �isfiler� r( r� r� r` r� r� r� �format�io�StringIOr� r� )r8 r: r; r< �paramr> r� rV r� r� �filepathr$ �bodyr� �status�messager� Z body_streamr! r! r" r+ C s. �
r+ )N)N)N)r )Yr� �sysrU rX r� r r5 rk r� r� rF r{ r� � http.clientr- � urllib.parser4 �urllib.request� urllib.error� functoolsr r �
pkg_resourcesr r r r r r r
r r r
r r r � distutilsr �distutils.errorsr �fnmatchr Zsetuptools.wheelr Z setuptools.extern.more_itertoolsr r� rC �Irp r� rD r� r7 rO �__all__Z_SOCKET_TIMEOUTZ_tmplr� � version_infor� r# r r@ r rB rW r rg ri ry rz r� r r� ra r` rr rh rn ro r| rv r� r� r, rH r� r+ r! r! r! r" �<module> s� <
� �
�
!
�
#
!
&/