3
Pfml @ s d dl mZ d dlmZ d dlZd dlZd dlZd dlZd dlZ d dl
Z
d dl Z d dl Z d dl
Z
d dlZd dlZd dlZd dlZd dlZd dlmZ d dlmZmZmZ d dlmZmZm Z m Z m Z m Z d dl m!Z! d dl"m#Z# d d l$m%Z% d d
l&m'Z' e%r d d lm(Z) n d d lm)Z) d
ddddddddddddddd d d d d d!d"d#d$gZ*e j+e,Z-dzZ.d{Z/d|Z0d}Z1e0e. e1 e/ Z2e0e1 Z3yd dl4Z4e3e.7 Z3W n e5k
r e-j6d1 Y nX yd dl7Z7e3e/7 Z3W n e5k
r e-j6d2 Y nX d3d4 Z8d5d! Z9d6d Z:e'd7d8d9d~d;d
Z;dd Z=dd@dZ>dAdB Z?dCd Z@dDd ZAdEd ZBdFd ZCdGd ZDejEfdHdIZFdJd ZGdKd ZHddMdZIdNd ZJdOd ZKdPdQ ZLdRdS ZMdTdU ZNdVdW ZOdXdY ZPdZd[ ZQdLedLd:d:fd\d]ZRd^d_ ZSd`da ZTdbd ZUdcdd ZVdded ZWdfd ZXdgd ZYddid ZZdjdk Z[dldm Z\G dndo doe]Z^G dpdq dqe)Z_ej`drds Zadtd ZbG dudv dve]Zcddwd$Zddxdy ZedS ) )absolute_import)dequeN)InstallationError)console_to_str
expanduser stdlib_pkgs)
site_packages user_siterunning_under_virtualenvvirtualenv_no_globalwrite_delete_marker_filedistutils_scheme)
pkg_resources)input)PY2)retry)BytesIO)StringIOrmtree display_path
backup_dirasksplitext format_sizeis_installable_dir is_svn_page
file_contentssplit_leading_dirhas_leading_dirnormalize_pathrenamesget_terminal_sizeget_prog
unzip_file
untar_file unpack_filecall_subprocesscaptured_stdout
ensure_dirARCHIVE_EXTENSIONSSUPPORTED_EXTENSIONSget_installed_version.tar.bz2.tbz.tar.xz.txz.tlz.tar.lz .tar.lzma.zip.whl.tar.gz.tgz.tarzbz2 module is not availablez lzma module is not availablec O s, yt | S tk
r& |||Y nX d S )N)
__import__ ImportError)Zpkg_or_module_stringZ
ExceptionTypeargskwargs r< /usr/lib/python3.6/__init__.pyimport_or_raiseI s r> c C sD yt j| W n0 tk
r> } z|jtjkr. W Y dd}~X nX dS )z os.path.makedirs without EEXIST.N)osmakedirsOSErrorerrnoZEEXIST)pather< r< r= r( P s
c
C sD y$t jjtjd dkr"dtj S W n tttfk
r> Y nX dS )Nr __main__.py-cz %s -m pipZpip)rE rF ) r? rC basenamesysargv
executableAttributeError TypeError
IndexErrorr< r< r< r= r" Y s i i )Zstop_max_delayZ
wait_fixedFc C s t j| |td d S )N)
ignore_errorsonerror)shutilr rmtree_errorhandler)dirrN r< r< r= r c s c C s2 t j|jtj@ r,t j|tj | | dS dS )zOn Windows, the files in .svn are read-only, so when rmtree() tries to
remove them, an exception is thrown. We catch that here, remove the
read-only attribute, and hopefully continue without problems.N)r? statst_modeS_IREADchmodS_IWRITE)funcrC exc_infor< r< r= rQ i s
rQ c C st t jjt jj| } tjd dkrB| jtj d} | jtj d} | j
t j t jj rpd| t
t j d } | S )zTGives the display value for a given path, making it relative to cwd
if possible.r replace.N)r? rC normcaseabspathrH version_infodecodegetfilesystemencodingencodegetdefaultencoding
startswithgetcwdseplen)rC r< r< r= r x s .bakc C s: d}|}x(t jj| | r0|d7 }|t| }q
W | | S )z\Figure out the name of a directory to back up the given dir to
(adding .bak, .bak2, etc) )r? rC existsstr)rR extn extensionr< r< r= r s c C s2 x&t jjddj D ]}||kr|S qW t| |S )NZPIP_EXISTS_ACTION )r? environgetsplitr )messageoptionsactionr< r< r= ask_path_exists s rv c C sZ xTt jjdrtd| t| }|j j }||krNtd|dj|f q|S qW dS )z@Ask the message interactively, with the given possible responsesZ PIP_NO_INPUTz7No input was expected ($PIP_NO_INPUT set); question: %sz[^<]*Revision \d+:z#Powered by (?:]*?>)?Subversion)researchI)Zhtmlr< r< r= r s c C s$ t | d}|j jdS Q R X d S )Nrbzutf-8)openreadr` )filenamefpr< r< r= r s c c s x| j |}|sP |V qW dS )z7Yield pieces of data from a file-like object until EOF.N)r )filesizechunkr< r< r= read_chunks s
r c C sh | j dj d} d| krHd| kr4| jd| jdk s s r c C s8 x2t jD ](}tjj|| jd }tjj|rdS qW dS )z$Is distribution an editable install?z .egg-linkTF)rH rC r? r{ project_namer )r Z path_itemegg_linkr< r< r= dist_is_editableH s
r c sl | r
t ndd |r dd ndd |r6dd ndd |rHtnd d
fd d tjD S )
a
Return a list of installed Distribution objects.
If ``local_only`` is True (default), only return installations
local to the current virtualenv, if in a virtualenv.
``skip`` argument is an iterable of lower-case project names to
ignore; defaults to stdlib_pkgs
If ``editables`` is False, don't report editables.
If ``editables_only`` is True , only report editables.
If ``user_only`` is True , only report installations in the user
site directory.
c S s dS )NTr< )dr< r< r=
local_testj s z/get_installed_distributions..local_testc S s dS )NTr< )r r< r< r=
editable_testn s z2get_installed_distributions..editable_testc S s
t | S )N)r )r r< r< r= r q s c S s t | S )N)r )r r< r< r= editables_only_testu s z8get_installed_distributions..editables_only_testc S s dS )NTr< )r r< r< r= r x s c S s dS )NTr< )r r< r< r= user_test~ s z.get_installed_distributions..user_testc s: g | ]2}|r|j kr |r|r|r|qS r< )key).0r )r r r skipr r< r=
s
z/get_installed_distributions..)r r r working_set)Z
local_onlyr Zinclude_editablesZeditables_onlyZ user_onlyr< )r r r r r r= get_installed_distributionsQ s
r c C s g }t r6t r |jt qN|jt trN|jt ntrD|jt |jt x0|D ](}tjj|| jd }tjj |rT|S qTW dS )a
Return the path for the .egg-link file if it exists, otherwise, None.
There's 3 scenarios:
1) not in a virtualenv
try to find in site.USER_SITE, then site_packages
2) in a no-global virtualenv
try to find in site_packages
3) in a yes-global virtualenv
try to find in site_packages, then site.USER_SITE
(don't look in global location)
For #1 and #3, there could be odd cases, where there's an egg-link in 2
locations.
This method will just return the first one found.
z .egg-linkN)
r
r appendr r r? rC r{ r r )r ZsitesZsiteZegglinkr< r< r=
egg_link_path s
r c C s t | }|r|S | jS )z
Get the site-packages location of this distribution. Generally
this is dist.location, except in the case of develop-installed
packages, where dist.location is the source code location, and we
want to know where the egg-link file is.
)r location)r r r< r< r= r s r c
C s dd } | dp | dp | d}|sZy(t jt j t j}| |}t j| W n Y nX |szt jjddt jjdd f}t|d t|d fS )
zlReturns a tuple (x, y) representing the width(x) and the height(x)
in characters of the terminal window.c S sP y4dd l }dd l}dd l}|jd|j| |jd}W n
d S |dkrLd S |S )Nr ZhhZ1234)r r )fcntltermiosstructunpackZioctlZ
TIOCGWINSZ)fdr r r crr< r< r= ioctl_GWINSZ s z'get_terminal_size..ioctl_GWINSZr ri rZ ZLINES ZCOLUMNSP )r? r ctermidO_RDONLYcloserp rq int)r r r r< r< r= r! s c C s t jd} t j| | S )zBGet the current umask which involves having to set it temporarily.r )r? umask)maskr< r< r=
current_umask s
r c
C s t | t| d}ztj|dd}t|j o0|}x|j D ]}|j}|j|}|} |rdt |d } t
j j || } t
j j
| }
| jds| jdrt | qd}n8| j jtrRd}n$| j jdrfd}ntjd| d }tj| |}zt d
d |j
D }x|j
D ]}|j }|d krq|rt |d
}t
jj||}ytj|j|d| W n tjk
r Y nX |j r"t | q|j rxy|j|| W n8 tk
rt } ztjd| |j | wW Y dd}~X nX qy|j|} W n< ttfk
r } ztjd| |j | wW Y dd}~X nX t t
jj| t|d}
tj | |
W dQ R X | j |j || |j d@ rt
j |dt! dB qW W d|j X dS )a
Untar the file (with path `filename`) to the destination `location`.
All files are written based on system defaults and umask (i.e. permissions
are not preserved), except that regular file members with any execute
permissions (user, group, or world) have "chmod +x" applied after being
written. Note that for windows, any execute changes using os.chmod are
no-ops per the python docs.
z.gzz.tgzzr:gzzr:bz2zr:xzz.tarrz-Cannot determine compression type for file %szr:*c S s g | ]}|j d kr|j qS )pax_global_header)r )r memberr< r< r= r ( s z untar_file..r ri )r z/In the tar file %s the member %s is invalid: %sNr r i )"r( ry r BZ2_EXTENSIONS
XZ_EXTENSIONSloggerwarningtarfiler r Z
getmembersr r r? rC r{ Z data_filterr[ ZLinkOutsideDestinationErrorr~ ZissymZ_extract_memberrw Z extractfileKeyErrorrK r rP Z copyfileobjr utimer rV r ) r r r Ztarr r r rC excr Zdestfpr< r< r= r$
sh
c C s t jj| } |dks,| j jts,tj| rDt| || jd d n|dkslt j
| sl| j jt t t
rxt| | nX|r|jdrtt| rddlm} |d|j j| n tjd | || td
| d S ) Nzapplication/zipz.whl)r zapplication/x-gzipz text/htmlr )
Subversionzsvn+zZCannot unpack file %s (downloaded from %s, content-type: %s); cannot detect archive formatz%Cannot determine archive format of %s)r? rC r ry r ZIP_EXTENSIONSr Z
is_zipfiler# r Z
is_tarfileTAR_EXTENSIONSr r r$ rd r r Zpip.vcs.subversionr Zurlr r criticalr )r r Z content_typelinkr r< r< r= r% ` s,
raisec C s, |r
d }nt j}|d krng }xF| D ]>} d| ksFd| ksFd| ksFd| krVd| jdd } |j| q"W dj|}tjd| tjj }
|r|
j
| y t j | t j d |||
d} W n2 t
k
r } ztjd | | W Y d d } ~ X nX |d k rNg }
x\t| jj }|sP |j }|
j|d tj tjkr:tj| q|d k r|j qW | j |d k r~| jrt|jd
n
|jd | jr|d krtj tjkr| rtjd
| tjdj|
d td|| j|f n:|dkrtj d|| j| n |dkrnt dt | |s(dj|
S d S )N
"'z"%s"z\"zRunning command %s)stderrstdinstdoutcwdenvz#Error %s while executing command %serrordoner z Complete output from command %s:ro z)
----------------------------------------z,Command "%s" failed with error code %s in %swarnz$Command "%s" had error code %s in %signorez Invalid value: on_returncode=%s)
subprocessPIPEr[ r r{ r debugr? rp copyupdatePopenZSTDOUTrw r r r readlinerstripZgetEffectiveLevel std_loggingDEBUGZspinwait
returncodeZfinishr r r
ValueErrorrepr)cmdZ show_stdoutr Z
on_returncodeZ command_descZ
extra_environZspinnerr Z cmd_partspartr procr Z
all_outputliner< r< r= r& sz
c C sx t | d}|j }W dQ R X dtjddg}x4|D ],}y|j|}W n tk
r\ w4Y nX P q4W t|tkstt|S )aR Return the contents of *filename*.
Try to decode the file contents with utf-8, the preferred system encoding
(e.g., cp1252 on some Windows machines), and latin1, in that order.
Decoding a byte string with latin1 will never raise an error. In the worst
case, the returned string will contain some garbage characters.
r Nzutf-8Flatin1) r r localegetpreferredencodingr` UnicodeDecodeErrortyper} AssertionError)r r r Z encodingsencr< r< r= read_text_file s
r c C s t j| t| d S )N)r? r@ r )Z build_dirr< r< r= _make_build_dir s
r c @ s( e Zd ZdZdd Zdd Zdd ZdS ) FakeFilezQWrap a list of lines in an object with readline() to make
ConfigParser happy.c C s dd |D | _ d S )Nc s s | ]
}|V qd S )Nr< )r lr< r< r= s z$FakeFile.__init__..)_gen)selflinesr< r< r= __init__ s zFakeFile.__init__c C sD y*y
t | jS tk
r& | jj S X W n tk
r> dS X d S )Nro )nextr NameError
StopIteration)r r< r< r= r s
zFakeFile.readlinec C s | j S )N)r )r r< r< r= __iter__ s zFakeFile.__iter__N)__name__
__module__ __qualname____doc__r r r r< r< r< r= r s r c @ s$ e Zd Zedd Zedd ZdS )
StreamWrapperc C s || _ | S )N) orig_stream)clsr! r< r< r= from_stream s zStreamWrapper.from_streamc C s | j jS )N)r! encoding)r r< r< r= r$ s zStreamWrapper.encodingN)r r r classmethodr# propertyr$ r< r< r< r= r s r c
c s@ t t| }tt| tj| zt t| V W dtt| | X dS )zReturn a context manager used by captured_stdout/stdin/stderr
that temporarily replaces the sys stream *stream_name* with a StringIO.
Taken from Lib/support/__init__.py in the CPython repo.
N)getattrrH setattrr r# )Z stream_nameZ orig_stdoutr< r< r= captured_output s
r) c C s t dS )zCapture the output of sys.stdout:
with captured_stdout() as stdout:
print('hello')
self.assertEqual(stdout.getvalue(), 'hello
')
Taken from Lib/support/__init__.py in the CPython repo.
r )r) r< r< r< r= r' / s c @ s e Zd ZdZdd Zdd ZdS )cached_propertyzA property that is only computed once per instance and then replaces
itself with an ordinary attribute. Deleting the attribute resets the
property.
Source: https://github.com/bottlepy/bottle/blob/0.11.5/bottle.py#L175
c C s t |d| _|| _d S )Nr )r' r rX )r rX r< r< r= r C s zcached_property.__init__c C s( |d kr | S | j | }|j| j j< |S )N)rX __dict__r )r objr" valuer< r< r= __get__G s zcached_property.__get__N)r r r r r r. r< r< r< r= r* ; s r* c C s@ t jj| }|dkr t j }n
t j|}|j|}|r<|jS dS )zCGet the installed version of dist_name avoiding pkg_resources cacheN)r Z RequirementparseZ
WorkingSetr version)Z dist_nameZ lookup_dirsZreqr r r< r< r= r+ O s
c C s t | dd dS )z Consume an iterable at C speed.r )maxlenN)r )iteratorr< r< r= consumec s r3 )r, r- )r. r/ r0 r1 r2 )r3 r4 )r5 r6 r7 )F)rh )T)T)TNr NNN)N)fZ
__future__r collectionsr
contextlibrB ior Zloggingr r r? r rP rS r rH r r Zpip.exceptionsr Z
pip.compatr r r Z
pip.locationsr r r
r r r
Z pip._vendorr Zpip._vendor.six.movesr Zpip._vendor.sixr Zpip._vendor.retryingr r r __all__Z getLoggerr r r r r r r) r* bz2r9 r Zlzmar> r( r" r rQ r r rv r r r r r DEFAULT_BUFFER_SIZEr r r r r r r r r r r r r r r r! r r# r$ r% r& r r objectr r contextmanagerr) r' r* r+ r3 r< r< r< r= s
5%
+S!
_