File: //proc/self/root/usr/lib64/python2.7/site-packages/mercurial/streamclone.pyo
�
1�3\c @@ s| d d l m Z d d l Z d d l Z d d l Z d d l m Z d d l m Z m Z m
Z
m Z m Z m
Z
m Z m Z m Z e d � Z d � Z d � Z d d � Z d
� Z d � Z d d
� Z d � Z d � Z d � Z d e f d � � YZ d Z d Z d Z! d Z" d � Z# d � Z$ e j% d � � Z& d � Z' d � Z( d � Z) e j% d � � Z* d � Z+ d � Z, d S( i ( t absolute_importNi ( t _( t branchmapt cacheutilt errort
narrowspect phasest pycompatt
repositoryt storet utilc C@ s� | j } | j } t } | j rH d | j j d g � k rH t } qH n | r_ | r_ t d f S| rv | rv t d f St | � r� t d f S| j r� t d f S| j
} | d k r� | j d � } n | s� t d f St � } | j d � r� | j
d � n� | j d � } | s6| j j j t d � � t d f St | j d � � } | | j } | r�| j j j t d � d j t | � � � | j j j t d
� � t d f S| } t | f S( s� Whether it is possible to perform a streaming clone as part of pull.
``bundle2`` will cause the function to consider stream clone through
bundle2 and only through bundle2.
Returns a tuple of (supported, requirements). ``supported`` is True if
streaming clone is supported and False otherwise. ``requirements`` is
a set of repo requirements from the remote, or ``None`` if stream clone
isn't supported.
t v2t streams stream-preferredt revlogv1t
streamreqss= warning: stream clone requested but server has them disabled
t ,sG warning: stream clone requested but client is missing requirements: %s
s , sQ (see https://www.mercurial-scm.org/wiki/MissingRequirement for more information)
N( t repot remotet Falset
canusebundle2t remotebundle2capst gett Truet Nonet lent headst streamclonerequestedt capablet sett addt uit warnR t splitt supportedformatst joint sorted( t pullopt bundle2R R t bundle2supportedt streamrequestedt requirementsR t missingreqs( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt canperformstreamclone sL
c
C@ so d d l m } t | � \ } } | s, d S| j } | j } d } | j d � r� | j � � } | j d i � j � } Wd QXn | j
j t d � � | j � � } | j d i � j � } Wd QX| j
� } y t | � }
Wn) t k
r
t j t d � | � � n X|
d k r2t j t d � � � nH |
d k rVt j t d
� � � n$ |
d k rzt j t d � � � n | j
� } y% t t | j d
d � � \ } } Wn/ t t f k
r�t j t d � | � � n X| j � �� t | | | | � | | j | j B| _ | j | j
| j | j � | j _ | j � | r[t j | | � n | j! � Wd QXd S( s� Possibly perform a legacy stream clone operation.
Legacy stream clones are performed as part of pull but before all other
operations.
A legacy stream clone will not be performed if a bundle2 stream clone is
supported.
i ( t localrepoNR s streaming all changes
t
stream_outs' unexpected response from remote server:s operation forbidden by serveri s$ locking the remote repository failedi s% the server sent an unknown error codet (" t R+ R* R R R R t commandexecutort callcommandt resultR t statusR t readlinet intt
ValueErrorR t
ResponseErrort Abortt mapR t TypeErrort lockt consumev1R( R! t resolvestorevfsoptionst featurest svfst optionst _writerequirementsR t replacecachet
invalidate(
R$ R+ t supportedR( R R t
rbranchmapt et fpt lt respt filecountt bytecount( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt maybeperformlegacystreamclonem sR !
%
c C@ sa t j | j k r t S| j j d d d t �s5 t St j | � } | r] | j j d d � St S( s5 Whether streaming clones are allowed from the server.t servert uncompressedt untrustedt uncompressedallowsecret( R t REPO_FEATURE_STREAM_CLONER= R R t
configboolR R t hassecret( R t secret( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt allowservergeneration� s c C@ s | j j | � S( N( R t walk( R t matcher( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt _walkstreamfiles� s c @ s� g � d } � j � �[ � j j d � xC t � � D]5 \ } } } | r6 � j | | f � | | 7} q6 q6 WWd QX� j j d t � � | f � � j � � j j � � � � � f d � } t � � | | � f S( s� Emit content for version 1 of a streaming clone.
This returns a 3-tuple of (file count, byte size, data iterator).
The data iterator consists of N entries for each file being transferred.
Each file entry starts as a line with the file name and integer size
delimited by a null byte.
The raw file data follows. Following the raw file data is the next file
entry, or EOF.
When used on the wire protocol, an additional line indicating protocol
success will be prepended to the stream. This function is not responsible
for adding it.
This function will obtain a repository lock to ensure a consistent view of
the store is captured. It therefore may raise LockError.
i s scanning
Ns %d files, %d bytes to transfer
c 3@ s� x� � D]� \ } } � r6 � j j d | | f � n d t j | � | f V� | d d t ��I } | d k r� | j | � Vn% x" t j | d | �D] } | Vq� WWd QXq Wd S( Ns sending %s (%d bytes)
s %s %d
t rbt auditpathi t limit( R t debugR t encodedirR t readR
t
filechunkiter( t namet sizeRF t chunk( t debugflagt entriesR R> ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt emitrevlogdata� s ( R: R R[ RW t appendR R> Rb ( R t total_bytesR_ t enameR` Rd ( ( Rb Rc R R> s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt
generatev1� s
c c@ sy t | � s d Vd Sy t | � \ } } } Wn t j k
rJ d Vd SXd Vd | | f Vx | D] } | Vqf Wd S( s� Emit content for version 1 of streaming clone suitable for the wire.
This is the data output from ``generatev1()`` with 2 header lines. The
first line indicates overall success. The 2nd contains the file count and
byte size of payload.
The success line contains "0" for success, "1" for stream generation not
allowed, and "2" for error locking the repository (possibly indicating
a permissions error for the server process).
s 1
Ns 2
s 0
s %d %d
( RT Rh R t LockError( R RI RJ t itRa ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt generatev1wireproto� s
t UNc @ sb � d k r t d � � n � j � j @} d j t | � � � � � � f d � } | | � f S( s@ Emit content for version 1 of a stream clone bundle.
The first 4 bytes of the output ("HGS1") denote this as stream clone
bundle version 1.
The next 2 bytes indicate the compression type. Only "UN" is currently
supported.
The next 16 bytes are two 64-bit big endian unsigned integers indicating
file count and byte count, respectively.
The next 2 bytes is a 16-bit big endian unsigned short declaring the length
of the requirements string, including a trailing . The following N bytes
are the requirements string, which is ASCII containing a comma-delimited
list of repo requirements that are needed to support the data.
The remaining content is the output of ``generatev1()`` (which may be
compressed in the future).
Returns a tuple of (requirements, data generator).
Rl s. we do not support the compression argument yetR c 3@ s� d V� Vt � � \ } } } � j j t d � | | f � t j d | | � Vt j d t � � d � V� d V� j j t d � d | d t d
� �} | j d � x) | D]! } | j d t | � � | Vq� W| j
� d S(
Nt HGS1s writing %d bytes for %d files
s >QQs >Hi s t bundlet totalt unitt bytesi t step( Rh R R2 R t structt packR t makeprogresst updatet incrementt complete( RI RJ Rj t progressRa ( t compressionR t requires( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt gen4 s
( R5 R( R! R" R# ( R Rz R( R| ( ( Rz R R{ s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt generatebundlev1 s c C@ sX | j � �F| j j t d � | t j | � f � | j j t d � d | d t d � �} | j d � t j � } | j d � �\| j
j | j d | ��*x"t j
| � D]} | j � } y( | j d d � \ } } t | � } Wn/ t t f k
r t j t d
� | � � n X| j j rS| j j d | t j | � f � n t j | � }
| j
|
d d
t ��J } x@ t j | d | �D]) } | j d t | � � | j | � q�WWd QXq� WWd QX| j d t � Wd QXt j � | }
|
d k r d }
n | j � | j j t d � t j | � |
t j | |
� f � Wd QXd S( s
Apply the contents from version 1 of a streaming clone file handle.
This takes the output from "stream_out" and applies it to the specified
repository.
Like "stream_out," the status line added by the wire protocol is not
handled by this function.
s! %d files to transfer, %s of data
t cloneRo Rp Rq i t
expectedcounts i s' unexpected response from remote server:s adding %s (%s)
t wt backgroundcloseRZ Rr Nt clearfilecacheg����MbP?s( transferred %s in %.1f seconds (%s/sec)
( R: R R2 R R
RJ Ru Rv t timert transactionR> t backgroundclosingR t xrangeR3 R R4 R5 R9 R R6 Rb R[ R t decodedirR R^ Rw R t writeRB Rx ( R RF RI RJ Ry t startt iRG R_ R` t patht ofpRa t elapsed( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyR; O sB
!
c C@ s� | j d � } | d k r7 t j t d � | � � n t j d | j d � � \ } } t j d | j d � � d } | j | � } | j d � s� t j t d � � � n t | j d � j d
� � } | | | f S( Ni Rl s< only uncompressed stream clone bundles are supported; got %ss >QQi s >Hi s s@ malformed stream clone bundle: requirements not properly encodedR (
R] R R7 R Rs t unpackt endswithR t rstripR ( RF Rz RI RJ t requireslenR{ R( ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt readbundle1header� s
! c C@ s� t | � r$ t j t d � � � n t | � \ } } } | | j } | rw t j t d � d j t | � � � � n t | | | | � d S( s� Apply the content from a stream clone bundle version 1.
We assume the 4 byte header has been read and validated and the file handle
is at the 2 byte compression identifier.
s2 cannot apply stream clone bundle on non-empty repos4 unable to apply stream clone: unsupported format: %ss , N( R R R7 R R� R! R" R# R; ( R RF RI RJ R( R) ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt
applybundlev1� s
t streamcloneapplierc B@ s e Z d Z d � Z d � Z RS( s� Class to manage applying streaming clone bundles.
We need to wrap ``applybundlev1()`` in a dedicated type to enable bundle
readers to perform bundle type-specific functionality.
c C@ s
| | _ d S( N( t _fh( t selft fh( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt __init__� s c C@ s t | | j � S( N( R� R� ( R� R ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt apply� s ( t __name__t
__module__t __doc__R� R� ( ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyR� � s t st cc C@ s& g } | j � s" | j d � n | S( s! list snapshot file from the storet
phaseroots( t
publishingRe ( R t fnames( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt _walkstreamfullstorefiles� s c C@ sE | \ } } } } | t k r" | S| | | | | | j | � � f S( s actually copy the snapshot files( t _filefullR" ( t entryt copyt vfsmapt srcR_ t ftypet data( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt _filterfull� s c #@ sD g � z � f d � } | VWd x � D] } t j | � q( WXd S( s( return a function to temporary copy filec @ sF t j � \ } } t j | � � j | � t j | | d t �| S( Nt hardlink( R t mkstempt ost closeRe R
t copyfilesR ( R� t fdt dst( t files( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyR� � s
N( R
t tryunlink( R� t tmp( ( R� s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt maketempcopies� s
c C@ s i | j t 6| j t 6} | S( s$ make a (src -> vfs) map for the repo( R> t _srcstoret cachevfst _srccache( R R� ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt _makemap� s
c c@ s� t | � } | j j t d � d | d t d � �} | j d � t � �c} | �Tg | D] } t | | | � ^ q] } d Vd } x | D]\ } } }
} | | } | Vt j t
| � � V|
t k r� | | � }
| } n0 |
t k rt
| d � }
t j |
� j } n z� t j | � V| V| d k rJ|
j | � f } n t j |
d | �} x0 | D]( } | t
| � 7} | j | � | VqfWWd |
j � Xq� WWd QXWd QXd S(
s actually emit the stream bundleRn Ro Rp Rq i RX i RZ N( R� R Ru R Rv R� R� R R
t
uvarintencodeR t _fileappendR� t opent fstatt st_sizeR] R^ R� ( R Rc t
totalfilesizeR� Ry R� RE t seenR� R_ R� R� t vfsRF R` t chunksRa ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt _emit2� s<
%
c
C@ s | s | r$ t j t d � � � n | j � ��g } d } d } | sO | rj t j | j | | � } n | j j d � xL t
| | � D]; \ } } } | r� | j t | t
| f � | | 7} q� q� Wx[ t | � D]M } | j j | � r� | | j j | � j 7} | j t | t d f � q� q� W| rt| j j d � rt| | j j d � j 7} | j t d t d f � n x^ t j | � D]M } | j j | � r�| | j j | � j 7} | j t | t d f � q�q�Wt | | | � }
t |
� } Wd QXt | � | |
f S( s� Emit content for version 2 of a streaming clone.
the data stream consists the following entries:
1) A char representing the file destination (eg: store or cache)
2) A varint containing the length of the filename
3) A varint containing the length of file data
4) N bytes containing the filename (the internal, store-agnostic form)
5) N bytes containing the file data
Returns a 3-tuple of (file count, file size, data iterator).
s, server does not support narrow stream clonesi s scanning
t obsstoreN( R R7 R R: R R t matcht rootR R[ RW Re R� R� R� R> t existst lstatR� R� R t cachetocopyR� R� R� t nextR ( R t includest excludest includeobsmarkersRc R� RV R_ Rg R` R� t first( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt
generatev2 s8
c g@ sK | d } | d } | �+ | r< t | � �
d VWd QXn d VWd QXd S( Ni i ( t nested( t ctxst thist rest( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyR� H s
c @ sE � j � �3� j j t d � | t j | � f � t j � } � j j t d � d | d t d � �} | j d � t � � } � j
d � �7� f d � | j � D� } t | � �� x� t
| � D]� } t j | d � } | | }
t j | � } t j | � } t j | | � }
� j j rR� j j d | |
t j | � f � n |
|
d
� �J } x@ t j | d | �D]) } | j d t | � � | j | � qzWWd
QXq� WWd
QX� j d t � Wd
QXt j � | } | d k r�d } n � j j t d � t j | j � | t j | j | � f � | j � Wd
QXd
S( s� Apply the contents from a version 2 streaming clone.
Data is read from an object that only needs to provide a ``read(size)``
method.
s! %d files to transfer, %s of data
R~ Ro Rp Rq i c 3@ s! | ] } | j � j � Vq d S( N( R� R ( t .0R� ( R ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pys <genexpr>e s i s adding [%s] %s (%s)
R� RZ Rr NR� g����MbP?s( transferred %s in %.1f seconds (%s/sec)
( R: R R2 R R
RJ R� Ru Rv R� R� t valuesR� t ranget readexactlyt uvarintdecodestreamRb R[ R^ Rw R R� RB R t posRx ( R RF RI t filesizeR� Ry R� R� R� R� R� t namelent datalenR_ R� Ra R� ( ( R s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt consumev2S sB
! c C@ s� d d l m } g | D] } | | j k r | ^ q } | ri t j t d � d j t | � � � � n t | | | | � t | � | j
| j B| _
| j | j
| j
| j � | j _ | j � d S( Ni ( R+ s4 unable to apply stream clone: unsupported format: %ss , ( R. R+ RC R R7 R R" R# R� R R( R! R< R R= R> R? R@ ( R RF RI R� R( R+ t rR) ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt
applybundlev2� s ( (- t
__future__R t
contextlibR� Rs t i18nR R. R R R R R R R R R
R R* RK RT R RW Rh Rk R} R; R� R� t objectR� R� R� R� R� R� R� t contextmanagerR� R� R� R� R� R� R� ( ( ( s; /usr/lib64/python2.7/site-packages/mercurial/streamclone.pyt <module> s: @ R H 4 7 @
$ 1 2