| Current File : //opt/alt/python37/lib64/python3.7/site-packages/aiohttp/__pycache__/streams.cpython-37.pyc |
B
�k�ahQ � @ s$ U d dl Z d dlZd dlZd dlmZmZmZmZmZm Z m
Z
m Z ddl m
Z
ddlmZmZmZ ddlmZ ddlmZ dZe d �ZG d
d � d e�ZG d d
� d
ee �ZG dd� d�ZG dd� d�Z G dd� de �Z G dd� de �Z e � Z ee e d< G dd� dee �Z!G dd� de!e �Z"dS )� N)� Awaitable�Callable�Deque�Generic�List�Optional�Tuple�TypeVar� )� BaseProtocol)�BaseTimerContext�
set_exception�
set_result)�internal_logger)�Final)�
EMPTY_PAYLOAD� EofStream� StreamReader� DataQueue�FlowControlDataQueue�_Tc @ s e Zd ZdZdS )r zeof stream indication.N)�__name__�
__module__� __qualname__�__doc__� r r �B/opt/alt/python37/lib64/python3.7/site-packages/aiohttp/streams.pyr s r c @ sD e Zd Zeg ee f dd�dd�Zdd�dd�Zed�d d
�ZdS ) �AsyncStreamIteratorN)� read_func�returnc C s
|| _ d S )N)r )�selfr r r r �__init__ s z AsyncStreamIterator.__init__zAsyncStreamIterator[_T])r c C s | S )Nr )r r r r � __aiter__ s z AsyncStreamIterator.__aiter__c � s< y| � � I d H }W n tk
r* t�Y nX |dkr8t�|S )N� )r r �StopAsyncIteration)r �rvr r r � __anext__! s
z AsyncStreamIterator.__anext__) r r r r r r r! r" r& r r r r r s r c @ s@ e Zd Zddd�dd�Zd d�dd�Zeeef d�d d
�ZdS ) � ChunkTupleAsyncStreamIteratorr N)�streamr c C s
|| _ d S )N)�_stream)r r( r r r r! , s z&ChunkTupleAsyncStreamIterator.__init__)r c C s | S )Nr )r r r r r" / s z'ChunkTupleAsyncStreamIterator.__aiter__c � s | j �� I d H }|dkr t�|S )N)r# F)r) � readchunkr$ )r r% r r r r& 2 s z'ChunkTupleAsyncStreamIterator.__anext__) r r r r! r" r �bytes�boolr& r r r r r' + s r' c @ sR e Zd Zee d�dd�Zeee d�dd�Zee d�dd�Ze d�d d
�Z
d S ) �AsyncStreamReaderMixin)r c C s
t | j�S )N)r �readline)r r r r r" : s z AsyncStreamReaderMixin.__aiter__)�nr c s t � �fdd��S )zzReturns an asynchronous iterator that yields chunks of size n.
Python-3.5 available for Python 3.5+ only
c s
�� � �S )N)�readr )r/ r r r �<lambda>C r# z5AsyncStreamReaderMixin.iter_chunked.<locals>.<lambda>)r )r r/ r )r/ r r � iter_chunked= s z#AsyncStreamReaderMixin.iter_chunkedc C s
t | j�S )zoYield all available data as soon as it is received.
Python-3.5 available for Python 3.5+ only
)r �readany)r r r r �iter_anyF s z AsyncStreamReaderMixin.iter_anyc C s t | �S )z�Yield chunks of data as they are received by the server.
The yielded objects are tuples
of (bytes, bool) as returned by the StreamReader.readchunk method.
Python-3.5 available for Python 3.5+ only
)r' )r r r r � iter_chunksM s z"AsyncStreamReaderMixin.iter_chunksN) r r r r r+ r" �intr2 r4 r' r5 r r r r r- 9 s r- c @ s� e Zd ZdZdZddd�eeee ee j
dd�dd�Z e d�d d
�Z
eeef d�d d �Zee d�d
d�Zedd�dd�Zeg df dd�dd�Zdd�dd�Zed�dd�Zed�dd�Zdd�dd �Zedd �d d �Zd@eedd �d!d"�Z dd�d#d$�Z dd�d%d&�Z e dd'�d(d)�Z ed�d*d+�Z dAeed-�d.d/�Z!dBeed1�d2d3�Z"ed�d4d5�Z#eeef d�d6d7�Z$eed1�d8d9�Z%dCeed1�d:d;�Z&eed1�d<d=�Z'eed1�d>d?�Z(dS )Dr a* An enhancement of asyncio.StreamReader.
Supports asynchronous iteration by line, chunk or as available::
async for line in reader:
...
async for chunk in reader.iter_chunked(1024):
...
async for slice in reader.iter_any():
...
r N)�timer�loop)�protocol�limitr7 r8 r c C sv || _ || _|d | _|d kr&t�� }|| _d| _d| _d | _t �
� | _ d| _ d| _
d | _d | _d | _|| _g | _d S )N� r F)� _protocol�
_low_water� _high_water�asyncioZget_event_loop�_loop�_size�_cursor�_http_chunk_splits� collections�deque�_buffer�_buffer_offset�_eof�_waiter� _eof_waiter�
_exception�_timer�_eof_callbacks)r r9 r: r7 r8 r r r r! h s"
zStreamReader.__init__)r c C s� | j jg}| jr |�d| j � | jr0|�d� | jdkrP|�d| j| jf � | jrf|�d| j � | jr||�d| j � dd� |� S ) Nz%d bytes�eofi zlow=%d high=%dzw=%rze=%rz<%s>� )
� __class__r rA �appendrH r= r> rI rK �join)r �infor r r �__repr__� s
zStreamReader.__repr__c C s | j | jfS )N)r= r> )r r r r �get_read_buffer_limits� s z#StreamReader.get_read_buffer_limitsc C s | j S )N)rK )r r r r � exception� s zStreamReader.exception)�excr c C sP || _ | j�� | j}|d k r.d | _t||� | j}|d k rLd | _t||� d S )N)rK rM �clearrI r
rJ )r rW �waiterr r r r
� s
zStreamReader.set_exception)�callbackr c C sB | j r2y
|� W q> tk
r. t�d� Y q>X n | j�|� d S )NzException in eof callback)rH � Exceptionr rV rM rQ )r rZ r r r �on_eof� s
zStreamReader.on_eofc C s� d| _ | j}|d k r$d | _t|d � | j}|d k rBd | _t|d � x8| jD ].}y
|� W qJ tk
rv t�d� Y qJX qJW | j�� d S )NTzException in eof callback) rH rI r rJ rM r[ r rV rX )r rY �cbr r r �feed_eof� s
zStreamReader.feed_eofc C s | j S )z&Return True if 'feed_eof' was called.)rH )r r r r �is_eof� s zStreamReader.is_eofc C s | j o | j S )z=Return True if the buffer is empty and 'feed_eof' was called.)rH rF )r r r r �at_eof� s zStreamReader.at_eofc � sB | j r
d S | jd kst�| j�� | _z| jI d H W d d | _X d S )N)rH rJ �AssertionErrorr@ �
create_future)r r r r �wait_eof� s zStreamReader.wait_eof)�datar c C sx t jdtdd� |sdS | jr>| jd | jd� | jd< d| _| jt|�7 _| jt|�8 _| j�|� d| _ dS )zDrollback reading some data from stream, inserting it to buffer head.zJunread_data() is deprecated and will be removed in future releases (#3260)r; )�
stacklevelNr )
�warnings�warn�DeprecationWarningrG rF rA �lenrB �
appendleft� _eof_counter)r rd r r r � unread_data� s zStreamReader.unread_data)rd �sizer c C s� | j rtd��|sd S | jt|�7 _| j�|� | jt|�7 _| j}|d k rdd | _t|d � | j| j kr�| j
j s�| j
� � d S )Nzfeed_data after feed_eof)
rH ra rA ri rF rQ � total_bytesrI r r> r< �_reading_paused�
pause_reading)r rd rm rY r r r � feed_data� s
zStreamReader.feed_datac C s" | j d kr | jrtd��g | _ d S )Nz?Called begin_http_chunk_receiving whensome data was already fed)rC rn � RuntimeError)r r r r �begin_http_chunk_receiving� s
z'StreamReader.begin_http_chunk_receivingc C sd | j d krtd��| j r"| j d nd}| j|kr4d S | j �| j� | j}|d k r`d | _t|d � d S )NzFCalled end_chunk_receiving without calling begin_chunk_receiving first���r )rC rr rn rQ rI r )r �posrY r r r �end_http_chunk_receiving s
z%StreamReader.end_http_chunk_receiving)� func_namer c � sf | j d k rtd| ��| j�� }| _ z2| jrL| j� |I d H W d Q R X n
|I d H W d d | _ X d S )NzH%s() called while another coroutine is already waiting for incoming data)rI rr r@ rb rL )r rw rY r r r �_wait! s
zStreamReader._waitc � s | � � I d H S )N)� readuntil)r r r r r. 6 s zStreamReader.readline�
)� separatorr c � s� t |�}|dkrtd��| jd k r(| j�d}d}d}x�|r�xn| jr�|r�| j}| jd �||�d }| �|rr|| nd�}||7 }|t |�7 }|r�d}|| jkr<td��q<W | jr�P |r6| � d �I d H q6W |S )
Nr z,Separator should be at least one-byte stringr# Tr
rt Fz
Chunk too bigry )
ri �
ValueErrorrK rF rG �find�_read_nowait_chunkr> rH rx ) r r{ Zseplen�chunk�
chunk_sizeZ
not_enough�offsetZicharrd r r r ry 9 s0
zStreamReader.readuntilrt )r/ r c � s� | j d k r| j �| jrF| jsFt| dd�d | _| jdkrFtjddd� |sNdS |dk r�g }x"| �� I d H }|spP |�|� q\W d� |�S x | js�| js�| �
d �I d H q�W | � |�S )
Nrk r r
� zEMultiple access to StreamReader in eof state, might be infinite loop.T)�
stack_infor# r0 ) rK rH rF �getattrrk r �warningr3 rQ rR rx � _read_nowait)r r/ �blocks�blockr r r r0 [ s*
zStreamReader.readc � s< | j d k r| j �x | js0| js0| �d�I d H qW | �d�S )Nr3 rt )rK rF rH rx r� )r r r r r3 � s
zStreamReader.readanyc � s� x�| j dk r| j �xL| jr^| j�d�}|| jkr4dS || jkrR| �|| j �dfS t�d� qW | jrt| �d�dfS | j r~dS | �
d �I dH qW dS )
a Returns a tuple of (data, end_of_http_chunk).
When chunked transfer
encoding is used, end_of_http_chunk is a boolean indicating if the end
of the data corresponds to the end of a HTTP chunk , otherwise it is
always False.
Nr )r# TTzESkipping HTTP chunk end due to data consumption beyond chunk boundaryrt F)r# Fr* ) rK rC �poprB r� r r� rF r~ rH rx )r ru r r r r* � s
zStreamReader.readchunkc � st | j d k r| j �g }xT|dkrh| �|�I d H }|sPd�|�}t�|t|�| ��|�|� |t|�8 }qW d�|�S )Nr r# )rK r0 rR r? �IncompleteReadErrorri rQ )r r/ r� r� �partialr r r � readexactly� s
zStreamReader.readexactlyc C s2 | j d k r| j �| jr(| j�� s(td��| �|�S )Nz9Called while some coroutine is waiting for incoming data.)rK rI �donerr r� )r r/ r r r � read_nowait� s
zStreamReader.read_nowaitc C s� | j d }| j}|dkrHt|�| |krH|||| � }| j|7 _n,|rj| j �� ||d � }d| _n
| j �� }| jt|�8 _| jt|�7 _| j}x |r�|d | jk r�|�d� q�W | j| jk r�| j j
r�| j � � |S )Nr rt ) rF rG ri �popleftrA rB rC r� r= r< ro �resume_reading)r r/ Z first_bufferr� rd Z chunk_splitsr r r r~ � s$
z StreamReader._read_nowait_chunkc C sT g }x<| j r@| �|�}|�|� |dkr|t|�8 }|dkrP qW |rPd�|�S dS )z6Read not more than n bytes, or whole buffer if n == -1rt r r# )rF r~ rQ ri rR )r r/ �chunksr r r r r� � s
zStreamReader._read_nowait)r )rz )rt )rt ))r r r r rn r r6 r r r? �AbstractEventLoopr! �strrT r rU �
BaseExceptionrV r
r r\ r^ r, r_ r` rc r+ rl rq rs rv rx r. ry r0 r3 r* r� r� r~ r� r r r r r X s8 "* "r c @ s e Zd Zdd�dd�Zee d�dd�Zedd�dd �Zeg df dd
�d d �Z dd�d
d�Z
e d�dd�Z e d�dd�Z
dd�dd�Zd'eedd�dd�Zed�dd�Zd(eed �d d �Zed�d d �Zeee f d�d!d"�Zeed �d#d$�Zd)eed �d%d&�ZdS )*�EmptyStreamReaderN)r c C s d S )Nr )r r r r r! � s zEmptyStreamReader.__init__c C s d S )Nr )r r r r rV � s zEmptyStreamReader.exception)rW r c C s d S )Nr )r rW r r r r
s z EmptyStreamReader.set_exception)rZ r c C s. y
|� W n t k
r( t�d� Y nX d S )NzException in eof callback)r[ r rV )r rZ r r r r\ s
zEmptyStreamReader.on_eofc C s d S )Nr )r r r r r^ s zEmptyStreamReader.feed_eofc C s dS )NTr )r r r r r_ s zEmptyStreamReader.is_eofc C s dS )NTr )r r r r r` s zEmptyStreamReader.at_eofc � s d S )Nr )r r r r rc s zEmptyStreamReader.wait_eofr )rd r/ r c C s d S )Nr )r rd r/ r r r rq s zEmptyStreamReader.feed_datac � s dS )Nr# r )r r r r r. s zEmptyStreamReader.readlinert )r/ r c � s dS )Nr# r )r r/ r r r r0 s zEmptyStreamReader.readc � s dS )Nr# r )r r r r r3 " s zEmptyStreamReader.readanyc � s dS )N)r# Tr )r r r r r* % s zEmptyStreamReader.readchunkc � s t �d|��d S )Nr# )r? r� )r r/ r r r r� ( s z EmptyStreamReader.readexactlyc C s dS )Nr# r )r r/ r r r r� + s z EmptyStreamReader.read_nowait)r )rt )rt )r r r r! r r� rV r
r r\ r^ r, r_ r` rc r+ r6 rq r. r0 r3 r r* r� r� r r r r r� � s r� r c @ s� e Zd ZdZejdd�dd�Zed�dd�Ze d�d d
�Z
e d�d d �Z e e
d�d
d�Ze
dd�dd�Zd eedd�dd�Zdd�dd�Zed�dd�Zee d�dd�ZdS ) r z>DataQueue is a general-purpose blocking queue with one reader.N)r8 r c C s, || _ d| _d | _d | _d| _t�� | _d S )NFr )r@ rH rI rK rA rD rE rF )r r8 r r r r! 5 s zDataQueue.__init__)r c C s
t | j�S )N)ri rF )r r r r �__len__= s zDataQueue.__len__c C s | j S )N)rH )r r r r r_ @ s zDataQueue.is_eofc C s | j o | j S )N)rH rF )r r r r r` C s zDataQueue.at_eofc C s | j S )N)rK )r r r r rV F s zDataQueue.exception)rW r c C s. d| _ || _| j}|d k r*d | _t||� d S )NT)rH rK rI r
)r rW rY r r r r
I s zDataQueue.set_exceptionr )rd rm r c C s@ | j |7 _ | j�||f� | j}|d k r<d | _t|d � d S )N)rA rF rQ rI r )r rd rm rY r r r rq R s zDataQueue.feed_datac C s( d| _ | j}|d k r$d | _t|d � d S )NT)rH rI r )r rY r r r r^ [ s
zDataQueue.feed_eofc � s� | j sX| jsX| jrt�| j�� | _y| jI d H W n$ tjtjfk
rV d | _� Y nX | j r~| j � � \}}| j
|8 _
|S | j d k r�| j �nt �d S )N)
rF rH rI ra r@ rb r? �CancelledError� TimeoutErrorr� rA rK r )r rd rm r r r r0 c s
zDataQueue.readc C s
t | j�S )N)r r0 )r r r r r" w s zDataQueue.__aiter__)r )r r r r r? r� r! r6 r� r, r_ r` r r� rV r
r rq r^ r0 r r" r r r r r 2 s r c sX e Zd ZdZeeejdd�� fdd� Zd
e edd�� fdd �
Z
e d
�� fd d � Z � Z S )r zlFlowControlDataQueue resumes and pauses an underlying stream.
It is a destination for parsed data.
N)r9 r: r8 r c s" t � j|d� || _|d | _d S )N)r8 r; )�superr! r< �_limit)r r9 r: r8 )rP r r r! � s z FlowControlDataQueue.__init__r )rd rm r c s0 t � �||� | j| jkr,| jjs,| j�� d S )N)r� rq rA r� r< ro rp )r rd rm )rP r r rq � s z FlowControlDataQueue.feed_data)r c � s6 zt � �� I d H S | j| jk r0| jjr0| j�� X d S )N)r� r0 rA r� r< ro r� )r )rP r r r0 � s zFlowControlDataQueue.read)r )
r r r r r r6 r? r� r! r rq r0 �
__classcell__r r )rP r r { s
r )#r? rD rf �typingr r r r r r r r Z
base_protocolr Zhelpersr r
r �logr Ztypedefsr �__all__r r[ r r r' r- r r� r �__annotations__r r r r r r �<module> s, ( &4I