golden hour
/opt/saltstack/salt/lib/python3.10/site-packages/cheroot/workers/__pycache__
⬆️ Go Up
Upload
File/Folder
Size
Actions
__init__.cpython-310.pyc
199 B
Del
OK
threadpool.cpython-310.pyc
9.44 KB
Del
OK
Edit: threadpool.cpython-310.pyc
o �xeh) � @ s� d Z ddlmZmZmZ eZddlZddlZddl Z ddl Z ddl Z ddl m Z ddlmZ dZG dd� d�Ze� ZdZG d d � d ej�ZG d d � d �ZdS ) z8A thread-based worker pool. .. spelling:: joinable � )�absolute_import�division�print_functionN)�queue)� pass_none)� WorkerThread� ThreadPoolc @ s e Zd ZdZdd� Zdd� ZdS )� TrueyZerozDObject which equals and does math like the integer 0 but evals True.c C � |S �N� ��self�otherr r �N/opt/saltstack/salt/lib/python3.10/site-packages/cheroot/workers/threadpool.py�__add__ � zTrueyZero.__add__c C r r r r r r r �__radd__ r zTrueyZero.__radd__N)�__name__� __module__� __qualname__�__doc__r r r r r r r s r c @ s2 e Zd ZdZdZ dZ dZ dd� Zdd� ZdS )r aF Thread which continuously polls a Queue for Connection objects. Due to the timing issues of polling a Queue, a WorkerThread does not check its own 'ready' flag after it has started. To stop the thread, it is necessary to stick a _SHUTDOWNREQUEST object onto the Queue (one for each running WorkerThread). NFc sv d� _ |� _d� _d� _d� _d� _d� _� fdd�� fdd�� fdd�� fdd�d d� d d� d �� _tj � � � dS ) z�Initialize WorkerThread instance. Args: server (cheroot.server.HTTPServer): web server object receiving this request Fr Nc s � j � jd u r tp � jj S r )� requests_seen� start_time� trueyzero�conn��s�r r r �<lambda>M s ��z'WorkerThread.__init__.<locals>.<lambda>c � � j � jd u r tp � jjj S r )� bytes_readr r r �rfiler r r r r R � ��c r r )� bytes_writtenr r r �wfiler r r r r W r# c s" � j � jd u r tpt�� � j S r )� work_timer r �timer r r r r \ s � �c S � | d | �| d | �p d S )N� Bytes Read� Work Time���ư>r r r r r r a � �c S r( )N� Bytes Writtenr* r+ r r r r r r d r, )ZRequestsr) r- r* zRead ThroughputzWrite Throughput) �ready�serverr r! r$ r r& �stats� threading�Thread�__init__)r r/ r r r r3 = s � zWorkerThread.__init__c C s� | j | jj d | �� < z�d| _ | jj�� }|tu r W dS || _| jj d }|r-t�� | _ d}zD|� � }W |r>| j� |� n|� � |rp| j | jj 7 _ | j| jjj7 _| j| jjj7 _| jt�� | j 7 _d| _ d| _n?|r}| j� |� n|� � |r�| j | jj 7 _ | j| jjj7 _| j| jjj7 _| jt�� | j 7 _d| _ d| _w q ttfy� } z || j_W Y d}~dS d}~ww )zeProcess incoming HTTP connections. Retrieves incoming connections from thread pool. zWorker ThreadsTNZEnabledF)r0 r/ �getNamer. Zrequests�get�_SHUTDOWNREQUESTr r' r � communicateZput_conn�closer r! r" r$ r% r& �KeyboardInterrupt� SystemExitZ interrupt)r r Zis_stats_enabledZkeep_conn_open�exr r r �runj sN ����zWorkerThread.run) r r r r r r/ r. r3 r< r r r r r ) s -r c @ s� e Zd ZdZ d dd�Zdd� Zedd � �Zd d � Zd d � Z dd� Z dd� Z dd� Z d dd�Z eedd� ��Zdd� Zedd � �Zd S ) r z�A Request Queue for an HTTPServer which pools threads. ThreadPool objects must provide min, get(), put(obj), start() and stop(timeout) attributes. � ���c C sD || _ || _|| _g | _tj|d�| _|| _| jj| _t � � | _ dS )a� Initialize HTTP requests queue instance. Args: server (cheroot.server.HTTPServer): web server object receiving this request min (int): minimum number of worker threads max (int): maximum number of worker threads accepted_queue_size (int): maximum number of active requests in queue accepted_queue_timeout (int): timeout for putting request into queue )�maxsizeN) r/ �min�max�_threadsr ZQueue�_queue�_queue_put_timeoutr5 � collections�deque�_pending_shutdowns)r r/ r@ rA Zaccepted_queue_sizeZaccepted_queue_timeoutr r r r3 � s zThreadPool.__init__c C sr t | j�D ] }| j�t| j�� q| jD ]}|�dj|�� d�� |� � q| jD ] }|j s6t � d� |j r.q)dS )zStart the pool of threads.�CP Server {worker_name!s}�Z worker_name皙�����?N) �ranger@ rB �appendr r/ �setName�formatr4 �startr. r' �sleep)r �i�workerr r r rO � s �� ���zThreadPool.startc C s( t dd� | jD ��}t|t | j� d�S )z3Number of worker threads which are idle. Read-only.c S s g | ] }|j d u r|�qS r �r ��.0�tr r r � <listcomp>� s z#ThreadPool.idle.<locals>.<listcomp>r )�lenrB rA rG )r Zidlesr r r �idle� s zThreadPool.idlec C s | j j|d| jd� dS )z�Put request into queue. Args: obj (:py:class:`~cheroot.server.HTTPConnection`): HTTP connection waiting to be processed T)�block�timeoutN)rC �putrD )r �objr r r r\ � s zThreadPool.putc C sF dd� | j D �D ]}| j �|� z| j�� W q ty Y qw d S )Nc S s g | ]}|� � s|�qS r )�is_aliverT r r r rW � s z2ThreadPool._clear_dead_threads.<locals>.<listcomp>)rB �removerG �popleft� IndexError)r rV r r r �_clear_dead_threads� s ��z ThreadPool._clear_dead_threadsc s� � j dkrt � j t� j� d�}ntd�}t||�}� fdd�t|�D �}tdd� |D ��s<t�d� tdd� |D ��r.� j� |� dS ) z.Spawn new worker threads (not above self.max).r �infc s g | ]}� � � �qS r )� _spawn_worker)rU rQ r r r rW � s z#ThreadPool.grow.<locals>.<listcomp>c s s � | ]}|j V qd S r )r. )rU rR r r r � <genexpr>� s � z"ThreadPool.grow.<locals>.<genexpr>rJ N) rA rX rB �floatr@ rK �allr' rP �extend)r �amountZbudgetZn_new�workersr r r �grow� s �zThreadPool.growc C s, t | j�}|�dj|�� d�� |�� |S )NrH rI )r r/ rM rN r4 rO )r rR r r r rd � s ��zThreadPool._spawn_workerc C sl |t | j�8 }| �� |dkrdS tt | j�| j d�}t||�}t|�D ]}| j�d� | j� t � q%dS )z-Kill off worker threads (not below self.min).r N) rX rG rb rA rB r@ rK rL rC r\ r6 )r ri Zn_extraZ n_to_remove�nr r r �shrink� s �zThreadPool.shrink� c C s� |dur|dk rd}t jddd� |durt�� | }| jD ]}| j�t� q ttf}| � � D ](}|o8|t�� }z|� |� |� � rM| � |j � |� � W q/ |yW Y q/w dS )z|Terminate all worker threads. Args: timeout (int): time to wait for threads to stop gracefully Nr zZIn the future, negative timeouts to Server.stop() will be equivalent to a timeout of zero.� )� stacklevel)�warnings�warningr' rB rC r\ r6 �AssertionErrorr9 �_clear_threads�joinr^ � _force_closer )r r[ �endtimerR Zignored_errorsZremaining_timer r r �stop s2 � � � ��zThreadPool.stopc C sZ | j jrd S z z | j�tj� W W d S ty" | j�� Y W d S w ty, Y d S w r )r" �closed�socket�shutdown�SHUT_RD� TypeError�OSErrorrS r r r rv , s � �zThreadPool._force_closec C s, | j dd� g }| j dd�< dd� |D �S )z3Clear self._threads and yield all joinable threads.Nc s s � | ] }|t �� ur|V qd S r )r1 � currentThread)rU �threadr r r re @ s � ��z,ThreadPool._clear_threads.<locals>.<genexpr>)rB )r �threadsr r r rt < s �zThreadPool._clear_threadsc C s | j �� S )zReturn the queue size.)rC �qsizer r r r r� F s zThreadPool.qsizeN)r= r> r> r= )rn )r r r r r3 rO �propertyrY r\ rb rk rd rm rx � staticmethodr rv rt r� r r r r r � s( � * r )r Z __future__r r r �typeZ __metaclass__rE r1 r' rz rq Z six.movesr Zjaraco.functoolsr �__all__r r r6 r2 r r r r r r �<module> s e
Save