golden hour
/opt/saltstack/salt/lib/python3.10/site-packages/salt/client/__pycache__
⬆️ Go Up
Upload
File/Folder
Size
Actions
__init__.cpython-310.pyc
49.05 KB
Del
OK
mixins.cpython-310.pyc
15.23 KB
Del
OK
netapi.cpython-310.pyc
2.24 KB
Del
OK
Edit: __init__.cpython-310.pyc
o �xe�: � @ s� d Z ddlZddlZddlZddlZddlZddlmZ ddlZddl Zddl Zddl Zddl Zddl ZddlZddlmZ ddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlm Z m Z m Z m Z m Z m!Z!m"Z" dZ#zddl$Z%dZ#W n e&y� Y nw e�'e(�Z)ej*�+ej,d�dddddfdd �Z-G d d � d �Z.G d d � d e/�Z0G dd� d�Z1G dd� d�Z2dS )a' The client module is used to create a client connection to the publisher The data structure needs to be: {'enc': 'clear', 'load': {'fun': '<mod.callable>', 'arg':, ('arg1', 'arg2', ...), 'tgt': '<glob or id>', 'key': '<read in the key file>'} � N)�datetime)�AuthenticationError�AuthorizationError�EauthAuthenticationError� PublishError�SaltClientError�SaltInvocationError�SaltReqTimeoutErrorFT�masterc C s0 |r|}n ddl }|j�| �}t|||||d�S )a� .. versionadded:: 2014.7.0 Read in the config and return the correct LocalClient object based on the configured transport :param str c_path: Path of config file to use for opts. The default value is None. :param bool mopts: When provided the local client will use this dictionary of options insead of loading a config file from the value of c_path. The default value is None. :param str skip_perm_errors: Ignore permissions errors while loading keys. The default value is False. :param IOLoop io_loop: io_loop used for events. Pass in an io_loop if you want asynchronous operation for obtaining events. Eg use of set_event_handler() API. Otherwise, operation will be synchronous. :param bool keep_loop: Do not destroy the event loop when closing the event subsriber. :param bool auto_reconnect: When True the event subscriber will reconnect automatically if a disconnect error is raised. .. versionadded:: 3004 :param bool listen: Listen for events indefinitly. When option is set the LocalClient object will listen for events until it's destroy method is called. The default value is False. r N)�mopts�skip_perm_errors�io_loop�auto_reconnect�listen)� salt.config�config� client_config� LocalClient)�c_pathr r r r r �opts�salt� r �H/opt/saltstack/salt/lib/python3.10/site-packages/salt/client/__init__.py�get_local_clientD s / �r c @ sR e Zd ZdZej�ejd�ddddddfdd�Z dd� Z d d � Z d d � Z dUdd�Z dUdd�Z dVdd�Zdd� Zejjjj dWdd��Z dXdd �Z dYd d �Z dZd!d"�Z d[d#d$�Z d\d%d&�Z d]d'd(�Z d^d)d*�Z d_d+d,�Z - d`d.d/�Z dad0d1�Z d2d3� Z! - dbd4d5�Z"dad6d7�Z#dad8d9�Z$d:d;� Z% - dcd<d=�Z& - ddd>d?�Z'dad@dA�Z(dBdC� Z)dDdE� Z* F dedGdH�Z+ejjjj F dfdIdJ��Z,dKdL� Z-dMdN� Z.dOdP� Z/dQdR� Z0dSdT� Z1dS )gr a> The interface used by the :command:`salt` CLI tool on the Salt Master ``LocalClient`` is used to send a command to Salt minions to execute :ref:`execution modules <all-salt.modules>` and return the results to the Salt Master. Importing and using ``LocalClient`` must be done on the same machine as the Salt Master and it must be done using the same user that the Salt Master is running as. (Unless :conf_master:`external_auth` is configured and authentication credentials are included in the execution). .. note:: The LocalClient uses a Tornado IOLoop, this can create issues when using the LocalClient inside an existing IOLoop. If creating the LocalClient in partnership with another IOLoop either create the IOLoop before creating the LocalClient, or when creating the IOLoop use ioloop.current() which will return the ioloop created by LocalClient. .. code-block:: python import salt.client local = salt.client.LocalClient() local.cmd('*', 'test.fib', [10]) r NFc C s� |r|| _ ntj�|�rt�d| jj|� tj � |�| _ tj j � � | _|| _| �� | _|| _|| _tj jjd| j d | j | j||d�| _tj� | j �| _ tjj| j | j d�| _tj�| j | j�| _dS )a� :param str c_path: Path of config file to use for opts. The default value is None. :param bool mopts: When provided the local client will use this dictionary of options insead of loading a config file from the value of c_path. The default value is None. :param str skip_perm_errors: Ignore permissions errors while loading keys. The default value is False. :param IOLoop io_loop: io_loop used for events. Pass in an io_loop if you want asynchronous operation for obtaining events. Eg use of set_event_handler() API. Otherwise, operation will be synchronous. :param bool keep_loop: Do not destroy the event loop when closing the event subsriber. :param bool auto_reconnect: When True the event subscriber will reconnect automatically if a disconnect error is raised. .. versionadded:: 3004 :param bool listen: Listen for events indefinitly. When option is set the LocalClient object will listen for events until it's destroy method is called. The default value is False. zP%s expects a file path not a directory path(%s) to its 'c_path' keyword argumentr �sock_dir)r r r � keep_loop)�utilsN)r �os�path�isdir�log�warning� __class__�__name__r r r r �userZget_specific_user� salt_userr � _LocalClient__read_master_key�keyr r �event� get_event�loaderZ minion_mods� functions� returners)�selfr r r r r r r r r r �__init__� s2 , � �zLocalClient.__init__c C s� | j }|dkr| j�dd�dkr| j�dd�}|�d�r#| j�dd�}tjj�� r/|�dd�}t j � | jd d� |��}z2tjj �| jd || j� tjj�|d��}tjj�|�� �W d � W S 1 sgw Y W d S ttfyz Y d S w ) z@ Read in the rotating master authentication key �rootr$ Zsudo_�\�_Zcachedirz.{}_key�rN� )r% r �get� startswithr r �platformZ is_windows�replacer r �join�formatZverifyZcheck_path_traversalr �filesZfopenZ stringutilsZ to_unicode�read�OSErrorr )r- Zkey_user�keyfiler' r r r Z__read_master_key� s& �(��z LocalClient.__read_master_keyc C sZ t j�| jd �}z|�|�W S t jjy, } ztd�|�� g W Y d}~S d}~ww )z? convert a seco.range range into a list target Z range_serverzRange server exception: {}N)�seco�rangeZRanger �expandZRangeException�printr9 )r- �tgtZrange_�errr r r �_convert_range_to_list s ��z"LocalClient._convert_range_to_listc C s\ |du r | j d S t|t�r|S t|t�r)zt|�W S ty( | j d Y S w | j d S )z+ Return the timeout to use N�timeout)r � isinstance�int�str� ValueError)r- rE r r r � _get_timeout s � zLocalClient._get_timeoutTc K s^ t �d|� t|�d| jd ��}| j|df|g|||d�|��}d|v r-| j�|d � |S )z: Return the information about a given job z(Checking whether jid %s is still running�gather_job_timeoutzsaltutil.find_job)�arg�tgt_typerE r �jid)r �debugrG r4 r �run_jobr( � subscribe)r- rN rB rM r �kwargsrE �pub_datar r r �gather_job_info s ��� zLocalClient.gather_job_infoc C s� |dkrt d��d|v r t|d � t�d|d � i S d|vr"i S |d dkr.td� i S | j�d�s>|d s>td � i S |sB|S | j�d�rT| j�d �|d �d � | j�d �|d �� |S )zX Common checks on the pub_data data structure returned from running pub r3 z�Failed to authenticate! This is most likely because this user is not permitted to execute commands, but there is a small possibility that a disk error occurred (check disk/inode usage).�errorz_check_pub_data() error: %srN �0z<Failed to connect to the Master, is the Salt Master running?� order_masters�minionszHNo minions matched the target. No command was sent, no jid was assigned.� syndic/.*/{}�regex� salt/job/{}) r rA r rO r r4 r( rQ r9 )r- rS r r r r �_check_pub_data6 s2 � � zLocalClient._check_pub_datar �globr3 c K s� t jj�||�}z| j|||||f|| �|�| d�| ��} W n2 ty) td�� ty5 } z� d} ~ w tyA } z� d} ~ w t yP } zt| ��d} ~ ww | j | | d�S )a Asynchronously send a command to connected minions Prep the job directory and publish a command to any targeted minions. :return: A dictionary of (validated) ``pub_data`` or an empty dictionary on failure. The ``pub_data`` contains the job ID and a list of all minions that are expected to return data. .. code-block:: python >>> local.run_job('*', 'test.sleep', [300]) {'jid': '20131219215650131543', 'minions': ['jerry']} )rN rE r �:The salt master could not be contacted. Is master running?N�r ) r r �args�condition_input�pubrJ r r r � Exceptionr\ )r- rB �funrL rM �retrE rN �kwargr rR rS rC �general_exceptionr r r rP e s< �� � �����zLocalClient.run_jobc C s" t jj�| j�j||d�}|d S )N)rM rX )r r rX � CkMinionsr Z check_minions)r- rB Z expr_formZ_resr r r �gather_minions� s �zLocalClient.gather_minionsc k s� � t jj�||�}z| j|||||f|| �|�| | d�| ��V } W n8 ty, td�� ty; } zt| ��d} ~ w tyJ } zt| ��d} ~ w t yY } zt|��d}~ww t j j j � | j| | d���)a Asynchronously send a command to connected minions Prep the job directory and publish a command to any targeted minions. :return: A dictionary of (validated) ``pub_data`` or an empty dictionary on failure. The ``pub_data`` contains the job ID and a list of all minions that are expected to return data. .. code-block:: python >>> local.run_job_async('*', 'test.sleep', [300]) {'jid': '20131219215650131543', 'minions': ['jerry']} )rN rE r r r^ Nr_ )r r r` ra � pub_asyncrJ r r r rc �ext�tornado�gen�Returnr\ )r- rB rd rL rM re rE rN rf r r rR rS rC rg r r r � run_job_async� s@ � �� � �����zLocalClient.run_job_asyncc K sB | j |||||f||dd�|��} z| d W S ty Y dS w )aT Asynchronously send a command to connected minions The function signature is the same as :py:meth:`cmd` with the following exceptions. :returns: A job ID or 0 on failure. .. code-block:: python >>> local.cmd_async('*', 'test.sleep', [300]) '20131219215921857715' F)rN rf r rN r )rP �KeyError) r- rB rd rL rM re rN rf rR rS r r r � cmd_async� s ��� �zLocalClient.cmd_async� c K s� | � d|�}| j|dfd|i| ��} t| �} t�| � g }| D ]}|| | v r,|�|� t|�|kr4 nq | j}|r=| j}||||fd||| | d�| ��S )a� Execute a command on a random subset of the targeted systems The function signature is the same as :py:meth:`cmd` with the following exceptions. :param subset: The number of systems to execute on :param cli: When this is set to True, a generator is returned, otherwise a dictionary of the minion returns is returned .. code-block:: python >>> SLC.cmd_subset('*', 'test.ping', subset=1) {'jerry': True} �sub�sys.list_functionsrM �list)rM re rf �progress� full_return)�pop�cmdru �random�shuffle�append�len�cmd_cli)r- rB rd rL rM re rf Zsubset�clirv rw rR Z minion_retrX Zf_tgt�minion�funcr r r � cmd_subset� s6 ��� �zLocalClient.cmd_subset�10%c k sB � ddl } ddl} | jj�||�}|||||||�d| j�dd��|�dd�d�} d|v r3|d | d< d|v r=|d | d< d |v rIt|d �| d < i } d |v rV|�d �| d < d |v ra|�d �| d < d |v rl|�d �| d < d |v rw|�d �| d < | j� � D ] \} } | | vr�| | | < q|| j j j | | dd�}|� � D ]\}}|V q�dS )a5 Iteratively execute a command on subsets of minions at a time The function signature is the same as :py:meth:`cmd` with the following exceptions. :param batch: The batch identifier of systems to execute on :returns: A generator of minion returns .. code-block:: python >>> returns = local.cmd_batch('*', 'state.highstate', batch='10%') >>> for ret in returns: ... print(ret) {'jerry': {...}} {'dave': {...}} {'stewart': {...}} r N�failhardF�raw)rB rd rL rM re �batchr� r� rE rK Z batch_wait�eauth�username�password�tokenT)r� �quiet)Zsalt.cli.batch�salt.utils.argsr r` ra r4 r rG rx �itemsr r� ZBatch�run)r- rB rd rL rM re rf r� rR r r r� r' �valr1 r r r � cmd_batch/ sH �# � ��zLocalClient.cmd_batchc K s� | j j} zm| j|||||||f| dd�| ��} | s$| W | s#| j �� S S i }| j| d | d | �|�||fi | ��D ]} | rS| �� D ]\}}|rJ|n|�di �||< qBq:tt | d �t |� �D ]}d||< q`|W | sq| j �� S S | sz| j �� w w )a� Synchronously execute a command on targeted minions The cmd method will execute and wait for the timeout period for all minions to reply, then it will return all minion data at once. .. code-block:: python >>> import salt.client >>> local = salt.client.LocalClient() >>> local.cmd('*', 'cmd.run', ['whoami']) {'jerry': 'root'} With extra keyword arguments for the command function to be run: .. code-block:: python local.cmd('*', 'test.arg', ['arg1', 'arg2'], kwarg={'foo': 'bar'}) Compound commands can be used for multiple executions in a single publish. Function names and function arguments are provided in separate lists but the index values must correlate and an empty list must be used if no arguments are required. .. code-block:: python >>> local.cmd('*', [ 'grains.items', 'sys.doc', 'cmd.run', ], [ [], [], ['uptime'], ]) :param tgt: Which minions to target for the execution. Default is shell glob. Modified by the ``tgt_type`` option. :type tgt: string or list :param fun: The module and function to call on the specified minions of the form ``module.function``. For example ``test.ping`` or ``grains.items``. Compound commands Multiple functions may be called in a single publish by passing a list of commands. This can dramatically lower overhead and speed up the application communicating with Salt. This requires that the ``arg`` param is a list of lists. The ``fun`` list and the ``arg`` list must correlate by index meaning a function that does not take arguments must still have a corresponding empty list at the expected index. :type fun: string or list of strings :param arg: A list of arguments to pass to the remote function. If the function takes no arguments ``arg`` may be omitted except when executing a compound command. :type arg: list or list-of-lists :param timeout: Seconds to wait after the last minion returns but before all minions return. :param tgt_type: The type of ``tgt``. Allowed values: * ``glob`` - Bash glob completion - Default * ``pcre`` - Perl style regular expression * ``list`` - Python list of hosts * ``grain`` - Match based on a grain comparison * ``grain_pcre`` - Grain comparison with a regex * ``pillar`` - Pillar data comparison * ``pillar_pcre`` - Pillar data comparison with a regex * ``nodegroup`` - Match on nodegroup * ``range`` - Use a Range server for matching * ``compound`` - Pass a compound match string * ``ipcidr`` - Match based on Subnet (CIDR notation) or IPv4 address. .. versionchanged:: 2017.7.0 Renamed from ``expr_form`` to ``tgt_type`` :param ret: The returner to use. The value passed can be single returner, or a comma delimited list of returners to call in order on the minions :param kwarg: A dictionary with keyword arguments for the function. :param full_return: Output the job return only (default) or the full return including exit code and other job metadata. :param kwargs: Optional keyword arguments. Authentication credentials may be passed when using :conf_master:`external_auth`. For example: ``local.cmd('*', 'test.ping', username='saltdev', password='saltdev', eauth='pam')``. Or: ``local.cmd('*', 'test.ping', token='5871821ea51754fdcea8153c1c745433')`` :returns: A dictionary with the result of the execution, keyed by minion ID. A compound command will return a sub-dictionary keyed by function name. T�rf r rN rX re F) r( �cpubrP � close_pub�get_cli_event_returnsrJ r� r4 ru �set)r- rB rd rL rE rM re rN rw rf rR � was_listeningrS �fn_retZmid�data�failedr r r ry y sV t�� � ��� � � � �zLocalClient.cmdc k s� � | j j} z[| j||||||f|dd�| ��| _| js | jV n5z#| j| jd | jd | �|�|||| fi | ��D ]} | s>q9| V q9W n tyT td�| jd ���w W | s_| j � � dS dS | si| j � � w w )am Used by the :command:`salt` CLI. This method returns minion returns as they come back and attempts to block until all minions return. The function signature is the same as :py:meth:`cmd` with the following exceptions. :param verbose: Print extra information about the running command :returns: A generator Tr� rN rX a This job's jid is: {0} Exiting gracefully on Ctrl-c The minions may not have all finished running and any remaining minions will return upon completion. To look up the return data for this job later, run the following command: salt-run jobs.lookup_jid {0}N) r( r� rP rS r� rJ �KeyboardInterrupt� SystemExitr9 r� ) r- rB rd rL rE rM re �verboserf rv rR r� r� r r r r~ s\ ��� � � � � ��� � �zLocalClient.cmd_clic k s� � | j j} zP| j||||||f|dd�|��} | s | V n-|�d�r%| V | j| d | d f| �|�||d�|��D ]} | s?q:| V q:| �| d � W | sT| j �� dS dS | s^| j �� w w )a� Yields the individual minion returns as they come in The function signature is the same as :py:meth:`cmd` with the following exceptions. Normally :py:meth:`cmd_iter` does not yield results for minions that are not connected. If you want it to return results for disconnected minions set `expect_minions=True` in `kwargs`. :return: A generator yielding the individual minion returns .. code-block:: python >>> ret = local.cmd_iter('*', 'test.ping') >>> for i in ret: ... print(i) {'jerry': {'ret': True}} {'dave': {'ret': True}} {'stewart': {'ret': True}} Tr� Zyield_pub_datarN rX )rE rB rM N)r( r� rP r4 �get_iter_returnsrJ �_clean_up_subscriptionsr� ) r- rB rd rL rE rM re rf rR r� rS r� r r r �cmd_iter\ sP � �� � �� ��� �zLocalClient.cmd_iterc k s� � | j j} zX| j||||||f|dd�| ��} | s | V n5| j| d | d f|||dd�| ��D ]} | rGt|| g�rG| D ] }| d | | d< q<| V q0| �| d � W | s\| j �� dS dS | sf| j �� w w )a� Yields the individual minion returns as they come in, or None when no returns are available. The function signature is the same as :py:meth:`cmd` with the following exceptions. :returns: A generator yielding the individual minion returns, or None when no returns are available. This allows for actions to be injected in between minion returns. .. code-block:: python >>> ret = local.cmd_iter_no_block('*', 'test.ping') >>> for i in ret: ... print(i) None {'jerry': {'ret': True}} {'dave': {'ret': True}} None {'stewart': {'ret': True}} Tr� rN rX F)rE rB rM �blockN)r( r� rP r� �anyr� r� )r- rB rd rL rE rM re rf �show_jidr� rR r� rS r� r� r r r �cmd_iter_no_block� sP �#�� � �� � �� �z LocalClient.cmd_iter_no_blockc K s� | j j} z5| j||||||f|dd�| ��} | s#| W | s"| j �� S S | �| d | d ||||�W | s9| j �� S S | sB| j �� w w )z3 Execute a salt command and return Tr� rN rX )r( r� rP r� � get_cli_static_event_returns) r- rB rd rL rE rM re r� rf rR r� rS r r r �cmd_full_return� s8 �� � ��� � �zLocalClient.cmd_full_return�*c k s � |rd� |�} t| � tdt| � d � n |r td� |�� |du r)| jd }i } t|�}t� } | j|||d�} | �|�} | i krM| �t| �� | V t| �|��t|�krZdS | D ]#}|i krl| �t|�� |V t| �|��t|�kr| � |� dS q\dS )z� Starts a watcher looking at the return data for a specified JID :returns: all of the information for the JID �Executing job with jid {}�-� �jid: {}NrE �rE ) r9 rA r} r r� �get_event_iter_returns�get_cache_returns�update� intersectionr� )r- rN rX rE rB rM r� r� rR �msgZfret�found� event_iterre r( r r r �get_cli_returns s8 � ��zLocalClient.get_cli_returnsc c s& � | j jd||dd| jd�}|V q)a4 Raw function to just return events of jid excluding timeout logic Yield either the raw event data or None Pass a list of additional regular expressions as `tags_regex` to search the event bus for non-return data, such as minion lists returned from syndics. T�{�G�z�?)�wait�tag� match_typeZfullZno_blockr )r( r) r )r- r� r� r� r r r �get_returns_no_blockD s � ��z LocalClient.get_returns_no_blockc C s | j d�| jd � |�S )N� {}.get_load�master_job_cache)r, r9 r )r- rN r r r �returns_for_jobZ s zLocalClient.returns_for_jobc k s � t |t�s t |t�r|h}n t |ttf�r tt|��}|du r%| jd }t|�d| jd ��} tt�� �} i } t� } t� } z| � |�sOt � d� i V W dS W n t yk } zt j d|t jd� W Y d}~nd}~ww d}| jd r}| �d �|�d �}n| �d �|��}g }t� }t�� | }t�� | jd }d }t �d||t�|��� � |D ]�}|du r� n�d|�di �v r�dddd�iV d|�di �v r�|�|d d � d|�di �v r�| �|d d � q�|d �d|� d��s�t �d|d � q�d|d v�r t � d|d � q�|�d d��r | �|d d � |V q�| �|d d � |d d d |d d ii}d |d v �rJ|d d ||d d d < d |d v �r_|d d ||d d d < d!|d v �rt|d d! ||d d d!< |�d"d��r�||d d �|d � t �d#||d d � |V q�t| �|��t|�k�r�| jd �s�t �d$|| � �n�t| �|��t|�k�r�| jd �r�t| �t|�k�r�t|�d%k�r�t�� |k�rݐno|| D ]}|| v�r�t�� | | |< �q�t�� |k�r4|�r4| j|t|| �d&fi |��}d}d!|v�rg }n | �d �|d! ��}t�� | }| jd �r4|| j�d d'�7 }|D ]�}|du �r? n�z!|d d d%k�r_t �d(|d d � |�|d d � W n�W n+ t �y� } z |� � � d)�}|d k�r{t �d*� nt �d+|� W Y d}~nd}~ww |�|d! � d|�di �v �r�|�|d d � �q6d,|�di �v �r�|�|d, � �q6d|�di �v�rĐq6|d d i k�rϐq6t |d d t��r�t �d-|� �q6d|d d v �r�|d d d i k�r��q6|d d |v�r |�|d d � t�� | | |d d < d }�q6t�� }||k�o$| } | �r;|| D ]}|| | k �r9d} n�q,| �r?n |�rHt� d.� ndV q�|�r[|D ] }| j �!|� �qQ|�rot|| �D ] } | d/d iiV �qd| | 8 } | �r�| D ] } | d/d iiV �qxdS dS )0z� Watch the event system and return job data as it comes in :returns: all of the information for the JID NrE rK �jid does not existzReturner unavailable: %s)Zexc_info_on_loglevelFrW z(salt/job|syndic/.*)/{}rZ r[ Z syndic_waitTz9get_iter_returns for jid %s sent to %s will timeout at %srU r� r z Authorization error occurred.)�name�messagerX �missingr� z salt/job/z/retz Skipping non return event: %s�returnzMalformed event return: %sr� �idre �out�retcoderN Z _cmd_metazjid %s return from %szjid %s found all minions %sr ru � z&saltutil returning errors on minion %sz'"z"retcode missing from client returnzcPassing on saltutil error. Key '%s' missing from client return. This may be an error in the client.Zsyndicz!unexpected return from minion: %sr� r� )"rF r� rH ru �tupler rG r4 �timer� r r! rc �logging�DEBUGr� r9 rO r � fromtimestampr� r5 �addr} r� rT rU �removerp �__str__�strip�sleepr( � unsubscribe) r- rN rX rE rB rM �expect_minionsr� rR rK �startZminion_timeoutsr� r� �excZ last_timeZret_iterZ jinfo_iterZ open_jids� timeout_atZgather_syndic_waitZminions_runningr� re �id_ZjinfoZ missing_key�nowZdoner� r r r r� ] sj � � ���� � ��� �� ��� � �� ��� � �� 7�z LocalClient.get_iter_returnsc C s� t |�}|du r | jd }tt�� �}|| }t�d||t�|��� � t � }i }z| jd� | jd � |�i krAt� d� |W S W n t yY } z t d� | jd |���d}~ww |tt�� � } t d | �} | jj| || jd �} | dur�d | v r�|�| d � | d || d < t|�|��t|�kr�t�d |� |S qZt|�|��t|�kr�t�d |� |S tt�� �|kr�t�d||| � |S t�d� q[)�U Get the returns for the command line interface via the event system NrE z4get_returns for jid %s sent to %s will timeout at %sr� r� r� zJMaster job cache returner [{}] failed to verify jid. Exception details: {}Tr� �r r� r� zjid %s found all minionsz(jid %s minions %s did not return in timer� )r� r rG r� r rO r r� r, r9 r! rc r �maxr( r) r r� r} r� �infor� ) r- rN rX rE r� r� r� re r� � time_leftr� r� r r r � get_returnsk sf �� ���� � � � ��zLocalClient.get_returnsc C sr i }| j |||d�}z| jd�| jd � |�}W n ty0 } z td�| jd |���d}~ww |D ];}i } d|| v rG|| �d�| d< n || �d�| d< d|| v r^|| d | d< ||v rj|| �| � q3| ||< q3tt |�� |��t|�kr~|S |D ]6} | i kr�t � d � q�| � � D ]\}} ||v r�|| �| � q�| ||< q�tt |�� |��t|�kr�| S q�|S ) z� This method starts off a watcher looking at the return data for a specified jid, it returns all of the information for the jid r� � {}.get_jidr� z;Returner {} could not fetch jid data. Exception details: {}Nr� re r� �{�G�z�?)r� r, r9 r rc r r4 r� r} r� r� r� r� r� ) r- rN rX rE re r� r� r� r� �m_dataZ event_retr r r �get_full_returns� sL � ���� �z LocalClient.get_full_returnsc C s� i }z| j d�| jd � |�}W n ty( } z td�| jd |���d}~ww |D ];}i }d|| v r?|| �d�|d< n || �d�|d< d|| v rV|| d |d< ||v rb|| �|� q+|||< q+|S )zO Execute a single pass to gather the contents of the job cache r� r� zXCould not examine master job cache. Error occurred in {} returner. Exception details: {}Nr� re r� )r, r9 r rc r r4 r� )r- rN re r� r� r� r� r r r r� � s. ���� z LocalClient.get_cache_returnsc C sh t �d� t|�}|r d�|�} t| � tdt| � d � n |r(td�|�� |du r1| jd }tt�� �} | | } t� } i } z| j d�| jd � |�i krXt � d � | W S W n t yp } z t d �| jd |���d}~ww | tt�� � }t d |�}d�|�}| jj||| jd�}|dur�d|v r�d|�di �v r�|�|d d � qq| �|d � d|d i| |d < |�dd�| |d d< d|v r�|d | |d d< t| �|��t|�kr�nNqqt| �|��t|�kr�nAtt�� �| k�r'|s�|�r&| j�dd��s|dv �r&t| �t|�k �r&tt|�| ���}|D ] }ddd �| |< �qnt�d � qr| �|� | S ) r� z1entered - function get_cli_static_event_returns()r� r� r� r� NrE r� r� r� zCLoad could not be retrieved from returner {}. Exception details: {}Tr� r[ r� r� rX r� r� re �successFr� �minion_data_cache)r] Zpcreru � no_returnzMinion did not return)r� re r� )r �tracer� r9 rA r} r rG r� r, r! rc r r� r( r) r r4 r� r� r� �sortedru � differencer� r� )r- rN rX rE rB rM r� � show_timeoutr� r� r� r� r� re r� r� r� Zjid_tagr� Zfailr� r r r r� � s� � � ���� � � � +z(LocalClient.get_cli_static_event_returnsc k s� � t �d� |r d�|�} t| � tdt| � d � n | r%td�|�� d} d} | j||f|||| �dd �p:|p:|d �| ��D ]�}t �d |� | d } |rf|�� D ]\}}|� d �duret|�| d�V qR|�� D ]j\}}|� d �du r�| du r�t j j � | j��� } | jd r�t j�| j��d�|�d�r�| r�|| vr�|ddt jjjd�iV qjtj�tj�| jd |��s�|dd�|�t jjjd�iV qjd|v r�td��||iV qjq@| �|� dS )r� z func get_cli_event_returns()r� r� r� r� Nr r� F)rE rB rM r� zreturn event: %sr� r� T)Z minion_count� return_countr� z minions/{}r� r� z&Minion did not return. [Not connected])r� re r� Z syndic_dirz�Minion did not return. [No response] The minions may not have all finished running and any remaining minions will return upon completion. To look up the return data for this job later, run the following command: salt-run jobs.lookup_jid {}rU z Authorization error occurred) r r� r9 rA r} r� rx rO r� r4 r r rX rh r Z connected_ids�cache�factory�contains�defaultsZ exitcodesZ EX_GENERICr r �existsr8 r r� )r- rN rX rE rB rM r� rv r� r� rR r� Zconnected_minionsr� re r� Zmin_retr r r r� Z s� � �� � ����� ����� ����� �0z!LocalClient.get_cli_event_returnsc c s � t �d� |du r| jd }t�� | }t� }| jd�| jd � |�i kr1t �d� i V dS | jj || j d�}|du sEt�� |krGdS d |� d i �v rPq1z ||d kri|� |d � |d d |d ii}nW q1W n t yu Y q1w d|v r�|d ||d d< |V t�d� q2)zk Gather the return data from the event system, break hard when timeout is reached. z+entered - function get_event_iter_returns()NrE r� r� r� Tr� rX r� rN r� re r� r� r� )r r� r r� r� r, r9 r! r( r) r r4 r� rp r� )r- rN rX rE r� r� r� re r r r r� � s@ � � � � �z"LocalClient.get_event_iter_returnsc C sB || j d vr| j �dd�}td�||���tjj�|| j d �S )zD Resolve a nodegroup into its configured components Z nodegroups� conf_filezthe master config filez Node group {} unavailable in {})r r4 r r9 r r rX Znodegroup_comp)r- Zngr� r r r �_resolve_nodegroup� s �z LocalClient._resolve_nodegroupc K s. |dkr | � |�}d}|dkrPt� } t�d|� t|t�r!|�� }|D ]!} | �d�r?t| �dkr?| � | dd� �} | � | � q#| � | � q#t�d| � d� | �}|d kr]t r]| � |�}d }| j�d �ru|rp|d �| jd �7 }n| jd }d |||| j|||d�} |r�|| d< | j| d< | jd r�|| d< | S )zI Set up the payload_kwargs to be sent down to the master Z nodegroupZcompoundz%compound resolution: original tgt: %szN@� Nz compound resolution: new_tgt: %s� r? ru Z ext_job_cachez,{}Zpublish)ry rB rd rL r' rM re rN rR r$ rW �to)r� ru r rO rF rH �splitr5 r} �extendr| r8 � HAS_RANGErD r r4 r9 r' r% ) r- rB rd rL rM re rN rE rR Znew_tgt�wordZresolved�payload_kwargsr r r � _prep_pub� sJ � zLocalClient._prep_pub� c K s� | j �dd�dkr"tj�tj�| j d d��s"t�d| j d � t�| j |||||||fi | ��} d� t j j �| j d �t| j d ��} t jjjj| j d | d ���} z|r^| jj|d �s^t� �| j| |d �} W n ty{ } z t�|� td ��d}~ww | s�| �� }|| jkr�| W d � S || _| j| d< | �| �} | �dd�}|dur�t|t �r�|�dd�}|�dd�}|dkr�t |��|dkr�t |��t |��| s�| W d � S W d � n1 s�w Y | d d | d d d�S )�� Take the required arguments and publish the given command. Arguments: tgt: The tgt is a regex or a glob used to match up the ids on the minions. Salt works by always publishing every command to all of the minions and then the minions determine if the command is for them based on the tgt value. fun: The function name to be called on the remote host(s), this must be a string in the format "<modulename>.<function name>" arg: The arg option needs to be a tuple of arguments to pass to the calling function, if left blank Returns: jid: A string, as returned by the publisher, which is the job id, this will inform the client where to get the job results minions: A set, the targets that the tgt passed should match. �ipc_moder3 �tcpr �publish_pull.ipc�4Unable to connect to the salt master publisher at %sz tcp://{}:{}� interface�ret_port�clear)�crypt� master_urir� �f Salt request timed out. The master is not responding. You may need to run your command with `--async` in order to bypass the congested event bus. With `--async`, the CLI tool will print the job id (jid) and exit immediately without listening for responses. You can then use `salt-run jobs.lookup_jid` to look up the results of the job in the job cache later.Nr' rU r� r� r r �loadrN rX �rN rX ) r r4 r r r� r8 r rU r r� r9 r r �network� ip_bracketrH �channel�clientZ ReqChannelr� r( � connect_pubr �sendr& r' rx rF �dictr r r )r- rB rd rL rM re rN rE r rR r� r r �payloadrC r' rU �err_name�err_msgr r r rb : sp "���� � � ��� � �+ �.zLocalClient.pubc k s� � | j �dd�dkr#tj�tj�| j d d��s#t�d| j d � t�| j |||||||fi | ��} dt j j � | j d � d t| j d � } t jjjj| j |d | d ���} z| rb| jj|d �sbt� �| j| |d �V }W n tyv td��w |s�| �� }|| jkr�t jjj� |��|| _| j| d< | �| �V }|� dd�}|dur�t |t �r�|�dd�}|�dd�}|dkr�t |��|dkr�t!|��t"|��|s�t jjj� |��W d � n1 s�w Y t jjj� |d d |d d d���)r� r� r3 r� r r� r� ztcp://r� �:r� r )r r r r� r r' rU Nr� r� r r r rN rX r )#r r4 r r r� r8 r rU r r� r r r r rH r r ZAsyncReqChannelr� r( r r r r& r' rk rl rm rn rx rF r r r r )r- rB rd rL rM re rN rE r r rR r� r r r r' rU r r r r r rj � sv �$������ �� � �� � � -�zLocalClient.pub_asyncc C � | � � d S �N��destroy�r- r r r �__del__ s zLocalClient.__del__c C s6 | j �d�r| j�d�|�d� | j�d�|�� d S )NrW rY rZ r[ )r r4 r( r� r9 )r- Zjob_idr r r r� s z#LocalClient._clean_up_subscriptionsc C s" | j d ur| j �� d | _ d S d S r )r( r r r r r r s �zLocalClient.destroyc C s | S r r r r r r � __enter__ s zLocalClient.__enter__c G r r r )r- r` r r r �__exit__ s zLocalClient.__exit__)T)r r] r3 Nr3 NF)r r] r3 Nr3 NTN)r r] r3 r3 N)r r] r3 Nrr FFF)r r] r3 Nr� )r Nr] r3 r3 FN)r Nr] r3 FNF)r Nr] r3 N)r Nr] r3 NFF)r Nr] r3 FN)Nr� r] FFr )Nr� r] FT)Nr� r] FFF)Nr� r] FFFF)r r] r3 r3 r� F)r r] r3 r3 r� NT)2r# � __module__� __qualname__�__doc__r r r8 �syspaths� CONFIG_DIRr. r& rD rJ rT r\ rP ri r rk rl rm � coroutinero rq r� r� ry r~ r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� rb rj r r� r r r r r r r r � s& �H 3 �8 �; � �= �N � ! �K �H �L �, � 4 � ::# �` � g, F � d �i r c s8 e Zd ZdZ� fdd�Zdd� Zdd� Zdd � Z� ZS ) �FunctionWrappera Create a function wrapper that looks like the functions dict on the minion but invoked commands on the minion via a LocalClient. This allows SLS files to be loaded with an object that calls down to the minion when the salt functions dict is referenced. c s4 t � �� || _|| _t| jd �| _| �� | _d S )Nr� )�superr. r r� r �local� _FunctionWrapper__load_functionsr+ )r- r r� �r" r r r. * s zFunctionWrapper.__init__c C s || j vrt�| �|�S )z� Since the function key is missing, wrap this call to a command to the minion of said key if it is available in the self.functions set )r+ rp �run_key)r- r' r r r � __missing__1 s zFunctionWrapper.__missing__c C s t | j�| jd��| jg ��S )zE Find out what functions are available on the minion rt )r� r! ry r� r4 r r r r Z__load_functions: s �z FunctionWrapper.__load_functionsc s � �fdd�}|S )zc Return a function that executes the arguments passed via the local client c s> t | �} |�� D ] \}}| �d�||�� q�j��j� | �S )z+ Run a remote call z{}={})ru r� r| r9 r! ry r� )r` rR Z_keyZ_val�r' r- r r r� H s z%FunctionWrapper.run_key.<locals>.funcr )r- r' r� r r& r r$ B s zFunctionWrapper.run_key) r# r r r r. r% r" r$ � __classcell__r r r# r r ! s r c @ s: e Zd ZdZej�ejd�dfdd�Z dd� Z dd � Z dS ) �Callera� ``Caller`` is the same interface used by the :command:`salt-call` command-line tool on the Salt Minion. .. versionchanged:: 2015.8.0 Added the ``cmd`` method for consistency with the other Salt clients. The existing ``function`` and ``sminion.functions`` interfaces still exist but have been removed from the docs. Importing and using ``Caller`` must be done on the same machine as a Salt Minion and it must be done using the same user that the Salt Minion is running as. Usage: .. code-block:: python import salt.client caller = salt.client.Caller() caller.cmd('test.ping') Note, a running master or minion daemon is not required to use this class. Running ``salt-call --local`` simply sets :conf_minion:`file_client` to ``'local'``. The same can be achieved at the Python level by including that setting in a minion config file. .. versionadded:: 2014.7.0 Pass the minion config as the ``mopts`` dictionary. .. code-block:: python import salt.client import salt.config __opts__ = salt.config.minion_config('/etc/salt/minion') __opts__['file_client'] = 'local' caller = salt.client.Caller(mopts=__opts__) r� Nc C s6 dd l }|r || _n|j�|�| _|j�| j�| _d S �Nr )� salt.minionr r Z minion_configr� ZSMinion�sminion�r- r r r r r r r. { s zCaller.__init__c O s | j j| |i |��S )aF Call an execution module with the given arguments and keyword arguments .. versionchanged:: 2015.8.0 Added the ``cmd`` method for consistency with the other Salt clients. The existing ``function`` and ``sminion.functions`` interfaces still exist but have been removed from the docs. .. code-block:: python caller.cmd('test.arg', 'Foo', 'Bar', baz='Baz') caller.cmd('event.send', 'myco/myevent/something', data={'foo': 'Foo'}, with_env=['GIT_COMMIT'], with_grains=True) )r+ r+ )r- rd r` rR r r r ry � s z Caller.cmdc O s8 | j j| }tj�|tjj�|�|�\}}||i |��S )z- Call a single salt function )r+ r+ r r� Zload_args_and_kwargsr r` Z parse_input)r- rd r` rR r� r r r �function� s �zCaller.function) r# r r r r r r8 r r r. ry r- r r r r r( T s & r( c @ s2 e Zd ZdZej�ejd�dfdd�Z dd� Z dS )� ProxyCallera4 ``ProxyCaller`` is the same interface used by the :command:`salt-call` with the args ``--proxyid <proxyid>`` command-line tool on the Salt Proxy Minion. Importing and using ``ProxyCaller`` must be done on the same machine as a Salt Minion and it must be done using the same user that the Salt Minion is running as. Usage: .. code-block:: python import salt.client caller = salt.client.ProxyCaller() caller.cmd('test.ping') Note, a running master or minion daemon is not required to use this class. Running ``salt-call --local`` simply sets :conf_minion:`file_client` to ``'local'``. The same can be achieved at the Python level by including that setting in a minion config file. .. code-block:: python import salt.client import salt.config __opts__ = salt.config.proxy_config('/etc/salt/proxy', minion_id='quirky_edison') __opts__['file_client'] = 'local' caller = salt.client.ProxyCaller(mopts=__opts__) .. note:: To use this for calling proxies, the :py:func:`is_proxy functions <salt.utils.platform.is_proxy>` requires that ``--proxyid`` be an argument on the commandline for the script this is used in, or that the string ``proxy`` is in the name of the script. �proxyNc C s. dd l }|p |j�|�| _|j�| j�| _d S r) )r* r Z proxy_configr r� Z SProxyMinionr+ r, r r r r. � s zProxyCaller.__init__c O s� | j j| }||d�}|�|� t| j dg �p | j�ddg�}t|t�r'|g}|D ](}d�|�}|| j j vr=t d�|���| j j | | j||||�} | durQ | S q)| S )aF Call an execution module with the given arguments and keyword arguments .. code-block:: python caller.cmd('test.arg', 'Foo', 'Bar', baz='Baz') caller.cmd('event.send', 'myco/myevent/something', data={'foo': 'Foo'}, with_env=['GIT_COMMIT'], with_grains=True) )rL rd Zmodule_executorsZ direct_callz {}.executez Executor '{}' is not availableN) r+ r+ r� �getattrr r4 rF rH r9 � executorsr ) r- rd r` rR r� r� r1 r� �fnameZ return_datar r r ry � s( � ��zProxyCaller.cmd) r# r r r r r r8 r r r. ry r r r r r. � s & r. )3r r� r rz �sysr� r Z salt.cacher Zsalt.channel.clientr Zsalt.defaults.exitcodesZsalt.ext.tornado.genZ salt.loaderZ salt.payloadZ salt.syspathsr r� Zsalt.utils.eventZsalt.utils.filesZsalt.utils.jidZsalt.utils.minionsZsalt.utils.networkZsalt.utils.platformZsalt.utils.stringutilsZsalt.utils.userZsalt.utils.verifyZsalt.exceptionsr r r r r r r r� Z seco.ranger> � ImportErrorZ getLoggerr# r r r8 r r r r r r( r. r r r r �<module> sx $ � �A +3N
Save