golden hour
/opt/saltstack/salt/lib/python3.10/site-packages/salt/cloud/clouds/__pycache__
⬆️ Go Up
Upload
File/Folder
Size
Actions
__init__.cpython-310.pyc
171 B
Del
OK
aliyun.cpython-310.pyc
19.81 KB
Del
OK
azurearm.cpython-310.pyc
39.67 KB
Del
OK
clc.cpython-310.pyc
8.91 KB
Del
OK
cloudstack.cpython-310.pyc
10.87 KB
Del
OK
digitalocean.cpython-310.pyc
27.39 KB
Del
OK
dimensiondata.cpython-310.pyc
12.62 KB
Del
OK
ec2.cpython-310.pyc
92.28 KB
Del
OK
gce.cpython-310.pyc
48.78 KB
Del
OK
gogrid.cpython-310.pyc
11.07 KB
Del
OK
hetzner.cpython-310.pyc
11.82 KB
Del
OK
joyent.cpython-310.pyc
22.78 KB
Del
OK
libvirt.cpython-310.pyc
16.69 KB
Del
OK
linode.cpython-310.pyc
59.17 KB
Del
OK
lxc.cpython-310.pyc
10.9 KB
Del
OK
msazure.cpython-310.pyc
71.44 KB
Del
OK
oneandone.cpython-310.pyc
18.39 KB
Del
OK
opennebula.cpython-310.pyc
90.2 KB
Del
OK
openstack.cpython-310.pyc
23.53 KB
Del
OK
packet.cpython-310.pyc
12.06 KB
Del
OK
parallels.cpython-310.pyc
11.89 KB
Del
OK
profitbricks.cpython-310.pyc
25.34 KB
Del
OK
proxmox.cpython-310.pyc
27.25 KB
Del
OK
pyrax.cpython-310.pyc
2.59 KB
Del
OK
qingcloud.cpython-310.pyc
16.64 KB
Del
OK
saltify.cpython-310.pyc
11.91 KB
Del
OK
scaleway.cpython-310.pyc
9.36 KB
Del
OK
softlayer.cpython-310.pyc
13.26 KB
Del
OK
softlayer_hw.cpython-310.pyc
13.5 KB
Del
OK
tencentcloud.cpython-310.pyc
20.55 KB
Del
OK
vagrant.cpython-310.pyc
8.32 KB
Del
OK
virtualbox.cpython-310.pyc
9.57 KB
Del
OK
vmware.cpython-310.pyc
94.14 KB
Del
OK
vultrpy.cpython-310.pyc
12.8 KB
Del
OK
xen.cpython-310.pyc
25.66 KB
Del
OK
Edit: ec2.cpython-310.pyc
o �xe{r � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl ZddlZddlm mZ ddlmZ ddlmZ ddlZddlm m Z ddl Zddl Zddl Zddl Zddl!m m"Z" ddl#Zddl$Zddl%Zddl&Zddl'm(Z(m)Z)m*Z*m+Z+m,Z, zddl-Z-dZ.W n e/y� dZ.Y nw e�0e1�Z2ddd d d d d ddddd� Z3dZ4dZ5g d�Z6e �7de j8�Z9dZ:dd� Z;dd� Z<d d � Z=d d � Z>d d!� Z?d"d#� Z@d$d%� ZA d�d&d'�ZB ( ) * +d�d,d-�ZCd�d.d/�ZDd�d0d1�ZEd2d3� ZFd4d5� ZGd6d7� ZHd8d9� ZId:d;� ZJd<d=� ZKd�d>d?�ZLd�d@dA�ZMdBdC� ZNdDdE� ZOdFdG� ZPdHdI� ZQdJdK� ZRdLdM� ZSdNdO� ZTdPdQ� ZUdRdS� ZVd�dTdU�ZWd�dVdW�ZXdXdY� ZYdZd[� ZZd\d]� Z[d^d_� Z\d`da� Z]dbdc� Z^d�ddde�Z_d�dfdg�Z`d�dhdi�Zadjdk� Zbd�dldm�Zcd�dndo�Zd d�dpdq�Zedrds� Zfd�dtdu�Zgdvdw� Zhd�dxdy�Zid�dzd{�Zjd�d|d}�Zk d�d~d�Zl d�d�d��Zm d�d�d��Znd�d�d��Zod�d�d��Zpd�d�d��Zqd�d�d��Zrd�d�d��Zsd�d�d��Ztd�d�d��Zud�d�� Zvd�d�� Zwd�d�d��Zxd�d�d��Zyd�d�d��Zzd�d�d��Z{d�d�d��Z|d�d�d��Z}d�d�� Z~d�d�d��Zd�d�d��Z�d�d�d��Z�d�d�d��Z�d�d�d��Z�d�d�d��Z�d�d�d��Z� d�d�d��Z�d�d�d��Z�d�d�� Z�d�d�� Z�d�d�d��Z�d�d�� Z�d�d�d��Z�d�d�d��Z�d�d�dÄZ�d�d�dńZ�d�dDŽ Z�d�d�dɄZ�d�d�d˄Z�d�d�d̈́Z�d�d�dτZ�d�d�dфZ�d�d�dӄZ�d�d�dՄZ�d�d�dׄZ�d�d�dلZ� d�d�dۄZ� d�d�d݄Z�d�d�d߄Z�d�d� Z�d�d�d�Z�d�d�d�Z�d�d�d�Z�dS )�a� The EC2 Cloud Module ==================== The EC2 cloud module is used to interact with the Amazon Elastic Compute Cloud. To use the EC2 cloud module, set up the cloud configuration at ``/etc/salt/cloud.providers`` or ``/etc/salt/cloud.providers.d/ec2.conf``: .. code-block:: yaml my-ec2-config: # EC2 API credentials: Access Key ID and Secret Access Key. # Alternatively, to use IAM Instance Role credentials available via # EC2 metadata set both id and key to 'use-instance-role-credentials' id: GKTADJGHEIQSXMKKRBJ08H key: askdjghsdfjkghWupUjasdflkdfklgjsdfjajkghs # If 'role_arn' is specified the above credentials are used to # to assume to the role. By default, role_arn is set to None. role_arn: arn:aws:iam::012345678910:role/SomeRoleName # The ssh keyname to use keyname: default # The amazon security group securitygroup: ssh_open # The location of the private key which corresponds to the keyname private_key: /root/default.pem # Be default, service_url is set to amazonaws.com. If you are using this # driver for something other than Amazon EC2, change it here: service_url: amazonaws.com # The endpoint that is ultimately used is usually formed using the region # and the service_url. If you would like to override that entirely, you # can explicitly define the endpoint: endpoint: myendpoint.example.com:1138/services/Cloud # SSH Gateways can be used with this provider. Gateways can be used # when a salt-master is not on the same private network as the instance # that is being deployed. # Defaults to None # Required ssh_gateway: gateway.example.com # Defaults to port 22 # Optional ssh_gateway_port: 22 # Defaults to root # Optional ssh_gateway_username: root # Default to nc -q0 %h %p # Optional ssh_gateway_command: "-W %h:%p" # One authentication method is required. If both # are specified, Private key wins. # Private key defaults to None ssh_gateway_private_key: /path/to/key.pem # Password defaults to None ssh_gateway_password: ExamplePasswordHere driver: ec2 # Pass userdata to the instance to be created userdata_file: /etc/salt/my-userdata-file # Instance termination protection setting # Default is disabled termination_protection: False :depends: requests � N)� cmp_to_key)�SaltCloudConfigError�SaltCloudException�SaltCloudExecutionFailure�SaltCloudExecutionTimeout�SaltCloudSystemExitTFZec2_ap_northeastZec2_ap_northeast_2Zec2_ap_southeastZec2_ap_southeast_2Z ec2_eu_westZec2_eu_centralZ ec2_sa_eastZ ec2_us_eastZec2_us_gov_west_1Z ec2_us_westZec2_us_west_oregon) zap-northeast-1zap-northeast-2zap-southeast-1zap-southeast-2z eu-west-1z eu-central-1z sa-east-1� us-east-1z us-gov-west-1z us-west-1z us-west-2r z 2016-11-15)ZRequestLimitExceededZ InsufficientInstanceCapacityZ InternalErrorZ UnavailableZInsufficientAddressCapacityZ$InsufficientReservedInstanceCapacityz /\*.*?\*/�ec2c C s t � du rdS t� du rdS tS )zH Set up the libcloud functions and check for EC2 configurations F)�get_configured_provider�get_dependencies�__virtualname__� r r �I/opt/saltstack/salt/lib/python3.10/site-packages/salt/cloud/clouds/ec2.py� __virtual__� s r c C s" zt �� W S ty t Y S w �N)Z__active_provider_name__�value�AttributeErrorr r r r �_get_active_provider_name� s �r c C s t �tt� ptd�S )z/ Return the first configured instance. )�id�key)�configZis_provider_configured�__opts__r r r r r r r � s �r c C s" t tjjptjjd�} t�t| �S )z* Warn if dependencies aren't met. )�requestszpycrypto or m2crypto)� HAS_REQUESTS�salt�crypt�HAS_M2� HAS_CRYPTOr Zcheck_driver_dependenciesr )Zdepsr r r r � s � r c C s� t | �dk r| j}d|v r|�d�}|d }|| jiS i }| D ]H}|j}d|v r1|�d�}|d }||vrHt |�dkrBt|�||< q |j||< q t|| t�s^|| }g ||< || �|� || �t|�� q |S )z) Convert an XML tree into a dict � �}r )�len�tag�split�text� _xml_to_dict� isinstance�list�append)Zxmltree�name�compsZxmldict�itemZtempvarr r r r$ � s, r$ c C s� i }i }| � � D ]3\}}d|vrt|d< |d |vr i ||d < |d |d f}|||d vr;||d�||d |< q|� � D ]!\}}|� � D ]\}}|\}} |d } |d } | |vr`| || < qHq@|S )a4 Return an optimized list of providers. We want to reduce the duplication of querying the same region. If a provider is using the same credentials for the same region the same data will be returned for each provider, thus causing un-wanted duplicate data and API calls to EC2. �locationr r )r( �datar( r, )�items�DEFAULT_LOCATION) Z providersZ tmp_providersZoptimized_providersr( r, �credsr+ Ztmp_dataZ_idZ_key�_name�_datar r r �optimize_providers� s. ����r2 c C s t �| |�d�tj��� S )N�utf-8)�hmac�new�encode�hashlib�sha256�digest)r �msgr r r �sign s r; c 6 C s� t � }|�dd�}t�|�\}} } d} | tjk �r�| �� } tj�� �d�} |s*t � }|sJ|�dd� ||��}d� |�}t j � |�j}t j � |�j}n*t j � |�j}t j � |�j}|dkrtd � |�}t�|� |d u rpd |i|fS d |iS t�d |� d }|}d}t j � |�j}|�� }tj�� }|�d�}|�d�}d| d d | d }d}tjj�d�}|�dt�} | | d< tt| ��} t| j| �} t j � tt | | ���} | � dd�} |d | d | d | d | d | } d}!|d | d | d d }"|!d | d |" d tjj�| � }#t d |d � d �|�}$t |$|�}%t |%|�}&t |&d�}'t!�"|'|#� d �t#j$��%� }(|!d d |d! d |" d" d# | d" d$ |( })||)d%�}*t�d&|� t�&d'| � z t'j||*| d(�}+t�d)|+j(� t�&d*|+j)� |+�*� W n� t'j+j,�y� }, z`t-�.|,j/j0�}-t1|-�}.|.�d+i ��d,i ��d-d�}/|/�r�|/t2v �r�| d.7 } t�d/|,j/j(|,|.| � t�3| � W Y d },~,qt�d0|,j/j(|,|.� |d u �r�d |.i|fW Y d },~,S d |.iW Y d },~,S d },~,ww t�d0|,j/j(|,|.� |d u �rd |.i|fS d |.iS |+j)}0t-�.|0�}-|-d. }1|d u �r|-}1|�r8t4|-�D ]\}2}3|3j5�6d1�}4|4d. |k�r6|-|2 }1�q!g }5|1D ] }3|5�7t1|3�� �q<|d u �rP|5|fS |5S )2N� service_urlz amazonaws.comr z%Y-%m-%dT%H:%M:%SZ�endpointz ec2.{}.{}z https://{}/� zqCould not find a valid endpoint in the requesturl: {}. Looking for something like https://some.ec2.endpoint/?argsT�errorzUsing EC2 endpoint: %sZGETr z%Y%m%dT%H%M%SZz%Y%m%dzhost:� z x-amz-date:zhost;x-amz-date�ec2_api_versionZVersion�+z%20zAWS4-HMAC-SHA256�/Z aws4_requestZAWS4r r3 � z Credential=r z, zSignedHeaders=z Signature=)z x-amz-dateZ AuthorizationzEC2 Request: %szEC2 Request Parameters: %s)�headers�paramsz EC2 Response Status Code: %szEC2 Response Text: %s�Errors�ErrorZCoder zFEC2 Response Status Code and Error: [%s %s] %s; Attempts remaining: %sz.EC2 Response Status Code and Error: [%s %s] %sr )8r �get�awsr/ �AWS_MAX_RETRIES�copy�datetime�utcnow�strftime� get_location�format�urllib�parse�urlparse�netloc�path�logr? �debug�stripr �utilsZ hashutilsZ sha256_digest�DEFAULT_EC2_API_VERSION�sortedr& �map� urlencode�zip�replacer; r6 r4 r5 r7 r8 � hexdigest�tracer Z status_coder# Zraise_for_status� exceptions� HTTPError�ETZ fromstring�response�contentr$ �EC2_RETRY_CODES�sleep_exponential_backoff� enumerater! r" r' )6rF �setname� requesturlr+ � return_url� return_root�providerr< Z access_key_idZsecret_access_key�token�attemptsZparams_with_headers� timestampr= Z endpoint_pathZ endpoint_err�method�regionZserviceZ canonical_uri�host�tZamz_dateZ datestampZcanonical_headersZsigned_headersZ payload_hashrA �keys�valuesZ querystringZcanonical_request� algorithmZcredential_scopeZstring_to_signZkDateZkRegionZkServiceZ signing_keyZ signatureZauthorization_headerrE �result�exc�rootr, Zerr_coderf r- �idxr* r) �retr r r �query sl � � �������� � �������� �� ���������� � � �� �� � � �� � � r �X � r � c C s� |du rd}|du r i }|} t �dt|d �t|d �� | |i |��}|du r<t �d|� |d8 }|d kr;td ��n|durB|S |d k rVtd �t|d �t|d ����t�|� ||8 }|dkru||9 }||kro|d }t �d |� q) a� Helper function that waits for a spot instance request to become active for a specific maximum amount of time. :param update_callback: callback function which queries the cloud provider for spot instance request. It must return None if the required data, running instance included, is not available yet. :param update_args: Arguments to pass to update_callback :param update_kwargs: Keyword arguments to pass to update_callback :param timeout: The maximum amount of time(in seconds) to wait for the IP address. :param interval: The looping interval, i.e., the amount of time to sleep before the next iteration. :param interval_multiplier: Increase the interval by this multiplier after each request; helps with throttling :param max_failures: If update_callback returns ``False`` it's considered query failure. This value is the amount of failures accepted before giving up. :returns: The update_callback returned data :raises: SaltCloudExecutionTimeout Nr Tz@Waiting for spot instance reservation. Giving up in 00:%02d:%02d�< FzXupdate_callback has returned False which is considered a failure. Remaining Failures: %sr r z\Too many failures occurred while waiting for the spot instance reservation to become active.zBUnable to get an active spot instance request for 00:{:02d}:{:02d}z2Interval multiplier in effect; interval is now %ss) rW rX �intr r rQ �time�sleep�info) Zupdate_callback� update_argsZ update_kwargs�timeout�interval�interval_multiplier� max_failuresZdurationr, r r r �_wait_for_spot_instance� sL ����� �r� c C s@ | dkrt d��ddddd�dd d d d�d �d d ddd d�iddddd�ddddd�ddddd�d d d d d�d d!d"d#d�d$dd%dd�d&dd'dd�d(dd)dd�d*d d+d d�d,d-d.d#d�d/� d0dd1d2d�d3dd4d5d�d6d d7d8d�d9d!d:d;d�d<�d=dd>dd�d?d-d@d#d�dA�dBddCd5d�dDd-dCdEd�dFdGdCdHd�dI�dJddKd2d�dLddMd5d�dNd dOd8d�dPd-dQd;d�dR�dSdTdUdVd�dWdXdYdZd�d[d\dCd]d�d^d_dCd2d�d`dadCd5d�dbdcdCd8d�dddedCd;d�dfdgdCdEd�dhdidjdd�dkdldmd2d�dndodpd5d�dqdrdsd8d�dtdud.d;d�dv� dwdwdxd@d;d�idydydzd{d|d�ii d}d}d~dCdd��d�d�d~dCd�d��d�d�d~dCd�d��d�d�ddCd�d��d�d�ddCd�d��d�d�ddCd�d��d�d�ddCd�d��d�d�dd�d�d��d�d�ddd�d��d�d�ddd�d��d�d�d d d�d��d�d�d�d"d�d��d�d�dGd�d�d��d�d�d~d�dd��d�d�dd�dd��d�d�dd�dd��d�d�dd�d d��d�� }|S )�z� Return a dict of all available VM sizes on the cloud provider with relevant data. Latest version can be found at: http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-types.html �actionz^The avail_sizes function must be called with -f or --function, or with the --list-sizes option� cc2.8xlargez816 (2 x Intel Xeon E5-2670, eight-core with hyperthread)z3360 GiB (4 x 840 GiB)z60.5 GiB)r ZcoresZdiskZram� cc1.4xlargez48 (2 x Intel Xeon X5570, quad-core with hyperthread)z1690 GiB (2 x 840 GiB)z22.5 GiB)r� r� z cg1.4xlargezT8 (2 x Intel Xeon X5570, quad-core with hyperthread), plus 2 NVIDIA Tesla M2050 GPUsz1680 GiB (2 x 840 GiB)�c4.large�2zEBS - 500 Mbpsz3.75 GiB� c4.xlarge�4zEBS - 750 Mbpsz7.5 GiB� c4.2xlarge�8zEBS - 1000 Mbpsz15 GiB� c4.4xlargeZ16zEBS - 2000 Mbpsz30 GiB� c4.8xlargeZ36zEBS - 4000 Mbpsz60 GiB�c3.largez32 GiB (2 x 16 GiB SSD)� c3.xlargez80 GiB (2 x 40 GiB SSD)� c3.2xlargez160 GiB (2 x 80 GiB SSD)� c3.4xlargez320 GiB (2 x 160 GiB SSD)� c3.8xlargeZ32z640 GiB (2 x 320 GiB SSD)) r� r� r� r� r� r� r� r� r� r� � d2.xlargez"6 TiB (3 x 2 TiB hard disk drives)z30.5 GiB� d2.2xlargez#12 TiB (6 x 2 TiB hard disk drives)z61 GiB� d2.4xlargez$24 TiB (12 x 2 TiB hard disk drives)z122 GiB� d2.8xlargez$24 TiB (24 x 2 TiB hard disk drives)z244 GiB)r� r� r� r� � g2.2xlargez60 GiB (1 x 60 GiB SSD)� g2.8xlargez240 GiB (2 x 120 GiB SSD))r� r� � p2.xlargeZEBS� p2.8xlargez488 GiB� p2.16xlargeZ64z732 GiB)r� r� r� � i2.xlargezSSD (1 x 800 GiB)� i2.2xlargezSSD (2 x 800 GiB)� i2.4xlargezSSD (4 x 800 GiB)� i2.8xlargezSSD (8 x 800 GiB))r� r� r� r� � x1.16xlargez64 (with 5.45 ECUs each)z1920 GiB (1 x 1920 GiB)z976 GiB� x1.32xlargez128 (with 2.73 ECUs each)z3840 GiB (2 x 1920 GiB)z1952 GiB�r4.largez2 (with 3.45 ECUs each)z 15.25 GiB� r4.xlargez4 (with 3.35 ECUs each)� r4.2xlargez8 (with 3.35 ECUs each)� r4.4xlargez16 (with 3.3 ECUs each)� r4.8xlargez32 (with 3.1 ECUs each)� r4.16xlargez64 (with 3.05 ECUs each)�r3.largez2 (with 3.25 ECUs each)z32 GiB (1 x 32 GiB SSD)� r3.xlargez4 (with 3.25 ECUs each)z80 GiB (1 x 80 GiB SSD)� r3.2xlargez8 (with 3.25 ECUs each)z160 GiB (1 x 160 GiB SSD)� r3.4xlargez16 (with 3.25 ECUs each)z320 GiB (1 x 320 GiB SSD)� r3.8xlargez32 (with 3.25 ECUs each)) r� r� r� r� r� r� r� r� r� r� r� r� r� z cr1.8xlargez'16 (2 x Intel Xeon E5-2670, eight-core)z hs1.8xlargez 16 (8 cores + 8 hyperthreads)z$48 TiB (24 x 2 TiB hard disk drives)z117 GiBzt2.nano�1z512 MiBzt2.microz1 GiBzt2.smallz2 GiBz t2.mediumz4 GiBzt2.largez8 GiBz t2.xlargez16 GiBz t2.2xlargez32 GiBzm4.largezEBS - 450 Mbpsz m4.xlargez m4.2xlargez m4.4xlargez64 GiBz m4.10xlargeZ40z160 GiBz m4.16xlargezEBS - 10000 Mbpsz256 GiBz m3.mediumz SSD (1 x 4)zm3.largez SSD (1 x 32)z m3.xlargez SSD (2 x 40)z m3.2xlargez SSD (2 x 80)) zCluster Computez Cluster CPUzCompute Optimizedz Dense StorageZGPUz GPU ComputezHigh I/Oz High MemoryzHigh-Memory Clusterz High StoragezGeneral Purpose)r )�call�sizesr r r � avail_sizes) s� ������ �����������@����� ������������ ��������������Q�� ������� � ������ ��#��)��/��5��;��A��G��M�� � �� er� c C s� |dkrt d��t| t�si } d| v r| d }n t� }tjd|tdd�}i }d|d�}tj|t � t � tdd �}|D ]}|||d < q9|S ) zI Return a dict of all available VM images on the cloud provider. r� z`The avail_images function must be called with -f or --function, or with the --list-images option�owner�amazon��default�DescribeImages)�ActionZOwnerr� �r+ ro �opts�sigver�imageId) r r% �dictr r �get_cloud_config_valuer rJ r rP � get_provider)�kwargsr� r� ro r~ rF �images�imager r r � avail_images� s0 � � �r� c C s4 t jj�t�d| t�| tt jj�t jj�t| ���S )z- Return the script deployment object �script) r rZ �cloudZ os_scriptr r� r Zsalt_config_to_yamlZ minion_config��vm_r r r r� � s ��r� c C � t jd| tdd�S )z Return the keyname �keynameF�� search_global�r r� r r� r r r r� � s r� c C r� )z# Return the security group � securitygroupFr� r� r� r r r r� � � �r� c C r� )aX Return the IAM profile. The IAM instance profile to associate with the instances. This is either the Amazon Resource Name (ARN) of the instance profile or the name of the role. Type: String Default: None Required: No Example: arn:aws:iam::111111111111:instance-profile/s3access Example: s3access � iam_profileFr� r� r� r r r r� � s �r� c C s0 t jd| tddd�}|dvrt�d|� d}|S )zj Return the ssh_interface type to connect to. Either 'public_ips' (default) or 'private_ips'. � ssh_interface� public_ipsF�r� r� )r� � private_ipsziInvalid ssh_interface: %s. Allowed options are ("public_ips", "private_ips"). Defaulting to "public_ips".)r r� r rW �warning)r� r~ r r r r� � s ��r� c C s� t jd| tddd�}t|t�sdS d|i}t jd| tddd�|d< t jd| tddd�|d< t jd| tddd�|d < t jd | tddd�|d < t jd | tddd�|d < |d }|durftj�|�sftd � |���|du rr|d srtd ��|S )z/ Return the ssh_gateway configuration. � ssh_gatewayNFr� Zssh_gateway_portZssh_gateway_usernameZssh_gateway_userZssh_gateway_private_keyZssh_gateway_keyZssh_gateway_passwordZssh_gateway_commandz7The defined ssh_gateway_private_key '{}' does not existzYNo authentication method. Please define: ssh_gateway_password or ssh_gateway_private_key) r r� r r% �str�osrV �isfiler rQ )r� r� �ssh_gateway_config� key_filenamer r r �get_ssh_gateway_config sB � � � � � ����r� c C s" t �dtjd| p t� t tdd��S )z� Return the EC2 region to use, in this order: - CLI parameter - VM parameter - Cloud profile setting r+ Fr� )r rI r r� r r. r� r r r rP E s ��rP c C s\ | dkrt d��i }ddi}tj|t� t� tdd�}|D ]}|d |d d �||d < q |S ) z& List all available locations r� zfThe avail_locations function must be called with -f or --function, or with the --list-locations optionr� ZDescribeRegionsr� r� Z regionNameZregionEndpoint)r( r= )r rJ r rP r� r )r� r~ rF rz rt r r r �avail_locationsX s$ ���r� c C sZ t jd| tdd�}|du rdS t| �}||vr td�|���|| dkr+td�|���|S )z- Return the availability zone to use Zavailability_zoneFr� Nz?The specified availability zone isn't valid in this region: {} � availablez>The specified availability zone isn't currently available: {} )r r� r �list_availability_zonesr rQ )r� ZavzZzonesr r r �get_availability_zonev s& ��� ��r� c C r� )zq Returns the Tenancy to use. Can be "dedicated" or "default". Cannot be present for spot instances. ZtenancyFr� r� r� r r r � get_tenancy� s r� c s� t jd| tdd�}|�d�r|S ttd�si t_n |tjv r#tj| S dd|d�}d d � � ttj |t � t � td d �t � fd d ��d�d d }|tj|< |S )z$ Returns the ImageId to use r� Fr� zami-r� r� r( �r� z Filter.0.NamezFilter.0.Value.0c S s t j �| d d�S )NZ creationDatez%Y-%m-%dT%H:%M:%S.%fZ)rM �strptime)�xr r r �<lambda>� s �z get_imageid.<locals>.<lambda>r� r� c s t jj�� | �� |��S r )r rZ �compat�cmp)�i�j�Z_tr r r� � s )r ���r� ) r r� r � startswith�hasattr� get_imageidr� r\ rJ r rP r� r )r� r� rF �image_idr r� r r� � s8 ��� � � r� c C s� ddi}t j|t� t� tdd�D ]:}d|v rJ|�di ��dg �}t|t�s(|g}|D ] }|d dkrI|d | krIt� d | |d � |d S q*qd S ) z5 Returns the SubnetId of a SubnetName to use r� �DescribeSubnetsr� r� �tagSetr* r �Namer zAWS Subnet ID of %s is %s�subnetIdN) rJ r rP r� r rI r% r& rW rX )� subnetnamerF �subnet�tagsr! r r r �_get_subnetname_id� s( � ��r� c C s< t jd| tdd�}|r |S t jd| tdd�}|r t|�S dS )z% Returns the SubnetId to use �subnetidFr� r� N)r r� r r� )r� r r� r r r � get_subnetid� s ��r c C st t � }t| t�s | g} ddi}tj|t� t� tdd�D ]}|d | v r5t� d|d |d � |� |d � qt|�S )zC Returns the SecurityGroupId of a SecurityGroupName to use r� �DescribeSecurityGroupsr� r� � groupName� AWS SecurityGroup ID of %s is %s�groupId) �setr% r& rJ r rP r� r rW rX �add)�securitygroupname_list�securitygroupid_setrF �sgr r r �_get_securitygroupname_id� s$ � ��r c C s� t � }tjd| tdd�}|r|�t |��}tjd| tdd�}|rSt|t�s(|g}ddi}tj|t � t � tdd�D ]}|d |v rRt � d |d |d � |� |d � q8t|�S ) z% Returns the SecurityGroupId �securitygroupidFr� �securitygroupnamer� r r� r� r r r )r r r� r �unionr% r& rJ r rP r� rW rX r )r� r Zsecuritygroupid_listr rF r r r r r s6 �� � ��r c C r� )z+ Returns the PlacementGroup to use ZplacementgroupFr� r� r� r r r �get_placementgroup) r� r c C r� )zE Returns the spot instance configuration for the provided vm � spot_configFr� r� r� r r r �get_spot_config2 r� r c C s> | du r t � pd}n| �dd�}d|v r |�d�}|d }|S )z+ Extract the provider name from vm Nr ro �:r )r rI r" )r� ro Z prov_compsr r r r� ; s r� c C sL i }ddt | �d�}tj|t | �t� tdd�}|D ] }|d ||d < q|S )z; List all availability zones in the current region ZDescribeAvailabilityZonesz region-namer� r� r� Z zoneStateZzoneName)rP rJ r r� r )r� r~ rF rz �zoner r r r� J s ��r� c C r� )z� Return the block device mapping: .. code-block:: python [{'DeviceName': '/dev/sdb', 'VirtualName': 'ephemeral0'}, {'DeviceName': '/dev/sdc', 'VirtualName': 'ephemeral1'}] �block_device_mappingsTr� r� r� r r r r c s �r c C sV ddi}| � dd�|d< tj|dt|�t� tdd�}|D ] }d |v r(|d S q d S ) z' Request and return Elastic IP r� ZAllocateAddress�domainZvpcZDomainTr� �rn r+ ro r� r� Z allocationIdN)� setdefaultrJ r rP r� r )� interfacer� rF ZeipsZeipr r r � _request_eipq s � �r c C s� d| v r| d dur| d | d d�S ddi}t j|dt|�t� tdd �}d | vr5d | v r5t| d �| d < d | vrEd | v rEt| d �| d < t|| �}|sVtd� | � d ����d |i}dD ] }|| v rh| | ||< q\dD ]}|| v r{|� t || | �� qkd| v r�dD ] }|| v r�| | ||< q�| � dd�|d< |S d|d< t j|dt|�t� tdd �}|d }|r�|� d�s�t d� |���|� d�}t�d|| d � | � dd�} t| t�r�t|| |d� | � d �r�t|| � d �|d� nD| � d �r�t| |�} t|| |d� n2| � d ��r1t|�} g } t| �D ] \} }| �t| |�� �qt| �D ]\} }t|| | ||d� �q!d | v �rWd |d | d d!�}t j|dt|�t� tdd �}d"|v �rWt�d#� | d |d�S )$z_ Create an Elastic Interface if necessary and return a Network Interface Specification �NetworkInterfaceIdN� DeviceIndex)r r r� r� Tr� r �SecurityGroupIdr �SubnetIdr� zNo such subnet <{}>)� Description�PrivateIpAddressZ SecondaryPrivateIpAddressCount)ZPrivateIpAddressesr �AssociatePublicIpAddress)r r r � delete_interface_on_terminate�DeleteOnTerminationZCreateNetworkInterfacer �networkInterfaceIdz Failed to create interface: {}z$Created network interface %s inst %sFr� Z associate_eipZallocate_new_eipZallocate_new_eipsr� � CreateTags)r� z ResourceId.0z Tag.0.Keyz Tag.0.Valuer? z#Failed to set name of interface {0})rJ r rP r� r r r� � _get_subnet_id_for_interfacer rQ rI �update�_param_from_configr rW rX r% r� � _associate_eip_with_interfacer � _list_interface_private_addrsrj r' r? )r r� rF � subnet_query� subnet_id�krz �eni_desc�eni_idZassociate_public_ipZ_new_eipZ addr_listZeip_listr} �addrZ tag_paramsZ tag_responser r r �_create_eni_if_necessary� s� �� � � �� ��� �� r0 c C sp | D ]3}d|v r5t |d t�r t|d |�}|d ur | S q|d D ]}t||�}|d ur4| S q#qd S )Nr* )r% r� � _get_subnet_from_subnet_query)r* r Zsubnet_query_resultr+ r� r r r r% � s �� ���r% c C s: d| v r|� d�r| d |d kr| d S d S | d S d S )Nr� r )rI )r* r r r r r1 s ��r1 c C sr | � d�}|s dS |g}| � di �� dg �}t|t�s |S |D ]}|� d�dkr)q |� d�r6|�|� d�� q |S )z� Returns a list of all of the private IP addresses attached to a network interface. The 'primary' address will be listed first. �privateIpAddressNZprivateIpAddressesSetr* �primary�true)rI r% r& r' )r- r3 Z addresses�lst�entryr r r r) s �r) c C sz t |t�s td��d| d�}|�� D ]\}}|||< qtj|dt|�t� tdd�}t |t�r;|� d�r;td� | |���|S ) z` Change properties of the interface with id eni_id to the values in properties dict z#ENI properties must be a dictionaryZ ModifyNetworkInterfaceAttribute)r� r Tr� r r? z1Could not change interface <{}> attributes <'{}'>) r% r� r r- rJ r rP r� r rI rQ )r. Z propertiesr� rF r, �vrz r r r �_modify_eni_properties( s( � ��r8 c C sn d| |d�}|r ||d< t j|dt|�t� tdd�}|d �d�s)td �|| ���t� d || � |d �d�S ) a� Accept the id of a network interface, and the id of an elastic ip address, and associate the two of them, such that traffic sent to the elastic ip address will be forwarded (NATted) to this network interface. Optionally specify the private (10.x.x.x) IP address that traffic should be NATted to - useful if you have multiple IP addresses assigned to an interface. ZAssociateAddress)r� r Z AllocationIdr Tr� r � Z associationIdzGCould not associate elastic ip address <{}> with network interface <{}>z1Associated ElasticIP address %s with interface %s) rJ r rP r� r rI r rQ rW rX )r. Zeip_idZ private_ipr� rF rz r r r r( G s* �� �r( c C sF i }g }| D ] }d|v r"|d |v rt �d� d S ||t|d �< q|d d d d d }t|t�rE|D ] }|�|d |d f� q6n |�|d |d f� |D ]N\}} d } d || d v ri|| d d } nd || d v ry|| d d } | d | d�} t|| |d�} d|| d v r�d|| d d i} t|| |d�}qRd S )Nr z5Duplicate DeviceIndex in profile. Cannot update ENIs.r � instancesSetr* ZnetworkInterfaceSetr# � attachmentTr" Z deviceIndexr! Z attachmentId)zAttachment.AttachmentIdz Attachment.DeleteOnTerminationr� ZSourceDestCheckzSourceDestCheck.Value)rW r? r� r% r& r' r8 )Z interfaces�instancer� Z config_enisZ instance_enisr Z query_enisZ query_enir. Zeni_dataZdelete_on_terminateZparams_attachmentZ set_eni_attachment_attributesZparams_sourcedestZset_eni_sourcedest_propertyr r r � _update_enisn sZ � ��� � ��� ����r= c C s� i }t |t�r |�� D ]\}}|�td�| |�|�� q |S t |t�s(t |t�rAt|�D ]\}}d�| |�}|�t||�� q,|S t |t �rS|�| t |�� � i� |S |�| |i� |S )aW Return EC2 API parameters based on the given config data. Examples: 1. List of dictionaries >>> data = [ ... {'DeviceIndex': 0, 'SubnetId': 'subid0', ... 'AssociatePublicIpAddress': True}, ... {'DeviceIndex': 1, ... 'SubnetId': 'subid1', ... 'PrivateIpAddress': '192.168.1.128'} ... ] >>> _param_from_config('NetworkInterface', data) ... {'NetworkInterface.0.SubnetId': 'subid0', ... 'NetworkInterface.0.DeviceIndex': 0, ... 'NetworkInterface.1.SubnetId': 'subid1', ... 'NetworkInterface.1.PrivateIpAddress': '192.168.1.128', ... 'NetworkInterface.0.AssociatePublicIpAddress': 'true', ... 'NetworkInterface.1.DeviceIndex': 1} 2. List of nested dictionaries >>> data = [ ... {'DeviceName': '/dev/sdf', ... 'Ebs': { ... 'SnapshotId': 'dummy0', ... 'VolumeSize': 200, ... 'VolumeType': 'standard'}}, ... {'DeviceName': '/dev/sdg', ... 'Ebs': { ... 'SnapshotId': 'dummy1', ... 'VolumeSize': 100, ... 'VolumeType': 'standard'}} ... ] >>> _param_from_config('BlockDeviceMapping', data) ... {'BlockDeviceMapping.0.Ebs.VolumeType': 'standard', ... 'BlockDeviceMapping.1.Ebs.SnapshotId': 'dummy1', ... 'BlockDeviceMapping.0.Ebs.VolumeSize': 200, ... 'BlockDeviceMapping.0.Ebs.SnapshotId': 'dummy0', ... 'BlockDeviceMapping.1.Ebs.VolumeType': 'standard', ... 'BlockDeviceMapping.1.DeviceName': '/dev/sdg', ... 'BlockDeviceMapping.1.Ebs.VolumeSize': 100, ... 'BlockDeviceMapping.0.DeviceName': '/dev/sdf'} 3. Dictionary of dictionaries >>> data = { 'Arn': 'dummyarn', 'Name': 'Tester' } >>> _param_from_config('IamInstanceProfile', data) {'IamInstanceProfile.Arn': 'dummyarn', 'IamInstanceProfile.Name': 'Tester'} z{}.{}) r% r� r- r& r' rQ r& �tuplerj �boolr� �lower)r r, �paramr, r7 r} Z conf_item�prefixr r r r' � s 3 � ��r' c 0 s� |dkrt d��| �dt| ��}t| �}|dur9d|vr%t d�| d ���dd d |v r/|d nd |d d �}d }n tjd| tddd�}tjd| tddd�}d||d�}d}t| �}|||d < d} tjd| tddd�} | du rztjd| tddd�} n-t � d| � t j � | �r�tjj�| d��} tjj�| �� �} W d � n1 s�w Y tjj�t| | �} | dur�zt�tjj�| ��||d < W n ty� } z t �d | � W Y d} ~ nd} ~ ww tjd | tdd �} | ||d < t | �}|r�|||d < t | �}|�r t |t ��s |||d! < nt |�D ]\}}|||d"�|� < �qt!| �}|�rHz|�"d#��r4|||d$ < n|||d% < W n t#�yG t$d&��w t%| �}|du�rW|||d' < t&| �}|du�rr|du�rnt$d(�| d ���||d)< t'| �}|du�r�|||d* < t(| �}|�r�t |t ��s�|||d+ < nt |�D ]\}}|||d,�|� < �q�t)| �}|du�r�|||d- < t*| �}|�r�|D ] }d.|v �r�|�+d.� �q�|}|�r�|�,t-|d/ |�� tjd0| tdd �}|�r g } |D ]} t �.d1| � t/| | �} | �0| � �q�|�,t-|d2 | �� tjd3| tdd �} | du�r)t | t1��s#t$d4��| ||d5 < tjd6| tdd �} tjd7| tdd �}!|!du�rTt |!t1��sJt$d8��|�,t-|d9 |!�� | �rat | t1��sat$d:��| | d;< | �rGt �2d<|| d � d=|d>�}"z t3j4|"t| �t5� td?d@�}#dA|#v �r�|#dA W S t �.dB|#� W n t�y� } zt j6dC|| d | t7j8dD� � d} ~ ww |#�s�dE�|�}$t |$��d}%d}&dF|#dG v �r�|#dG dF du�r�|#dG dF dH }'t |'t ��r�|'dG }'|'dI }%|'dJ �dKd�}&t �2dL|%� |%du�rG|�rdMdN� |D �}(ng }(|%|(v �r|(�9|%�})n t:|(�})|%|dO�||)�< dP�||)�}*t;| ��<� ||*< |�rG|)t:|�k �rGdQ||) v�rGdR�||)�}+|&||+< tjdS| tddd�},|,�r^t |,t1��s^t$dT��t=dU dVdWdX�| d �t=dY dZ|t |��|d[�td\ td] d^� t5| �� zt3j4|d_|� td?d@�}-dA|-v �r�|-dA W S W n t�y� } z t j6d`| d | t7j8dD� � d} ~ ww |�rV|-dG da }.|.| db< � fdcdd�}/t=dU dVdedf�| d �td\ td] dg� z3t>|/|.|ftjdh| tdidj�tjdk| tdldj�tjdm| tddj�tjdn| tdodj�dp�}-t �.dq|-� W |-| fS t?t@f�yU } z8z1zdr|.ds�}t3j4||� td?d@�}-t �.dt|.|-� W n t �y< Y nw W t t;| ���W t t;| ���t t;| ���d} ~ ww |-| fS )uz� Put together all of the information necessary to request an instance on EC2, and then fire off the request the instance. Returns data about the instance �functionz?The request_instance action must be called with -a or --action.r+ NZ spot_pricez<Spot instance config for {} requires a spot_price attribute.r( ZRequestSpotInstancesr� �typezone-time)r� Z InstanceCountZTypeZ SpotPricezLaunchSpecification.� min_instanceFr �r� r� � max_instanceZ RunInstances)r� ZMinCountZMaxCountr> ZImageId� userdata_file�userdatazuserdata_file: %s�rZUserDataz Failed to encode userdata: %s�sizer� Z InstanceType�KeyNamezSecurityGroup.1zSecurityGroup.{}z arn:aws:iam:zIamInstanceProfile.ArnzIamInstanceProfile.Namez''iam_profile' should be a string value.zPlacement.AvailabilityZonez@Spot instance config for {} does not support specifying tenancy.zPlacement.Tenancyr zSecurityGroupId.1zSecurityGroupId.{}zPlacement.GroupNamer! �BlockDeviceMapping�network_interfacesz Create network interface: %sZNetworkInterfaceZ ebs_optimizedz*'ebs_optimized' should be a boolean value.Z EbsOptimizedZdel_root_vol_on_destroyZtermination_protectionz3'termination_protection' should be a boolean value.ZDisableApiTerminationz4'del_root_vol_on_destroy' should be a boolean value.�set_del_root_vol_on_destroyz?Attempting to look up root device name for image id %s on VM %sr� )r� � ImageId.1r� r� r? zEC2 Response: '%s'z=Error getting root device name for image id %s for VM %s: %s)Zexc_info_on_loglevelzSThere was an error querying EC2 for the root device of image id {}. Empty response.�blockDeviceMappingr r* � deviceName�ebsZ volumeTypezFound root device name: %sc S s g | ]}|d �qS )� DeviceNamer )�.0�devr r r � <listcomp>� s z$request_instance.<locals>.<listcomp>z"{}BlockDeviceMapping.{}.DeviceNamez/{}BlockDeviceMapping.{}.Ebs.DeleteOnTerminationzEbs.VolumeTypez&{}BlockDeviceMapping.{}.Ebs.VolumeType�del_all_vols_on_destroyz4'del_all_vols_on_destroy' should be a boolean value.�cloud.fire_event�eventzrequesting instancezsalt/cloud/{}/requesting�cloud.filter_eventZ requesting)r� r+ �sock_dir� transport��argsr\ r] r: zGError creating %s on EC2 when trying to run the initial deployment: %s�spotInstanceRequestId� spotRequestIdc s� d| d�}t j||� tdd�}|st�d� dS t|t�r+d|v r+t�d|d � dS t�d |� |d � d �}|d kr>|S |d krPt� d|d d d � d S |dv r[t�d� dS d S )NZ DescribeSpotInstanceRequests�r� zSpotInstanceRequestId.1r� r� �5There was an error while querying EC2. Empty responseFr? �#There was an error in the query. %s�Returned query data: %sr �stateZactive�openzSpot instance status: %s�status�message)Z cancelledZfailed�closedzKSpot instance request resulted in state '{0}'. Nothing else we can do here.) rJ r r rW r? r% r� r� rX rI r� )�sir_idr+ rF r, rf �ro r r � __query_spot_instance_requestJ s2 � � ��z7request_instance.<locals>.__query_spot_instance_requestzwaiting for spot instancez salt/cloud/{}/waiting_for_spot)r\ r] Zwait_for_spot_timeoutr� r� Zwait_for_spot_intervalr� Z!wait_for_spot_interval_multiplierZwait_for_spot_max_failuresr� )r� r� r� r� r� z wait_for_spot_instance data %s�CancelSpotInstanceRequestsrb z4Canceled spot instance request %s. Data returned: %s)Ar rI rP r rQ r r� r r� rW rb r� rV �existsr rZ �files�fopen� stringutils� to_unicode�readr� Zuserdata_template�base64� b64encode�to_bytes� Exception� exceptionr� r� r% r& rj r� r� r r r� r� r r r r �popr& r' rX r0 r' r? r� rJ r r� r? �logging�DEBUG�indexr r� r@ � __utils__r� r r )0r� r� r+ r rF Z spot_prefixrE rG r� rI rH �fh_r{ Zvm_sizeZ ex_keynameZex_securitygroupZcounterZsg_Zex_iam_profileZaz_Ztenancy_Z subnetid_Zex_securitygroupidZplacementgroup_�blockdevicemappings_holder�_bdZex_blockdevicemappingsrN Z eni_devicesr Z_new_eniZset_ebs_optimizedrO Zset_termination_protectionZ rd_paramsZrd_data�err_msgZrd_nameZrd_typer* Zdev_listZ dev_indexZtermination_keyZtype_keyZset_del_all_vols_on_destroyr, rk rm r rl r �request_instance� s� ���� � �� � � � ��� �� � ���� � �� ������ � ��� � � ���� ��� ���� ���� & ������ ������ ���r� c s" |dkrt d���d }��dt���� td ddd��d �d|itd td d � t�d |� d|d�}t���d}|t j k r�t j |� �tddd�\}}t�d|� t |t �rgd|v rgt�d||d � nt |t�ru|sut�d|� nnt �|� |d7 }q<t d�|d ���� ��fdd�}z%tjjj|||ftjd �td d �tjd �td d �tjd!�tdd �d"�}W n5 ttfy� } z'z zt�d � W n t y� Y nw W t t|���W t t|���t t|���d#}~ww d$�v �r�d$ du �rtd dd%d&��d �d'|itd td d � |S )(z: Query an instance upon creation from the EC2 API rC z=The query_instance action must be called with -a or --action.� instance_idr+ rY rZ zquerying instancezsalt/cloud/{}/queryingr( r\ r] r^ z The new VM instance_id is %s�DescribeInstances�r� � InstanceId.1r Tr� )r+ ro r� rm r� zThe query returned: %sr? z:There was an error in the query. %s attempts remaining: %sz4Query returned an empty list. %s attempts remaining.r z'An error occurred while creating VM: {}c s� t j| � �tdd�}|st�d� dS t|t�r&d|v r&t�d|d � dS t�d|� t ��dkrCd |d d d v r>|S t�d � t ��dkr\d|d d d v rU|S t�d� d S d S )Nr� r� rc Fr? rd re r� � ipAddressr r: r* zPublic IP not detected.r� r2 zPrivate IP not detected.) rJ r r rW r? r% r� r� rX r� )rF �urlr, �r+ ro r� r r �__query_ip_address� s& � �z*query_instance.<locals>.__query_ip_address�wait_for_ip_timeoutr� r� �wait_for_ip_intervalr� � wait_for_ip_interval_multiplier�r� r� r� r� N�reactorzinstance queriedzsalt/cloud/{}/query_reactorr, )r rI rP r~ rQ r rW rX r� rJ rK r r% r� r� r& ri r rZ r� � wait_for_ipr r� r r �destroyr� ) r� r� r� rF rq r, rl r� r{ r r� r �query_instance� s� � � � �� � ��� � �� ��� � r� c C s4 |dkrt d��| du ri } |du ri }| �dt| ��}td ddd�| d �d |itd td d � t�d| td�}t�d| td�}t�d| t��rtjd| tdd�}tjd| tdd�} tjd| tdd�} tjd| tdd�} tjd | td d�} tjd | td d�} | r�| d kr�t� d!� t | d d"| d# id$d%�}|�d&d�} | du r�t� |� t � d'� n|}d(|d&< d(|d)< t� |� | | d< nq�t jjj|d*|d+�s�t d,��| s�t� d-� t jjj||| | | d.�s�t d/���n tjd0| td1d�}t jjj|||d+��st d2��t� d3� t jjj|||| || d4��st d5��n�t jjj||||d6��r�tjd7| tdd�}|�r�i }d8|v�rTt| d9 d$t| �d:�}t�|� t � d;� d8|v�s:t jj�|d8 �}|�d<�}t|�d=k �rkd S |d �d>�}d}|d? �� D ]}|�s��qz|d@�||�7 }�qzt jj� |dA��}|� t jj� |�� W d � n 1 �s�w Y |� � | dB D ]5}t jjj |||tjdC| td'd�| dD ||tjdE| tdFd�tjd7| tdGd�dH� �r�|tdI< || dI< n�q�t dJ��nt dK��dL| v �r| dL d u �rtd ddMdN�| d �d |itd td d � | S )OzR Wait for an instance upon creation from the EC2 API, to become available rC z@The wait_for_instance action must be called with -a or --action.N�gatewayrY rZ zwaiting for sshz salt/cloud/{}/waiting_for_sshr( � ip_addressr\ r] r^ �ssh_connect_timeouti� �ssh_port� Z win_installerZ win_usernameZ Administratorr� � win_passwordr> �win_deploy_auth_retriesr� �win_deploy_auth_retry_delayr � use_winrmF�winrm_verify_sslT�autoz/Waiting for auto-generated Windows EC2 password�key_file� private_keyr� �r( r� r� �passwordr� zXXX-REDACTED-XXX� passwordDatai� )�portr� z(Failed to connect to remote windows hostz+Trying to authenticate via SMB using psexec)ZretriesZ retry_delayz8Failed to authenticate against remote windows host (smb)� winrm_portib z0Failed to connect to remote windows host (winrm)z.Trying to authenticate via Winrm using pywinrm)r� Zverifyz2Failed to authenticate against remote windows host)r� r� r� �known_hosts_file�output_decodedr� �r� r� r+ � z!-----BEGIN SSH HOST KEY KEYS-----r9 z -----END SSH HOST KEY KEYS-----r z {} {}�a� usernamesZwait_for_passwd_timeoutr� Zwait_for_passwd_maxtries� z /dev/null) ru r� �usernameZ ssh_timeoutr� �display_ssh_outputr� Zmaxtriesr� Z ssh_usernamez)Failed to authenticate against remote sshz Failed to connect to remote sshr� zssh is availablez salt/cloud/{}/ssh_ready_reactor)!r rI r� r~ rQ r r r� rW rX �get_password_datar� r� r rZ r� Z wait_for_portZvalidate_windows_credZwait_for_winrm�get_console_outputrP �pprintrr rs r" r � splitlinesrp rq �writeZto_str�closeZwait_for_passwd)r� r, r� r� r� r� r� r� r� Z win_passwdr� r� r� r� Z password_dataZ logging_datar� r� Zconsole�outputr) rw �lineZfp_�userr r r �wait_for_instance% sN � � ������� � �� ������ ��� � � � � � ������ � r� c C sV | d u rt d��tj�| �st d�| ���t�t�| �j�}|dvr)t d�| ���dS )NzRThe required 'private_key' configuration setting is missing from the 'ec2' driver.z&The EC2 key file '{}' does not exist. )� i� z<The EC2 key file '{}' needs to be set to mode 0400 or 0600. T)r r� rV ro rQ �stat�S_IMODE�st_mode)r� Zkey_moder r r �_validate_key_path_and_mode� s � ���r� c $ C s |rt d��z| d r tjtt� pd| d | d�du r W dS W n ty( Y nw tjd| tdd�}tjd | td d�}tjd | tdd d �}|rKt|� td ddd� | d �td d| g d��td td d� td | d | d d| d � || d< || d < t | �| d < t | �}|| d < t � d | d |� tjjj| td d �| d!< d"| v r�d#| vr�d$| vr�t �d%| d � tjj�tj�d&| t��\| d$< | d#< nCt| �d u r�t d'��t| |�\}} t|t�r�t �d(|� i S g | d)< |D ] }| d) �|d* � q�| d) �� | d"< | d) �r t| d) � t | �}tjd+| ti dd,�}t|t ��s%t d-��|� � D ] } t| t��s5t d.���q)| d |d/< td dd0d1� | d �d2|itd td d� tjjj t!d3| d || d" d4|d5� d6| v �r�d+| d6 v �r�t| d6 d+ t ��s�t d-��| d6 d+ � � D ] } t| t��s�t d.���q�i } d7| v�r�t d8��| d7 } | d | d/< | d6 d+ �"� D ] \} } | | | < �q�td dd0d9� | �d2| itd td d� tjjj t!d3| d | | d4|d5� tjd:| tdd,�}|�r�t#||| � t � d;| d � |d< d= d> }t$| �d?k�r|d@ }t � dA|� n |dB }t � dC|� || dD< tjj�%| t�d?k�r:|d@ }t � dE|� n |dB }t �dE|� || dF< |�r[tjdG| tdd�}t&| |||�} |�'� }tjdH| tdd,�}|�r�td ddIdJ� | d �dH|itd td d� t � dK| d � t(| d ||dL dM |d* | �)dNd�dO�d4dP�}||dQ< tjdR| td dd,�}|�r�t �dS|� t*| d dR|i| d" d4dT�}t|t ��r�|�)dUd ��r�t �dV| d" |� i S tdW | t��"� D ] \}} |�+|| � �q�t � dX| d � t �dY| d t,�-|�� | d | d | d | d" dZ�}|�r ||dH< |�r%||dR< td dd[d\� | d �td d]|t.|��td td d� t/| d" d^�}td_ |t� t� |�0|� i }t1| �}|�rs|D ]} d+| v �rq| d+ || d` < �qbi } |�r�|da �"� D ]S\} } g } t| t ��r�| �| � n | D ]}!| �|!� �q�| D ]2}"|"db |v �r�d/||"db v�r�| d ||"db d/< |"db |v �r�||"db | |"|dc dd < �q��q~| �r| �"� D ]+\}#}td dd0de� t|#��d2|itd td d� tdf t!d3| d ||#d4|dg� �q�|S )hz- Create a single VM from a data dict z,You cannot create an instance with -a or -f.�profiler r� F�deployTr� r� r> r� NrF rY rZ zstarting createzsalt/cloud/{}/creatingr( r[ Zcreating)r( r� ro �driverr\ r] r^ zcloud.cachedir_index_addr� r� r� r+ zCreating Cloud VM %s in %s)zec2-userZcentosZubuntuZadminZbitnamir| )Z default_usersr� r� Zpub_keyZpriv_keyz Generating minion keys for '%s'ZkeysizezNThe required 'keyname' configuration setting is missing from the 'ec2' driver.z Error requesting instance: %sZinstance_id_list� instanceIdr! r� z'tag' should be a dict.zR'tag' values must be strings. Try quoting the values. e.g. "2013-09-19T20:09:46Z".r� z setting tagszsalt/cloud/{}/taggingr� r� r� )r� r( r� r� r� r+ r ra z Failed to find spotRequestIdz"salt/cloud/spot_request_{}/taggingrN zCreated node %sr r: r* r� r2 z Salt node data. Private_ip: %sr� z Salt node data. Public_ip: %sZssh_hostzSalt interface set to: %sZ salt_hostr� �volumeszattaching volumesz salt/cloud/{}/attaching_volumesz$Create and attach volumes to node %sZ placementZavailabilityZonerX )r� r r� rX �r� zAttached Volumes� ssm_documentz!Associating with ssm document: %s�r� r� r? z4Failed to associate instance %s with ssm document %szcloud.bootstrapzCreated Cloud VM '%s'z '%s' VM creation details: %s)r( r� ro r� zcreated instancezsalt/cloud/{}/created�created�r� �cloud.cache_noderT rQ rR ZrootDeviceType�volumeIdz"salt/cloud/block_volume_{}/taggingzcloud.wait_for_fun)r� r( r� � resource_idr� r+ )2r r Zis_profile_configuredr r r r� r� r~ rQ r� rP rW r� r rZ r� Z ssh_usernamesrX Zgen_keysr� r� r% r� r? r' rz �queue_instancesr� r� r rx Z wait_for_fun�set_tagsr- r= r� Zget_salt_interfacer� rL �create_attach_volumesrI �ssm_create_associationr r� Zpformatr& � _get_noder& r )$r� r� r� r� r� r+ r, r< r� r Zspot_request_tagsrk r, r7 rN r� Zsalt_ip_addressr� r~ r� r� r� Zassocr Z event_data�nodeZex_blockdevicetagsr� r� Zblock_device_volume_id_mapZ_device�_mapZbd_itemsZmapitemZ blockitemZvolidr r r �create s ���� �� � �� � � �� � �� � � �� �� � �� � �� � ��� � � ���� � � r� c C s* | D ]}t |d�}td |t� t� qdS )a� Queue a set of instances to be provisioned later. Expects a list. Currently this only queries node data, and then places it in the cloud cache (if configured). If the salt-cloud-reactor is being used, these instances will be automatically provisioned using that. For more information about the salt-cloud-reactor, see: https://github.com/saltstack-formulas/salt-cloud-reactor r� r� N)r� r~ r r )� instancesr� r� r r r r� � s �r� c C s� |dkrt d��d|vrt| �d |d< t|d t�r%tjj�|d �}n|d }g }|D ]�}d}d�|d | �}||d d �} d |v rK|d | d < nd |v rV|d | d < nd |v ra|d | d < nt d��d|v ro|d | d< d|v ry|d | d< d|v r�|d | d< d|v r�|d | d< d|v r�|d | d< d | vr�t | d|d�} d}d| v r�| d | d < t | | d |d d�|d dd�} |� dd�} | r�|r�| dur�t |d |d | d � | r�d �| d |d | |d �} t�| � |�| � q-|S ) z3 Create and attach volumes to created node r� zDThe create_attach_volumes action must be called with -a or --action.r� r� r� Fz{} on {}�devicer )� volume_namer � volume_id�snapshotrK zNCannot create volume. Please define one of 'volume_id', 'snapshot', or 'size'r� rD �iops� encrypted�kmskeyidrC )r� �wait_to_finishTr� )r� r� r� rX N)r� r� r z'{} attached to {} (aka {}) as device {})r r� r% r� r rZ �yaml� safe_loadrQ r � create_volume� attach_volumerI �_toggle_delvolrW r� r' )r( r� r� r� r� r~ Zvolumer� r� Z volume_dictZcreated_volume�attachZdelvols_on_destroyr: r r r r� � sz �� � � �� �r� c C �z |dkrt d��t�d| � t| �d }td ddd�| �| |d �td td d � d |d�}tj|t � t � tdd�}|S )z Stop a node r� z3The stop action must be called with -a or --action.zStopping node %sr� rY rZ zstopping instancezsalt/cloud/{}/stopping�r( r� r\ r] r^ Z StopInstancesr� r� r� � r rW r� r� r~ rQ r rJ r rP r� �r( r� r� rF rz r r r �stop� s* � �r� c C r� )z Start a node r� z4The start action must be called with -a or --action.zStarting node %sr� rY rZ zstarting instancezsalt/cloud/{}/startingr� r\ r] r^ ZStartInstancesr� r� r� r� r� r r r �start s. � � �r� c C s� |du ri }|du r t � }|du r;d|v r |d }|d= d|v r'|d }|d= |du r9|du r8t| d|d�d }n|}|du rCddiS d|d �}t�d | |� |rU|sU|}t|�� �D ]\}\} } | |d �|�< | |d �|�< q[d } | tjk r�tj |d|t � t dd� t |d|d�} t�d| � d} | D ]>}|d |vr�q�|� d�du r�|� |d �dkr�q�t|� |d ��t|d �kr�t�d|d |� |d �|d � d} nq�| r�t�d| � | d7 } t�| � qr| S td �| ���) aw Set tags for a resource. Normally a VM name or instance_id is passed in, but a resource_id may be passed instead. If both are passed in, the instance_id will be used. CLI Examples: .. code-block:: bash salt-cloud -a set_tags mymachine tag1=somestuff tag2='Other stuff' salt-cloud -a set_tags resource_id=vol-3267ab32 tag=somestuff Nr� r� �r( r� r+ r� rH z5A valid instance_id or resource_id was not specified.r$ �r� z ResourceId.1zTags to set for %s: %s� Tag.{}.Keyz Tag.{}.Valuer r� r� �rk r+ ro r� r� r� r� z Setting the tags returned: %sFr r r> z,Setting the tag %s returned %s instead of %sTz)Failed to set tags. Remaining attempts %sr zFailed to set tags on {}!)rP r� rW rX rj r- rQ rJ rK r r� r �get_tagsrI r� r� ri r )r( r� r� r+ r� r� r� rF r} Ztag_kZtag_vrq ZsettagsZfailed_to_set_tagsr! r r r r� $ s| �� � �� r� c C s| |du rt � }|du r,|du r*| rt| �d }nd|v r!|d }n d|v r)|d }n|}dd|d�}tj|d|t� td d �S ) aL Retrieve tags for a resource. Normally a VM name or instance_id is passed in, but a resource_id may be passed instead. If both are passed in, the instance_id will be used. CLI Examples: .. code-block:: bash salt-cloud -a get_tags mymachine salt-cloud -a get_tags resource_id=vol-3267ab32 Nr� r� r� Z DescribeTagsz resource-id)r� � Filter.1.NamezFilter.1.Valuer� r� r� )rP r� rJ r r� r )r( r� r� r+ r� r� rF r r r r� � s0 ���r� c C s� |du ri }d|vrt d��| sd|v r|d }|d= |s#t| �d }d|d�}t|d �d��D ] \}}||d �|�< q1tj|d t� t� t d d � |rQt |d �S t |d�S )a� Delete tags for a resource. Normally a VM name or instance_id is passed in, but a resource_id may be passed instead. If both are passed in, the instance_id will be used. CLI Examples: .. code-block:: bash salt-cloud -a del_tags mymachine tags=mytag, salt-cloud -a del_tags mymachine tags=tag1,tag2,tag3 salt-cloud -a del_tags resource_id=vol-3267ab32 tags=tag1,tag2,tag3 Nr� z7A tag or tags must be specified using tags=list,of,tagsr� r� Z DeleteTagsr� �,r� r� r� r� )r� r� ) r r� rj r" rQ rJ r rP r� r r� )r( r� r� r� r� rF r} r! r r r �del_tags� s2 � � r� c C sV |dkrt d��t�d| |d � t| d|d idd� tjj�td | |d � dS ) z� Properly rename a node. Pass in the new name as "new name". CLI Example: .. code-block:: bash salt-cloud -a rename mymachine newname=yourmachine r� z5The rename action must be called with -a or --action.zRenaming %s to %s�newnamer� r� Zpki_dirN) r rW r� r� r rZ r� Z rename_keyr r� r r r �rename� s � r� c C s� |dkrt d��t| �}|d }|�d�}t| |ddd�}td d d d �| �| |d �td td d� |dkr>t d�| ���i }tjdt � tdd�}|durjd�| t � � j �}t | d|idd� t�d|� ||d< d|d�} t� } t� } tj| | | tdd �} t�| � |�| d � |d ur�d |d �} tj| | | tdd �} | d |d!< td d d"d#�| �| |d �td td d� td$ | � t�d%d�du r�td& | t� �d'�d t� |S )(z� Destroy a node. Will check termination protection and warn if enabled. CLI Example: .. code-block:: bash salt-cloud --destroy mymachine rC zEThe destroy action must be called with -d, --destroy, -a or --action.r� r` r� T)r( r� r� �quietrY rZ zdestroying instancezsalt/cloud/{}/destroyingr� r\ r] r^ r4 z�This instance has been protected from being destroyed. Use the following command to disable protection: salt-cloud -a disable_term_protect {}�rename_on_destroyFr� z{}-DEL{}r� �r� r� z>Machine will be identified as %s until it has been cleaned up.ZTerminateInstancesr� r� r� r Nrn rb Z spotInstancezdestroyed instancezsalt/cloud/{}/destroyedzcloud.cachedir_index_delZupdate_cachedirz cloud.delete_minion_cachedirr )r r� rI �show_term_protectr~ rQ r r r� r �uuidZuuid4�hexr� rW r� rP r� rJ r r& r r" ) r( r� Z node_metadatar� rk Z protectedr~ r� r� rF r+ ro rz r r r r� s� � �� � �� � � � � �r� c C sJ t | �d }d|d�}tj|dt� t� tdd�}|g kr!t�d� ddiS ) zl Reboot a node. CLI Example: .. code-block:: bash salt-cloud -a reboot mymachine r� ZRebootInstancesr� r� r� r� ZCompleteZReboot)r� rJ r rP r� r rW r� r� r r r �rebootd s � r� c C sF |dkrt d��| d dd�}tj|dt� t� tdd�}t�|� |S ) z5 Show the details from EC2 concerning an AMI rC z;The show_image action must be called with -f or --function.r� r� )rP r� r� r� r� )r rJ r rP r� r rW r� )r� r� rF rz r r r � show_image� s �� r� c C sf | s |dkr t d��|dkr|�dd�} |�dd�}| s"|s"t d��t| |d�}td |t� t� |S ) a� Show the details from EC2 concerning an AMI. Can be called as an action (which requires a name): .. code-block:: bash salt-cloud -a show_instance myinstance ...or as a function (which requires either a name or instance_id): .. code-block:: bash salt-cloud -f show_instance my-ec2 name=myinstance salt-cloud -f show_instance my-ec2 instance_id=i-d34db33f r� z)The show_instance action requires a name.rC r( Nr� zCThe show_instance function requires either a name or an instance_idr� r� )r rI r� r~ r r )r( r� r� r� r� r r r � show_instance� s � r� c C s� |d u rt � }ddi}t| ��d�r t| �dks t| �dkr | }|r'||d< nd|d< | |d < t�|� t� }d }|tjk rvztj |||t d d �}t |�� � }t t|��W S typ |d 7 }t�d|pf| |� t�|� Y nw |tjk s>i S )Nr� r� �i-r� � r� ztag:Namer� zFilter.1.Value.1r r� r� r z<Failed to get the data for node '%s'. Remaining attempts: %s)rP r� r� r rW rb r� rJ rK r r �_extract_instance_inforx �next�iter� IndexErrorrX ri )r( r� r+ rF ro rq r� Z instance_infor r r r� � s< & � �� �r� c C s |dkrt d��t| p t� �S )�; Return a list of the VMs that are on the provider r� zBThe list_nodes_full function must be called with -f or --function.)r �_list_nodes_fullrP )r+ r� r r r �list_nodes_full� s �r c C sp d| v r4| d d ur4| d }t |d t�r,|d D ]}|d dkr'|d S q| d S | d d d S | d S )Nr� r* r r� r r� )r% r& )r* Ztagsetr! r r r �_extract_name_tag� s �r c C s i }| D ]y}t |d d t�rH|d d D ]1}t|�}|||< ||| d< || �t|d |d |d |d d |�dg �|�d g �d �� qq|d d }t|�}|||< ||| d< || �t|d |d |d |d d |�dg �|�d g �d �� q|S ) zE Given an instance query, return a dict of all instance data r: r* r( r� r� Z instanceType� instanceStater2 r� )r r� rK rf r� r� )r% r& r r& r� rI )r� r~ r< r* r( r r r r� � sB ��� �� r� c C s� t � pd}d|v r|�d�}|d }ddi}tj|| |tdd�}d|v r3td �|d d d d ���t|�}td ||t� |S )z8 Return a list of the VMs that in this location r r r r� r� r� r� r? �)An error occurred while listing nodes: {}rG rH �Messagezcloud.cache_node_list) r r" rJ r r r rQ r� r~ )r+ ro r) rF r� r~ r r r r s" ���r c C s� |dkrt d��i }ddi}tj|t� t� tdd�}d|v r-t d�|d d d d ���|D ]3}t|d d t�rA|d d }n|d d g}|D ]}|d d }t |�} |d } || d�|| < qJq/|S )z� Return a list of the VMs that are on the provider. Only a list of VM names, and their state, is returned. This is the minimum amount of information needed to check for existing VMs. r� zAThe list_nodes_min function must be called with -f or --function.r� r� r� r� r? r rG rH r r: r* r r( r� )rf r ) r rJ r rP r� r rQ r% r& r ) r+ r� r~ rF r� r< r- r* rf r( r r r r �list_nodes_min: s< ���� �r c C s� | dkrt d��i }tt� �}d|v r"t d�|d d d d ���|D ]*}|| d || d || d || d || d || d || d d�||< q$|S )r r� z=The list_nodes function must be called with -f or --function.r? r rG rH r r r� r( rK rf r� r� )r r� r( rK rf r� r� )r r rP rQ )r� r~ Znodesr� r r r � list_nodesc s, � �� � r c C s t jj�tt� �td | �S )zO Return a list of the VMs that are on the provider, with select fields zquery.selection)r rZ r� �list_nodes_selectr rP r r� r r r r � s �r c C s� |dkrt d��|st| �d }d|dd�}tj|t� t� dtdd �}d }|D ] }d |v r3|d } nq't�|du r=tj ntj d |d krFdpGd| � |S )zZ Show the details from EC2 concerning an instance's termination protection state r� z@The show_term_protect action must be called with -a or --action.r� ZDescribeInstanceAttributeZdisableApiTermination)r� � InstanceIdZ AttributeTr� �r+ ro rn r� r� Fr z#Termination Protection is %s for %sr4 �enabledZdisabled) r r� rJ r rP r� r rW r{ r| �INFO)r( r� r� r� rF rz Zdisable_protectr* r r r r� � s> � �� ��r� c C s� |dkrt d��t� }t| ��d�r t| �dks t| �dkr | }| s(|s(t d��t| ||d�}t�|du r8tjntj d |d | � |d S ) zM Show the details from EC2 regarding cloudwatch detailed monitoring. r� zGThe show_detailed_monitoring action must be called with -a or --action.r� r� r� zOThe show_detailed_monitoring action must be provided with a name or instance IDr� Tz Detailed Monitoring is %s for %sZ monitoring) r rP r� r� r r� rW r{ r| r )r( r� r� r� r+ Zmatchedr r r �show_detailed_monitoring� s& �&��r c C s@ t | �d }d||d�}tj|t� t� dtdd�}t| |dd�S ) z= Enable or Disable termination protection on a node r� �ModifyInstanceAttribute)r� r zDisableApiTermination.ValueTr� r r� �r( r� r� )r� rJ r rP r� r r� )r( r r� rF rz r r r �_toggle_term_protect� s �� r c C � |dkrt d��t| d�S )z� Enable termination protection on a node CLI Example: .. code-block:: bash salt-cloud -a enable_term_protect mymachine r� �BThe enable_term_protect action must be called with -a or --action.r4 �r r �r( r� r r r �enable_term_protect� � � r c C r )z� Disable termination protection on a node CLI Example: .. code-block:: bash salt-cloud -a disable_term_protect mymachine r� r �falser r r r r �disable_term_protect� r r c C �N |dkrt d��t| �d }d|d�}tj|t� t� dtdd�}t| |dd �S ) �6 Enable/disable detailed monitoring on a node r� r r� ZUnmonitorInstancesr� Tr� r r �r r� rJ r rP r� r r r� r r r �disable_detailed_monitoring � � � r c C r ) r r� r r� ZMonitorInstancesr� Tr� r r r r� r r r �enable_detailed_monitoring% r r c C s |dkrt d��|s i }|�dd�}|�dd�}|�dd�}|du r(t| �d }d|d �}tj|t� t� td d �}|d d d d }t|d t �sQ|d g|d< g } t |d �D ]1\} } | d } |durj|| krjqY|durw|| d d krwqY| | d d | d d d�} | � | � qY| S )z� Do not delete all/specified EBS volumes upon instance termination CLI Example: .. code-block:: bash salt-cloud -a show_delvol_on_destroy mymachine r� zEThe show_delvol_on_destroy action must be called with -a or --action.r� Nr� r� r� r� r� r� r� r r: r* rQ rR rS r� �deleteOnTermination)� device_namer� r! ) r rI r� rJ r rP r� r r% r& rj r' )r( r� r� r� r� r� rF r, �blockmapr- r} r* r" r� r r r �show_delvol_on_destroy= sF � � � r$ c C �@ |dkrt d��|s i }|�dd�}|�dd�}t| ||dd�S )z� Do not delete all/specified EBS volumes upon instance termination CLI Example: .. code-block:: bash salt-cloud -a keepvol_on_destroy mymachine r� zAThe keepvol_on_destroy action must be called with -a or --action.r� Nr� r �r( r� r� r �r rI r� �r( r� r� r� r� r r r �keepvol_on_destroy| � � r) c C r% )z� Delete all/specified EBS volumes upon instance termination CLI Example: .. code-block:: bash salt-cloud -a delvol_on_destroy mymachine r� z@The delvol_on_destroy action must be called with -a or --action.r� Nr� r4 r& r' r( r r r �delvol_on_destroy� r* r+ c C s* |st | �d }|rtj|t� t� tdd�}nd|d�}tj|dt� t� tdd�\}}|d d d d }d |d �}t|d t�sH|d g|d < t|d �D ],\} } | d } |d ur_|| kr_qN|d url|| d d krlqN| |d� | �< ||d� | �< qNtj|dt� t� tdd� |||d�} t | | dd�S )Nr� r� )rl r+ ro r� r� r� r� T�rm r+ ro r� r� r r: r* rQ r �r� r rR rS r� z BlockDeviceMapping.{}.DeviceNamez-BlockDeviceMapping.{}.Ebs.DeleteOnTerminationr )r� r� r� r� r� ) r� rJ r rP r� r r% r& rj rQ r$ ) r( r� r� r� r rl r, rF r# r} r* r" r� r r r r� � sR � � � r� c C s^ |dkr t �d� dS d| vrt �d� dS | �dd�}|sEd| vr)t �d � dS d | vr4t �d � dS | d | �d d �| d d�d�g}t|t�sM|g}d| d d�}|�td|�� d | v rf| d |d< d| v rp| d |d< d| v rz| d |d< d| v r�| d |d< t �|� tj |ddt � t � t dd �}i }|d D ]}|� � D ]\}}|||< q�q�|S ) z� Create an ami from a snapshot CLI Example: .. code-block:: bash salt-cloud -f register_image my-ec2-config ami_name=my_ami description="my description" root_device_name=/dev/xvda snapshot_id=snap-xxxxxxxx rC �@The create_volume function must be called with -f or --function.FZami_namez0ami_name must be specified to register an image.�block_device_mappingN� snapshot_idzKsnapshot_id or block_device_mapping must be specified to register an image.Zroot_device_namezProot_device_name or block_device_mapping must be specified to register an image.Z volume_typeZgp2)� VolumeType� SnapshotId)rT ZEbsZ RegisterImage)r� r� rM ZRootDeviceName� descriptionr Zvirtualization_typeZVirtualizationType� architectureZ ArchitectureTr� �rm rn r+ ro r� r� r )rW r? rI r% r& r& r' rX rJ r rP r� r r- ) r� r� r/ rF r, �r_data�dr, r7 r r r �register_image� sh �� ��� � �r8 c K � t | d�S )zh Wrapper around create_volume. Here just to ensure the compatibility with the cloud module. rC )r� �r� r r r � volume_create= � r; c C s� d| d d�}d| v r| d |d< d| v r| d |d< d| v r%| d |d < d | v r9| � dd ��� d v r9| d |d < d| v rQd| vrQ| d |d< d| v rQ| d |d< |S )NZ CreateVolumer )r� ZAvailabilityZonerK ZSizer� r2 rD r1 r� Zstandard�Zio1Zio2ZIopsr� Z Encryptedr� ZKmsKeyId)rI r@ )r� rF r r r � _load_paramsE s r> c C sf |dkr t �d� dS d| vrt �d� dS d| v r%d| vr%t �d� dS | �d ��� d v r9d | vr9t �d � dS d | vrEd| vrEd| d < t| �}t �|� tj|ddt� t � t dd�}i }|d D ]}|� � D ]\}}|||< qhqb|d } d| v r�t | d t �r�tjj�| d �} n| d } t | t�r�t| | dt� d�} | |d< |r�tjjjtd| i|ddd� |S ) aW Create a volume. zone The availability zone used to create the volume. Required. String. size The size of the volume, in GiBs. Defaults to ``10``. Integer. snapshot The snapshot-id from which to create the volume. Integer. type The volume type. This can be ``gp2`` for General Purpose SSD, ``io1`` or ``io2`` for Provisioned IOPS SSD, ``st1`` for Throughput Optimized HDD, ``sc1`` for Cold HDD, or ``standard`` for Magnetic volumes. String. iops The number of I/O operations per second (IOPS) to provision for the volume, with a maximum ratio of 50 IOPS/GiB. Only valid for Provisioned IOPS SSD volumes. Integer. This option will only be set if ``type`` is also specified as ``io1`` or ``io2`` encrypted Specifies whether the volume will be encrypted. Boolean. If ``snapshot`` is also given in the list of kwargs, then this value is ignored since volumes that are created from encrypted snapshots are also automatically encrypted. tags The tags to apply to the volume during creation. Dictionary. call The ``create_volume`` function must be called with ``-f`` or ``--function``. String. wait_to_finish Whether or not to wait for the volume to be available. Boolean. Defaults to ``False``. CLI Examples: .. code-block:: bash salt-cloud -f create_volume my-ec2-config zone=us-east-1b salt-cloud -f create_volume my-ec2-config zone=us-east-1b tags='{"tag1": "val1", "tag2", "val2"}' rC r. Fr z:An availability zone must be specified to create a volume.r� r� z8If a KMS Key ID is specified, encryption must be enabledrD r= r� z0Iops must be specified for types 'io1' and 'io2'rK r� �10Tr� r5 r r� r� r� )r� r� r� r+ r� rh r� �Zfunr� Zfun_callZargument_being_watchedZrequired_argument_response)rW r? rI r@ r> rX rJ r rP r� r r- r% r� r rZ r� r� r� r� r� �run_func_until_ret_arg�describe_volumes) r� r� r� rF r, r6 r7 r, r7 r� r� Znew_tagsr r r r� ^ sb 3 � � ��r� c C s< t j| dt� t� tdd�}|d r t�d|d |� dS |S )NTr� r, r z3Error attaching volume %s to instance %s. Retrying!r� F)rJ r rP r� r rW r� )rF �kwsr� r, r r r �__attach_vol_to_instance� s ��rD c C s� |dkrt d��|s i }d|v r|d }| r |s t| �d }| s)|s)t�d� dS d|vr4t�d� dS d |vr?t�d � dS d |d ||d d �}t�|� t� }tjjj t |||ft j d |t dd�t j d|t dd�t j d|t dd�d�}|S )z( Attach a volume to an instance r� z<The attach_volume action must be called with -a or --action.r� r� �,Either a name or an instance_id is required.Fr� �A volume_id is required.r� z%A device is required (ex. /dev/sdb1).Z AttachVolume)r� �VolumeIdr ZDevicer� r� r� r� r� r� r r� )r r� rW r? rX r r rZ r� r� rD r r� r )r( r� r� r� rF r� r, r r r r� � sP � � ����r� c C s | si } t | |�S )zo Wrapper around describe_volumes. Here just to keep functionality. Might be depreciated later. �rB r� r r r � show_volume! s rI c C sZ |dkrt d��|s i }d|vrt�d� dS d|d d�}tj|dt� t� td d �}|S ) z* Detach a volume from an instance r� z<The detach_volume action must be called with -a or --action.r� rF FZ DetachVolume�r� rG Tr� r, )r rW r? rJ r rP r� r �r( r� r� r� rF r, r r r � detach_volume- s& � �rL c C sJ |si }d|vrt �d� dS d|d d�}tj|dt� t� tdd�}|S ) z Delete a volume r� rF FZ DeleteVolumerJ Tr� r, �rW r? rJ r rP r� r rK r r r � delete_volumeJ s �rN c K r9 )zk Wrapper around describe_volumes. Here just to ensure the compatibility with the cloud module. rC rH r: r r r � volume_listb r< rO c C s� |dkr t �d� dS | si } ddi}d| v r.| d �d�}t|�D ] \}}||d�|�< q"t �|� tj|d t� t � t d d �}|S ) z� Describe a volume (or volumes) volume_id One or more volume IDs. Multiple IDs must be separated by ",". TODO: Add all of the filters. rC zCThe describe_volumes function must be called with -f or --function.Fr� ZDescribeVolumesr� r� z VolumeId.{}Tr� r, � rW r? r" rj rQ rX rJ r rP r� r )r� r� rF r� Z volume_indexr, r r r rB j s( �rB c C �` |dkr t �d� dS | si } d| vrt �d� dS d| d d�}tj|dt� t� td d �}|S ) z Create an SSH keypair rC zAThe create_keypair function must be called with -f or --function.Fr� �A keyname is required.Z CreateKeyPair�r� rL Tr� r, rM �r� r� rF r, r r r �create_keypair� �$ �rU c C s� |dkr t �d� dS | si } d| vrt �d� dS d| vr%t �d� dS d| d d �}| d }tj�|�rWtjj�|d ��}tjj � |� � �}W d � n1 sRw Y |d urbt � |�|d < tj|d t� t� tdd�}|S )zC Import an SSH public key. .. versionadded:: 2015.8.3 rC zAThe import_keypair function must be called with -f or --function.Fr� rR �filez A public key file is required.Z ImportKeyPairrS rJ NZPublicKeyMaterialTr� r, )rW r? r� rV ro r rZ rp rq rr rs rt ru rv rJ r rP r� r )r� r� rF Zpublic_key_filer Z public_keyr, r r r �import_keypair� s8 ��rX c C rQ ) z, Show the details of an SSH keypair rC z?The show_keypair function must be called with -f or --function.Fr� rR ZDescribeKeyPairs)r� z KeyName.1Tr� r, rM rT r r r � show_keypair� rV rY c C rQ ) z Delete an SSH keypair rC zAThe delete_keypair function must be called with -f or --function.Fr� rR Z DeleteKeyPairrS Tr� r, rM rT r r r �delete_keypair� rV rZ c C s� |dkrt d��| du ri } | �dd�}| �dd�}|du r"t d��d||d �}t�|� tj|d d t� t� td d �d }i }|D ]}|� � D ]\} } | || < qGqAd|v ri|d } |rit j j j td| i|ddd� |S )a� Create a snapshot. volume_id The ID of the Volume from which to create a snapshot. description The optional description of the snapshot. CLI Exampe: .. code-block:: bash salt-cloud -f create_snapshot my-ec2-config volume_id=vol-351d8826 salt-cloud -f create_snapshot my-ec2-config volume_id=vol-351d8826 \ description="My Snapshot Description" rC zBThe create_snapshot function must be called with -f or --function.Nr� r3 r> z3A volume_id must be specified to create a snapshot.ZCreateSnapshot)r� rG r Tr� r5 r Z snapshotIdr0 rh Z completedr@ )r rI rW rX rJ r rP r� r r- r rZ r� rA �describe_snapshots) r� r� r� r� r3 rF r, r6 r7 r, r7 r0 r r r �create_snapshot sT � � �� ��r\ c C sp |dkr t �d� dS d| vrt �d� dS ddi}d| v r$| d |d< t �|� tj|d t� t� td d �}|S ) z Delete a snapshot rC zBThe delete_snapshot function must be called with -f or --function.Fr0 z5A snapshot_id must be specified to delete a snapshot.r� ZDeleteSnapshotr2 Tr� r, �rW r? rX rJ r rP r� r rT r r r �delete_snapshotT s& �r^ c C s� |dkr t �d� dS d| vrt �d� dS d| vr!t �d� dS d| vr)d | d< d d i}d| v r7| d |d < d| v rA| d |d < d| v rK| d |d< t �|� tj|dt� t� tdd�}|S )z Copy a snapshot rC z@The copy_snapshot function must be called with -f or --function.FZ source_regionz5A source_region must be specified to copy a snapshot.Zsource_snapshot_idz:A source_snapshot_id must be specified to copy a snapshot.r3 r> r� Z CopySnapshotZ SourceRegionZSourceSnapshotIdr Tr� r, r] rT r r r � copy_snapshotr s8 �r_ c C s� |dkr t �d� dS ddi}d| v r| d | d< d| v r4| d �d�}t|�D ] \}}||d �|�< q(d | v rO| d �d�}t|�D ] \}}||d �|�< qCd | v rj| d �d�} t| �D ] \} } | |d �| �< q^t �|� tj|dt� t � t dd�} | S )a� Describe a snapshot (or snapshots) snapshot_id One or more snapshot IDs. Multiple IDs must be separated by ",". owner Return the snapshots owned by the specified owner. Valid values include: self, amazon, <AWS Account ID>. Multiple values must be separated by ",". restorable_by One or more AWS accounts IDs that can create volumes from the snapshot. Multiple aws account IDs must be separated by ",". TODO: Add all of the filters. rC zDThe describe_snapshot function must be called with -f or --function.Fr� ZDescribeSnapshots� snapshot_idsr0 r� z SnapshotId.{}r� zOwner.{}� restorable_byzRestorableBy.{}Tr� r, rP ) r� r� rF r` Zsnapshot_indexr0 ZownersZ owner_indexr� Zrestorable_bysZrestorable_by_indexra r, r r r r[ � s< � �r[ c C s� |dkrt d��|du rt� }|st| �d }|du r i }|du r,d|v r,|d }|d= d|d�}i }tj|d|t� td d �}|D ]*}tt|� � ��d kr[t � tt|� � ���|d < qAtt|� � ��|tt|� � ��< qA|S ) z� Show the console output from the instance. By default, returns decoded data, not the Base64-encoded data that is actually returned from the EC2 API. r� zAThe get_console_output action must be called with -a or --action.Nr� r� ZGetConsoleOutputr- Tr� r r� r� ) r rP r� rJ r r� r r� r� rw �binascii� a2b_base64rx ) r( r+ r� r� r� rF r~ r, r* r r r r� � s: � � "r� c C sh |dkrt d��|st| �d }|du ri }|du r%d|v r%|d }|d= d|d�}i }tj|dt� t� td d �}|D ]}tt|� � ��|tt|� � ��< q;t j j set j jsed |v s^d |v rct�d � |S d |vr�d |v r�t jj�|d d��}t jj�|�� �|d < W d � n1 s�w Y d |v r�|�dd�} | dur�|d } t�| �} t j �| | �|d< |S )a� Return password data for a Windows instance. By default only the encrypted password data will be returned. However, if a key_file is passed in, then a decrypted password will also be returned. Note that the key_file references the private key that was used to generate the keypair associated with this instance. This private key will _not_ be transmitted to Amazon; it is only used internally inside of Salt Cloud to decrypt data _after_ it has been received from Amazon. CLI Examples: .. code-block:: bash salt-cloud -a get_password_data mymachine salt-cloud -a get_password_data mymachine key_file=/root/ec2key.pem Note: PKCS1_v1_5 was added in PyCrypto 2.5 r� z@The get_password_data action must be called with -a or --action.r� Nr� ZGetPasswordDatar- Tr� r r r� z8No crypto library is installed, can not decrypt passwordrJ r� r� )r r� rJ r rP r� r r� r� rx rw r r r r rW r� rZ rp rq rr rs rt rI ru � b64decodeZpwdata_decrypt) r( r� r� r� rF r~ r, r* Zkf_ZpwdataZrsa_keyr r r r� sP � � " � r� c C s\ ddddddd�}| du ri } d | vr!|D ] }t || |� qdS t || d | d � dS ) a Download most recent pricing information from AWS and convert to a local JSON file. CLI Examples: .. code-block:: bash salt-cloud -f update_pricing my-ec2-config salt-cloud -f update_pricing my-ec2-config type=linux .. versionadded:: 2015.8.0 z6https://a0.awsstatic.com/pricing/1/ec2/linux-od.min.jsz5https://a0.awsstatic.com/pricing/1/ec2/rhel-od.min.jsz5https://a0.awsstatic.com/pricing/1/ec2/sles-od.min.jsz6https://a0.awsstatic.com/pricing/1/ec2/mswin-od.min.jsz9https://a0.awsstatic.com/pricing/1/ec2/mswinSQL-od.min.jsz<https://a0.awsstatic.com/pricing/1/ec2/mswinSQLWeb-od.min.js)�linux�rhel�sles�mswin�mswinsql� mswinsqlwebNrD )�_parse_pricing)r� r� Zsources�sourcer r r �update_pricingY s � �rm c C sR t j| dd�}g }d}t�td|d �}|�� �d��d�}dD ] }|�|d� |��}q d D ]}|�|d� |��}|�d � |�d � |��}q.|�d d �}i }t j j � |�}|d d D ] }i } |d D ]} | d D ]} | | | d < qiqc| ||d < q[tj�td d� |��} t j j�| d��} t j j�|| � W d � dS 1 s�w Y dS )z` Download and parse an individual pricing file from AWS .. versionadded:: 2015.8.0 T)r# r> r# z);z callback()�versr Zrate� valueColumnsZ currencies� instanceTypesrD ZECUZ storageGBr( ZvCPUZ memoryGiBZ storageGiB�USDz"{}")rt ZpricerK z"{}"sz"{}s"z""�"r �regionsrp r� rK rt �cachedir�ec2-pricing-{}.p�wN)�httpr �re�sub� JS_COMMENT_RErY �rstrip�lstripr` rQ r rZ �json�loadsr� rV �joinr rp rq �msgpack�dump)r� r( Zprice_jsr- Z current_item�keywordrs Z price_jsonrt r� ZityperK ZoutfileZfhor r r rk z s6 � ��rk c C s� t d �| d i �}|sddiS |�dd�}|�d�}t|�dk s'|d d kr+dd iS |�d d �}td |id�}|d }|�dd�dkrx|�dd�dkrg|�dd�}d|�� v rdd|�� v rad} n$d} n!d} n |�dd��� �d �rud } nd } n |�d d�d kr�d!} nd } tj � t d" d#� | ��} tj � | �s�t d$| id� tjj�| d%��} tjj�tjj�| ��} W d � n1 s�w Y t|�} |�d&d �}|d u r�dd'iS z| | | }W n ty� dd(� || �i Y S w i }| �d)d*�r�||d+< d|d,< |�d-g �D ]}|d, t�|d. �d/d��7 < �qt�|d, �|d,< |d, d0 |d1< |d1 d2 |d3< |d1 d4 |d5< |d3 d6 |d7< |d |iS )8a Show pricing for a particular profile. This is only an estimate, based on unofficial pricing sources. CLI Examples: .. code-block:: bash salt-cloud -f show_pricing my-ec2-config profile=my-profile If pricing sources have not been cached, they will be downloaded. Once they have been cached, they will not be updated automatically. To manually update all prices, use the following command: .. code-block:: bash salt-cloud -f update_pricing <provider> .. versionadded:: 2015.8.0 Zprofilesr� rH z#The requested profile was not foundro z0:0r r9 r r z,The requested profile does not belong to EC2r� NrC r ZimageOwnerAliasr> r� �platformZwindowsr3 ZsqlZwebrj ri rh Z imageLocationz amazon/suserg re Z imageOwnerIdZ 309956199498rf rt ru rD rJ rK z-The requested profile does not contain a sizezaThe size ({}) in the requested profile does not have a price associated with it for the {} region�rawFZ_rawZper_hourro Zpricesrq � Zper_day� Zper_weekr� Z per_month�4 Zper_year)r rI r" r r� r@ rY r� r� rV r rQ r� rm r rZ rp rq rr rs r� �loadrP �KeyError�decimalZDecimal)r� r� r� ro r) r� Z image_dictZ image_infoZimage_descriptionr( Z pricefileZfhiZ ec2_pricert rK r� r~ �colr r r � show_pricing� sl � �� & r� c C � |dkrt d��|s i }d|v r|d }| r |s t| �d }| s)|s)t�d� dS d|vr4t�d� dS d ||d d �}tj|d t� t� d td d�}t� |� |S )a* Associates the specified SSM document with the specified instance http://docs.aws.amazon.com/ssm/latest/APIReference/API_CreateAssociation.html CLI Examples: .. code-block:: bash salt-cloud -a ssm_create_association ec2-instance-name ssm_document=ssm-document-name r� zEThe ssm_create_association action must be called with -a or --action.r� r� rE Fr� �A ssm_document is required.ZCreateAssociation�r� r r� T�ssmr� �rn r+ ro �productr� r� � r r� rW r? rJ r rP r� r r� �r( r� r� r� rF rz r r r r� s> � �� r� c C r� )a3 Describes the associations for the specified SSM document or instance. http://docs.aws.amazon.com/ssm/latest/APIReference/API_DescribeAssociation.html CLI Examples: .. code-block:: bash salt-cloud -a ssm_describe_association ec2-instance-name ssm_document=ssm-document-name r� zGThe ssm_describe_association action must be called with -a or --action.r� r� rE Fr� r� ZDescribeAssociationr� Tr� r� r� r� r� r r r �ssm_describe_associationE s> � �� r� )NNNNFF)NNr� r� r r� r )NN)NNNTN)NT)NNNNNNN)NNNNNN)NNNNN)NNNN)NNN)NNNF)NNF)��__doc__ru rb rM r� r7 r4 r{ r� r� rx r� r� � urllib.parserR r� Zxml.etree.ElementTreeZetreeZ ElementTreere � functoolsr Z salt.configr Z salt.cryptr Zsalt.utils.awsrZ rJ Zsalt.utils.cloudZsalt.utils.compatZsalt.utils.filesZsalt.utils.hashutilsZsalt.utils.httprw Zsalt.utils.jsonZsalt.utils.msgpackZsalt.utils.stringutilsZsalt.utils.yamlZsalt.exceptionsr r r r r r r � ImportErrorZ getLogger�__name__rW Z EC2_LOCATIONSr. r[ rh �compile�Srz r r r r r r$ r2 r; r r� r� r� r� r� r� r� r� r� rP r� r� r� r� r� r r r r r r� r� r r r0 r% r1 r) r8 r( r= r' r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r� r r r r r� r r r r r r r$ r) r+ r� r8 r; r> r� rD r� rI rL rN rO rB rU rX rY rZ r\ r^ r_ r[ r� r� rm rk r� r� r� r r r r �<module> s� O � � ( � N � K u% ; #% q '4 H A~ � X p P # �l �. � 3 _ " & ) ) * ? � >S u : $ + G +; �6 � M! 6 _6
Save