EVOLUTION-NINJA
Edit File: plugin_net.cpython-36.pyc
3 �<�e�Z � @ sp d dl Z ddlmZ ddlT d dlZd dlmZ d dlm Z d dl Z d dl Z ej j � ZdZG dd � d ej�ZdS ) � N� )�hotplug)�*)�ethcard)�commandsZpumbagsdc s. e Zd ZdZ� fdd�Zdd� Zdd� Zdd � Zd d � Zd d � Z dd� Z e dd� �Z e dd� �Z e dd� �Ze dd� �Ze dd� �Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Ze d(d)� �Zed*d+d,�d-d.� �Zed*�did0d1��Z ed2�d3d4� �Z ed2�d5d6� �Z g fd7d8�Z djd:d;�Z ed<d+d,�d=d>� �Z!d?d@� Z"ed<�dkdAdB��Z#edCd+d,�dDdE� �Z$edC�dldFdG��Z%dHdI� Z&dJdK� Z'dLdM� Z(dNdO� Z)dPdQ� Z*dRdS� Z+dTdU� Z,dmdVdW�Z-dXdY� Z.e/dZd+d,�d[d\� �Z0e/d]d+d,�d^d_� �Z1e/d`d+d,�dadb� �Z2e/dcd+d,�ddde� �Z3e/dfd+d,�dgdh� �Z4� Z5S )n�NetTuningPlugina� `net`:: Configures network driver, hardware and Netfilter settings. Dynamic change of the interface speed according to the interface utilization is also supported. The dynamic tuning is controlled by the [option]`dynamic` and the global [option]`dynamic_tuning` option in `tuned-main.conf`. + The [option]`wake_on_lan` option sets wake-on-lan to the specified value as when using the `ethtool` utility. + .Set Wake-on-LAN for device eth0 on MagicPacket(TM) ==== ---- [net] devices=eth0 wake_on_lan=g ---- ==== + The [option]`coalesce` option allows changing coalescing settings for the specified network devices. The syntax is: + [subs="+quotes,+macros"] ---- coalesce=__param1__ __value1__ __param2__ __value2__ ... __paramN__ __valueN__ ---- Note that not all the coalescing parameters are supported by all network cards. For the list of coalescing parameters of your network device, use `ethtool -c device`. + .Setting coalescing parameters rx/tx-usecs for all network devices ==== ---- [net] coalesce=rx-usecs 3 tx-usecs 16 ---- ==== + The [option]`features` option allows changing the offload parameters and other features for the specified network devices. To query the features of your network device, use `ethtool -k device`. The syntax of the option is the same as the [option]`coalesce` option. + .Turn off TX checksumming, generic segmentation and receive offload ==== ---- [net] features=tx off gso off gro off ---- ==== The [option]`pause` option allows changing the pause parameters for the specified network devices. To query the pause parameters of your network device, use `ethtool -a device`. The syntax of the option is the same as the [option]`coalesce` option. + .Disable autonegotiation ==== ---- [net] pause=autoneg off ---- ==== + The [option]`ring` option allows changing the rx/tx ring parameters for the specified network devices. To query the ring parameters of your network device, use `ethtool -g device`. The syntax of the option is the same as the [option]`coalesce` option. + .Change the number of ring entries for the Rx/Tx rings to 1024/512 respectively ===== ----- [net] ring=rx 1024 tx 512 ----- ===== + The [option]`channels` option allows changing the numbers of channels for the specified network device. A channel is an IRQ and the set of queues that can trigger that IRQ. To query the channels parameters of your network device, use `ethtool -l device`. The syntax of the option is the same as the [option]`coalesce` option. + .Set the number of multi-purpose channels to 16 ===== ----- [net] channels=combined 16 ----- ===== + A network device either supports rx/tx or combined queue mode. The [option]`channels` option automatically adjusts the parameters based on the mode supported by the device as long as a valid configuration is requested. + The [option]`nf_conntrack_hashsize` option sets the size of the hash table which stores lists of conntrack entries by writing to `/sys/module/nf_conntrack/parameters/hashsize`. + .Adjust the size of the conntrack hash table ==== ---- [net] nf_conntrack_hashsize=131072 ---- ==== + The [option]`txqueuelen` option allows changing txqueuelen (the length of the transmit queue). It uses `ip` utility that is in package iproute recommended for TuneD, so the package needs to be installed for its correct functionality. To query the txqueuelen parameters of your network device use `ip link show` and the current value is shown after the qlen column. + .Adjust the length of the transmit queue ==== ---- [net] txqueuelen=5000 ---- ==== + The [option]`mtu` option allows changing MTU (Maximum Transmission Unit). It uses `ip` utility that is in package iproute recommended for TuneD, so the package needs to be installed for its correct functionality. To query the MTU parameters of your network device use `ip link show` and the current value is shown after the MTU column. + .Adjust the size of the MTU ==== ---- [net] mtu=9000 ---- ==== c s6 t t| �j||� d| _d| _t� | _i | _d| _d S )Ng�������?� T) �superr �__init__�_load_smallest� _level_stepsr �_cmd�_re_ip_link_show�_use_ip)�self�args�kwargs)� __class__� � /usr/lib/python3.6/plugin_net.pyr � s zNetTuningPlugin.__init__c C sh d| _ t� | _t� | _tjd�}x.| jjd�D ] }|j|j �r.| jj |j � q.W t j dt| j� � d S )NTz(?!.*/virtual/.*)�netz devices: %s)Z_devices_supported�setZ _free_devicesZ_assigned_devices�re�compile�_hardware_inventoryZ get_devices�matchZ device_path�addZsys_name�log�debug�str)r Zre_not_virtual�devicer r r � _init_devices� s z NetTuningPlugin._init_devicesc s � fdd�|D �S )Nc s g | ]}� j jd |��qS )r )r Z get_device)�.0�x)r r r � <listcomp>� s z7NetTuningPlugin._get_device_objects.<locals>.<listcomp>r )r Zdevicesr )r r �_get_device_objects� s z#NetTuningPlugin._get_device_objectsc C sX d|_ | j|jd �r<d|_| jjd|j�|_i |_i |_ nd|_d |_d |_d |_ d S )NT�dynamicr F) Z_has_static_tuningZ _option_boolZoptionsZ_has_dynamic_tuning�_monitors_repositoryZcreateZassigned_devices� _load_monitor�_idle�_stats)r �instancer r r �_instance_init� s z NetTuningPlugin._instance_initc C s" |j d k r | jj|j � d |_ d S )N)r( r' �delete)r r+ r r r �_instance_cleanup� s z!NetTuningPlugin._instance_cleanupc C s | j ||� d S )N)�_instance_update_dynamic)r r+ r r r r �_instance_apply_dynamic� s z'NetTuningPlugin._instance_apply_dynamicc C s< dd� |j j|�D �}|d kr"d S ||jkr8| j||� | j|||� | j||� |j| }|j| }|d dkr�|d | jkr�|d | jkr�d|d< tj d| � t |�j d � nF|d dkr�|d dks�|d dkr�d|d< tj d | � t |�j � tj d ||d |d f � tj d ||d |d |d f � d S ) Nc S s g | ] }t |��qS r )�int)r" �valuer r r r$ � s z<NetTuningPlugin._instance_update_dynamic.<locals>.<listcomp>�levelr �read�writer z%s: setting 100Mbps�d z%s: setting max speedz %s load: read %0.2f, write %0.2fz$%s idle: read %d, write %d, level %d)r( Zget_device_loadr* �_init_stats_and_idle� _update_stats� _update_idler) r r �infor Z set_speed� set_max_speedr )r r+ r �loadZstatsZidler r r r/ � s& ($ z(NetTuningPlugin._instance_update_dynamicc C s2 d d d d d d d d d d d d d d d d d d d d d d d�S )N)z adaptive-rxz adaptive-txzrx-usecsz rx-framesz rx-usecs-irqz rx-frames-irqztx-usecsz tx-framesz tx-usecs-irqz tx-frames-irqzstats-block-usecsz pkt-rate-lowz rx-usecs-lowz rx-frames-lowz tx-usecs-lowz tx-frames-lowz pkt-rate-highz rx-usecs-highzrx-frames-highz tx-usecs-highztx-frames-highzsample-intervalr )�clsr r r � _get_config_options_coalesce� s, z,NetTuningPlugin._get_config_options_coalescec C s d d d d�S )N)�autoneg�rx�txr )r= r r r �_get_config_options_pause� s z)NetTuningPlugin._get_config_options_pausec C s d d d d d�S )N)r@ zrx-minizrx-jumborA r )r= r r r �_get_config_options_ring s z(NetTuningPlugin._get_config_options_ringc C s d d d d d�S )N)r@ rA �other�combinedr )r= r r r � _get_config_options_channels s z,NetTuningPlugin._get_config_options_channelsc C s dd d d d d d d d d d� S )NT) r& � wake_on_lan�nf_conntrack_hashsize�features�coalesce�pause�ring�channels� txqueuelen�mtur )r= r r r �_get_config_options s z#NetTuningPlugin._get_config_optionsc C sF | j t|�j� �}ddg d|dg d�|j|< dddd�|j|< d S )N� r � r )�new�max)r3 r4 r5 )� _calc_speedr Z get_max_speedr* r) )r r+ r Z max_speedr r r r7 s z$NetTuningPlugin._init_stats_and_idlec C s� |j | d |j | d< }||j | d< dd� t||�D �}||j | d< |j | d }dd� t||�D �}||j | d< t|d �t|d � |j | d < t|d �t|d � |j | d < d S ) NrS �oldc S s g | ]}|d |d �qS )r r r )r" Znew_oldr r r r$ ( s z1NetTuningPlugin._update_stats.<locals>.<listcomp>�diffrT c S s g | ] }t |��qS r )rT )r" Zpairr r r r$ - s r r4 rR r5 )r* �zip�float)r r+ r Znew_loadZold_loadrW Z old_max_loadZmax_loadr r r r8 " s "z NetTuningPlugin._update_statsc C sL xFdD ]>}|j | | | jk r6|j| | d7 < qd|j| |< qW d S )Nr4 r5 r r )r4 r5 )r* r r) )r r+ r Z operationr r r r9 4 s z NetTuningPlugin._update_idlec C sH ||j krD|j | d dkrDd|j | d< tjd| � t|�j� d S )Nr3 r z%s: setting max speed)r) r r: r r; )r r+ r r r r �_instance_unapply_dynamic< s z)NetTuningPlugin._instance_unapply_dynamicc C s t d| d �S )Ng333333�?i � g333333�@g333333#A)r1 )r Zspeedr r r rU B s zNetTuningPlugin._calc_speedc C s� | j j|�}ttjdd|��j� }t|�}|d dkrPtjd|t|�f � d S |dkr^t � S t t t |d d d� |dd d� ���S )Nz (:\s*)|(\s+)|(\s*;\s*)|(\s*,\s*)� rR r zinvalid %s parameter: '%s'r ) Z _variables�expandr r �sub�split�lenr �error�dict�listrX )r r2 �context�vZlvr r r �_parse_config_parametersK s z(NetTuningPlugin._parse_config_parametersc C s| | j jddddddddd d d d d dddddd�|�}dd� |jd�D �}t|�dk rXd S tdd� dd� |dd � D �D ��S )Nz adaptive-rx:z adaptive-tx:zrx-frames-low:zrx-frames-high:ztx-frames-low:ztx-frames-high:zlro:zrx:ztx:zsg:ztso:zufo:zgso:zgro:zrxvlan:ztxvlan:zntuple:zrxhash:)z Adaptive RX:z\s+TX:z rx-frame-low:zrx-frame-high:z tx-frame-low:ztx-frame-high:zlarge-receive-offload:zrx-checksumming:ztx-checksumming:zscatter-gather:ztcp-segmentation-offload:zudp-fragmentation-offload:z generic-segmentation-offload:zgeneric-receive-offload:zrx-vlan-offload:ztx-vlan-offload:zntuple-filters:zreceive-hashing:c S s2 g | ]*}t t|��d krtjdt|�� r|�qS )r z \[fixed\]$)r` r r �search)r" re r r r r$ s s z<NetTuningPlugin._parse_device_parameters.<locals>.<listcomp>� rR c S s g | ]}t |�d kr|�qS )rR )r` )r" �ur r r r$ x s c S s g | ]}t jd t|���qS )z:\s*)r r_ r )r" re r r r r$ x s r )r �multiple_re_replacer_ r` rb )r r2 Zvlr r r �_parse_device_parametersZ s0 z(NetTuningPlugin._parse_device_parametersc C s dS )Nz,/sys/module/nf_conntrack/parameters/hashsizer )r r r r �_nf_conntrack_hashsize_pathz s z+NetTuningPlugin._nf_conntrack_hashsize_pathrG T)Z per_devicec C s^ |d kr d S t jddt|��}t jdt d |�s@tjd� d S |sZ| jjdd|d|g� |S ) N�0�dz^[z]+$z Incorrect 'wake_on_lan' value.�ethtoolz-sZwol) r r^ r r � WOL_VALUESr �warnr �execute)r r2 r �sim�remover r r �_set_wake_on_lan~ s z NetTuningPlugin._set_wake_on_lanFc C sX d }y:t jdt d | jjd|g�d t j�}|r<|jd�}W n tk rR Y nX |S )Nz.*Wake-on:\s*([z]+).*ro r )r r rp r rr �S�group�IOError)r r �ignore_missingr2 �mr r r �_get_wake_on_lan� s (z NetTuningPlugin._get_wake_on_lanrH c C sN |d kr d S t |�}|dkrF|sB| jj| j� ||r:tjgndd� |S d S d S )Nr F)Zno_error)r1 r Z write_to_filerl �errno�ENOENT)r r2 rs rt Zhashsizer r r �_set_nf_conntrack_hashsize� s z*NetTuningPlugin._set_nf_conntrack_hashsizec C s( | j j| j� �}t|�dkr$t|�S d S )Nr )r Z read_filerl r` r1 )r r2 r r r �_get_nf_conntrack_hashsize� s z*NetTuningPlugin._get_nf_conntrack_hashsizec C sz | j s d S ddg| }| jj|tjgdd�\}}}|tj krRtjd� d| _ d S |rvtjd� tjd||f � d S |S ) NZip�linkT)� no_errorsZ return_errz0ip command not found, ignoring for other devicesFzProblem calling ip commandz(rc: %s, msg: '%s')) r r rr r| r} r rq r: r )r r Zrc�outZerr_msgr r r � _call_ip_link� s z NetTuningPlugin._call_ip_linkNc C s dg}|r|j |� | j|�S )NZshow)�appendr� )r r r r r r � _ip_link_show� s z NetTuningPlugin._ip_link_showrN c C sr |d kr d S y t |� W n" tk r: tjd| � d S X |sn| jdd|d|g�}|d krntjd| � d S |S )Nz$txqueuelen value '%s' is not integerr �devrN z%Cannot set txqueuelen for device '%s')r1 � ValueErrorr rq r� )r r2 r rs rt �resr r r �_set_txqueuelen� s z NetTuningPlugin._set_txqueuelenc C s( || j kr tjd| �| j |< | j | S )z@ Return regex for int arg value from "ip link show" command z.*\s+%s\s+(\d+))r r r )r �argr r r �_get_re_ip_link_show� s z$NetTuningPlugin._get_re_ip_link_showc C s` | j |�}|d kr(|s$tjd| � d S | jd�j|�}|d krV|sRtjd| � d S |jd�S )NzECannot get 'ip link show' result for txqueuelen value for device '%s'ZqlenzFCannot get txqueuelen value from 'ip link show' result for device '%s'r )r� r r: r� rg rw )r r ry r� r� r r r �_get_txqueuelen� s z NetTuningPlugin._get_txqueuelenrO c C sr |d kr d S y t |� W n" tk r: tjd| � d S X |sn| jdd|d|g�}|d krntjd| � d S |S )Nz mtu value '%s' is not integerr r� rO z Cannot set mtu for device '%s')r1 r� r rq r� )r r2 r rs rt r� r r r �_set_mtu� s zNetTuningPlugin._set_mtuc C s` | j |�}|d kr(|s$tjd| � d S | jd�j|�}|d krV|sRtjd| � d S |jd�S )Nz>Cannot get 'ip link show' result for mtu value for device '%s'rO z?Cannot get mtu value from 'ip link show' result for device '%s'r )r� r r: r� rg rw )r r ry r� r� r r r �_get_mtu� s zNetTuningPlugin._get_mtuc C sl |dkr dS t |j� �}| j| j| j| jd�}t || � j� �}|j|�shtjd|t || �f � dS dS )NrI T)rJ rK rL rM zunknown %s parameter(s): %sF) r �keysr> rB rC rF �issubsetr ra r )r rd rn ZparamsZsupported_getterZ supportedr r r �_check_parameters s z!NetTuningPlugin._check_parametersc C sR | j jdddd�|�}|jd�dd � }dd� |D �}td d� d d� |D �D ��S ) Nr? r@ rA )Z Autonegotiate�RX�TXrh r c S s& g | ] }|d krt jd|� r|�qS )� z \[fixed\])r rg )r" r# r r r r$ s z;NetTuningPlugin._parse_pause_parameters.<locals>.<listcomp>c S s g | ]}t |�d kr|�qS )rR )r` )r" r# r r r r$ s c S s g | ]}t jd |��qS )z:\s*)r r_ )r" r# r r r r$ s )r rj r_ rb )r �s�lr r r �_parse_pause_parameters s z'NetTuningPlugin._parse_pause_parametersc C sj t jd|t jd�}|d }| jjddddd�|�}|jd �}d d � |D �}d d � d d � |D �D �}t|�S )Nz ^Current hardware settings:$)�flagsr r@ zrx-minizrx-jumborA )r� zRX MinizRX Jumbor� rh c S s g | ]}|d kr|�qS )r� r )r" r# r r r r$ , s z:NetTuningPlugin._parse_ring_parameters.<locals>.<listcomp>c S s g | ]}t |�d kr|�qS )rR )r` )r" r# r r r r$ - s c S s g | ]}t jd |��qS )z:\s*)r r_ )r" r# r r r r$ - s )r r_ � MULTILINEr rj rb )r r� �ar� r r r �_parse_ring_parameters# s z&NetTuningPlugin._parse_ring_parametersc C sj t jd|t jd�}|d }| jjddddd�|�}|jd �}d d � |D �}d d � d d � |D �D �}t|�S )Nz ^Current hardware settings:$)r� r r@ rA rD rE )r� r� ZOtherZCombinedrh c S s g | ]}|d kr|�qS )r� r )r" r# r r r r$ : s z>NetTuningPlugin._parse_channels_parameters.<locals>.<listcomp>c S s g | ]}t |�d kr|�qS )rR )r` )r" r# r r r r$ ; s c S s g | ]}t jd |��qS )z:\s*)r r_ )r" r# r r r r$ ; s )r r_ r� r rj rb )r r� r� r� r r r �_parse_channels_parameters1 s z*NetTuningPlugin._parse_channels_parametersc C sz g }d|kr(|j d|d d|d g� n,ttt|d �t|d ���}|j d|g� ttt|d d d� |dd d� ���S )NrE r@ r rA � rR )�extendr rT r1 rb rc rX )r rd Z params_list� dev_paramsZmod_params_listZcntr r r � _replace_channels_parameters> s z,NetTuningPlugin._replace_channels_parametersc C sR t |j� �}t |j� �}|| }x,|D ]$}tjd|||f � |j|d� q&W dS )a Filter unsupported parameters and log warnings about it Positional parameters: context -- context of change parameters -- parameters to change device -- name of device on which should be parameters set dev_params -- dictionary of currently known parameters of device z-%s parameter %s is not supported by device %sN)r r� r Zwarning�pop) r rd Z parametersr r� Zsupported_parametersZparameters_to_changeZunsupported_parameters�paramr r r �_check_device_supportG s z%NetTuningPlugin._check_device_supportc C s� dddddd�}|| }| j jd||g�\}}|dksBt|�dkrFd S | j| j| j| j| jd�}|| }||�} |d kr�| j|| � r�d S | S ) Nz-cz-kz-az-gz-l)rJ rI rK rL rM ro r rJ )r rr r` rk r� r� r� r� ) r rd r � context2opt�opt�retr2 Zcontext2parser�parserrn r r r �_get_device_parameters^ s z&NetTuningPlugin._get_device_parametersc C s� |d kst |�dkrd S | j||�}|d ks:| j||� r>i S |r�| j||||� |dkr�t|tt|�� �dkr�| j|| jj |�|�}| r�t |�dkr�t j d|t|�f � dddd d d �}|| }| jj d ||g| jj |� d gd� |S )Nr rM �n/arm zsetting %s: %sz-Cz-Kz-Az-Gz-L)rJ rI rK rL rM ro �P )r� )r� rm ) r` rf r� r� r �next�iterr� r � dict2listr r rr ) r rd r2 r rs r� rn r� r� r r r �_set_device_parametersp s $z&NetTuningPlugin._set_device_parametersc s� | j ||d�}|r�| j||�}|d ks2t|�dkr6dS | j|||||d�� � d ks^t� �dkrbdS � fdd�|j� D �}t|�}|r�| jj� �| jj|�k} | j|| � ||d� | S | j j |dj | jj|��� n | j j |�} | j|| |d� d S ) N)Z command_nameZ device_namer F)r� c s g | ]\}}|� kr||f�qS r r )r" r� r2 )� params_setr r r$ � s z6NetTuningPlugin._custom_parameters.<locals>.<listcomp>)r r\ ) Z _storage_keyr� r` r� �itemsrb r r� Z_log_verification_resultZ_storager �join�get) r rd �startr2 r �verifyZ storage_keyZparams_currentZrelevant_params_currentr� �original_valuer )r� r �_custom_parameters� s: z"NetTuningPlugin._custom_parametersrI c C s | j d||||�S )NrI )r� )r r� r2 r r� ry r r r � _features� s zNetTuningPlugin._featuresrJ c C s | j d||||�S )NrJ )r� )r r� r2 r r� ry r r r � _coalesce� s zNetTuningPlugin._coalescerK c C s | j d||||�S )NrK )r� )r r� r2 r r� ry r r r �_pause� s zNetTuningPlugin._pauserL c C s | j d||||�S )NrL )r� )r r� r2 r r� ry r r r �_ring� s zNetTuningPlugin._ringrM c C s | j d||||�S )NrM )r� )r r� r2 r r� ry r r r � _channels� s zNetTuningPlugin._channels)F)N)F)F)N)6�__name__� __module__� __qualname__�__doc__r r! r% r, r. r0 r/ � classmethodr> rB rC rF rP r7 r8 r9 rZ rU rf rk rl Z command_setru Z command_getr{ r~ r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� Zcommand_customr� r� r� r� r� � __classcell__r r )r r r sd &r )r| r� r Z decoratorsZ tuned.logsZtunedZtuned.utils.nettoolr Ztuned.utils.commandsr �osr Zlogsr� r rp ZPluginr r r r r �<module> s