EVOLUTION-NINJA
Edit File: plugin_disk.cpython-36.pyc
3 `��g�B � @ sj d dl Z ddlmZ ddlT d dlZd dljZd dlm Z d dl Z d dl Z ej j � ZG dd� dej�ZdS )� N� )�hotplug)�*)�commandsc s� e Zd ZdZ� fdd�Z� fdd�Zdd� Zdd � Zed d � �Z d d � Z dd� Z � fdd�Z � fdd�Z � fdd�Zedd� �Zedd� �Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&d'� Zd(d)� Zd*d+� Z� fd,d-�Zd.d/� ZdZd1d2�Z d3d4� Z e d5d6d7�d8d9� �Z e d5�d[d;d<��Z!e d=d6d7�d>d?� �Z"e d=�d\d@dA��Z#e dBd6d7�dCdD� �Z$e dB�d]dEdF��Z%dGdH� Z&dIdJ� Z'e dKd6d7�dLdM� �Z(e dK�d^dNdO��Z)e*dPd6d7�dQdR� �Z+dSdT� Z,e dUd6d7�dVdW� �Z-e dU�d_dXdY��Z.� Z/S )`� DiskPlugina� `disk`:: Plug-in for tuning various block device options. This plug-in can also dynamically change the advanced power management and spindown timeout setting for a drive according to the current drive utilization. The dynamic tuning is controlled by the [option]`dynamic` and the global [option]`dynamic_tuning` option in `tuned-main.conf`. + The disk plug-in operates on all supported block devices unless a comma separated list of [option]`devices` is passed to it. + .Operate only on the sda block device ==== ---- [disk] # Comma separated list of devices, all devices if commented out. devices=sda ---- ==== + The [option]`elevator` option sets the Linux I/O scheduler. + .Use the bfq I/O scheduler on xvda block device ==== ---- [disk] device=xvda elevator=bfq ---- ==== + The [option]`scheduler_quantum` option only applies to the CFQ I/O scheduler. It defines the number of I/O requests that CFQ sends to one device at one time, essentially limiting queue depth. The default value is 8 requests. The device being used may support greater queue depth, but increasing the value of quantum will also increase latency, especially for large sequential write work loads. + The [option]`apm` option sets the Advanced Power Management feature on drives that support it. It corresponds to using the `-B` option of the `hdparm` utility. The [option]`spindown` option puts the drive into idle (low-power) mode, and also sets the standby (spindown) timeout for the drive. It corresponds to using `-S` option of the `hdparm` utility. + .Use a medium-agressive power management with spindown ==== ---- [disk] apm=128 spindown=6 ---- ==== + The [option]`readahead` option controls how much extra data the operating system reads from disk when performing sequential I/O operations. Increasing the `readahead` value might improve performance in application environments where sequential reading of large files takes place. The default unit for readahead is KiB. This can be adjusted to sectors by specifying the suffix 's'. If the suffix is specified, there must be at least one space between the number and suffix (for example, `readahead=8192 s`). + .Set the `readahead` to 4MB unless already set to a higher value ==== ---- [disk] readahead=>4096 ---- ==== The disk readahead value can be multiplied by the constant specified by the [option]`readahead_multiply` option. c sr t t| �j||� ddddddddd d d d g | _d dddddddddd dg | _t| j�| _d| _d| _t � | _ d S )N� �� �� � � �} �i �U �F �7 � � r � �� �� � � � � �n �Z �< � g{�G�z�?) �superr �__init__� _power_levels�_spindown_levels�len�_levels� _level_steps�_load_smallestr �_cmd)�self�args�kwargs)� __class__� �!/usr/lib/python3.6/plugin_disk.pyr X s zDiskPlugin.__init__c sd t t| �j� d| _d| _t� | _t� | _x,| j j d�D ] }| j |�r8| jj |j � q8W t� | _d S )NT�block)r r � _init_devicesZ_devices_supported� _use_hdparm�setZ _free_devices�dict�_hdparm_apm_device_support�_hardware_inventoryZ get_devices�_device_is_supported�addZsys_nameZ_assigned_devices)r' �device)r* r+ r, r. b s zDiskPlugin._init_devicesc s � fdd�|D �S )Nc s g | ]}� j jd |��qS )r- )r3 Z get_device)�.0�x)r' r+ r, � <listcomp>n s z2DiskPlugin._get_device_objects.<locals>.<listcomp>r+ )r' Zdevicesr+ )r' r, �_get_device_objectsm s z DiskPlugin._get_device_objectsc C s� | j s dS || jkr | j| S | jjddd| gtjgdd�\}}}|tj krdtjd� d| _ dS |r�tjd| � tj d ||f � d| j|< dS d |kr�tjd | � d| j|< dS d| j|< dS ) NF�hdparmz-Cz/dev/%sT)� no_errorsZ return_errz4hdparm command not found, ignoring for other devicesz#Device '%s' not supported by hdparmz(rc: %s, msg: '%s')�unknownz3Driver for device '%s' does not support apm command) r/ r2 r& �execute�errno�ENOENT�log�warn�info�debug)r' r6 �rc�outZerr_msgr+ r+ r, �_is_hdparm_apm_supportedp s* z#DiskPlugin._is_hdparm_apm_supportedc C s2 |j dko0|jjdd �dko0|jd kp0|jjdkS ) N�diskZ removable� 0�scsi�virtio�xen�nvme)rJ rK rL rM )Z device_typeZ attributes�get�parentZ subsystem)�clsr6 r+ r+ r, r4 � s z DiskPlugin._device_is_supportedc C s | j j| d| j� d S )Nr- )r3 Z subscribe�_hardware_events_callback)r' r+ r+ r, �_hardware_events_init� s z DiskPlugin._hardware_events_initc C s | j j| � d S )N)r3 Z unsubscribe)r' r+ r+ r, �_hardware_events_cleanup� s z#DiskPlugin._hardware_events_cleanupc s( | j |�s|dkr$tt| �j||� d S )N�remove)r4 r r rQ )r' Zeventr6 )r* r+ r, rQ � s z$DiskPlugin._hardware_events_callbackc s, |j d k r|j j|� tt| �j||� d S )N)� _load_monitorZ add_devicer r �_added_device_apply_tuning)r' �instance� device_name)r* r+ r, rV � s z%DiskPlugin._added_device_apply_tuningc s, |j d k r|j j|� tt| �j||� d S )N)rU Z remove_devicer r � _removed_device_unapply_tuning)r' rW rX )r* r+ r, rY � s z)DiskPlugin._removed_device_unapply_tuningc C s dd d d d d d d�S )NT)�dynamic�elevator�apm�spindown� readahead�readahead_multiply�scheduler_quantumr+ )rP r+ r+ r, �_get_config_options� s z DiskPlugin._get_config_optionsc C s ddgS )Nr\ r] r+ )rP r+ r+ r, �#_get_config_options_used_by_dynamic� s z.DiskPlugin._get_config_options_used_by_dynamicc C sd d|_ d| _d| _| j|jd �rTd|_| jjd|j�|_ i |_ i |_ i |_ i |_ n d|_d |_ d S )NTr rZ rH F)Z_has_static_tuning� _apm_errcnt�_spindown_errcntZ _option_boolZoptionsZ_has_dynamic_tuning�_monitors_repositoryZcreateZassigned_devicesrU Z _device_idle�_stats�_idle�_spindown_change_delayed)r' rW r+ r+ r, �_instance_init� s zDiskPlugin._instance_initc C s" |j d k r | jj|j � d |_ d S )N)rU re �delete)r' rW r+ r+ r, �_instance_cleanup� s z DiskPlugin._instance_cleanupc C s� |rd}| j }n d}| j}|tjkr(d S |dkr6d}nL|tj krbtjd | _ | _tjd� d S |d7 }|tjkr�tjd| � |r�|| _ n|| _d S )Nr] r\ r r zIhdparm command not found, ignoring future set_apm / set_spindown commandsz5disabling set_%s command: too many consecutive errors) rd rc �consts�ERROR_THRESHOLDr? r@ rA rB rC )r' rE r] �sZcntr+ r+ r, �_update_errcnt� s& zDiskPlugin._update_errcntc C sN t jd| � | jjdd| d| gtjgd�\}}| j|d� d|j|< d S )Nzchanging spindown to %dr; z-S%dz/dev/%s)r< TF)rA rD r& r> r? r@ ro rh )r' rW r6 �new_spindown_levelrE rF r+ r+ r, �_change_spindown� s & zDiskPlugin._change_spindownc C s2 | j jddd| gtjgd�\}}d|ko0d|kS )Nr; z-Cz/dev/%s)r< ZstandbyZsleeping)r& r> r? r@ )r' r6 rE rF r+ r+ r, �_drive_spinning� s "zDiskPlugin._drive_spinningc C s( | j |�sd S |jj|�}|d kr&d S ||jkr<| j||� | j|||� | j||� |j| }|j| }|d d | jk r�|d | j kr�|d | j kr�d}n.|d dkr�|d dks�|d dkr�d}nd}|dk�r�|d |7 < | j |d }| j |d }t j d|d � | jtjk �rb| j|� �rT|dk�rTt j d| � d|j|< n| j|||� | jtjk �r�t j d | � | jjd d | d | gtjgd �\} } | j| d� n4|j| �r�| j|��r�| j |d }| j|||� t j d||d |d f � t j d||d |d |d f � d S )N�levelr �read�writer ztuning level changed to %dz;delaying spindown change to %d, drive has already spun downTzchanging APM_level to %dr; z-B%dz/dev/%s)r< Fz %s load: read %0.2f, write %0.2fz$%s idle: read %d, write %d, level %d���)rG rU Zget_device_loadrf �_init_stats_and_idle� _update_stats� _update_idlerg r# r$ r r! rA rD rd rl rm rr rh rq rc r& r> r? r@ ro ) r' rW r6 �loadZstatsZidleZ level_changeZnew_power_levelrp rE rF r+ r+ r, �_instance_update_dynamic� sF .$ & z#DiskPlugin._instance_update_dynamicc C sD ddg ddg ddg d�|j |< dddd�|j|< d|j|< d S )N� r r )�new�old�max)rs rt ru F)rf rg rh )r' rW r6 r+ r+ r, rw ! s $z DiskPlugin._init_stats_and_idlec C s� |j | d |j | d< }||j | d< dd� t||�D �}||j | d< |j | d }dd� t||�D �}||j | d< t|d �t|d � |j | d < t|d �t|d � |j | d < d S ) Nr} r~ c S s g | ]}|d |d �qS )r r r+ )r7 Znew_oldr+ r+ r, r9 + s z,DiskPlugin._update_stats.<locals>.<listcomp>�diffr c S s g | ] }t |��qS r+ )r )r7 Zpairr+ r+ r, r9 0 s r rt � ru )rf �zip�float)r' rW r6 Znew_loadZold_loadr� Z old_max_loadZmax_loadr+ r+ r, rx & s "zDiskPlugin._update_statsc C sL xFdD ]>}|j | | | jk r6|j| | d7 < qd|j| |< qW d S )Nrt ru r r )rt ru )rf r% rg )r' rW r6 Z operationr+ r+ r, ry 7 s zDiskPlugin._update_idlec s0 | j |�stjd| � ntt| �j||� d S )Nz<There is no dynamic tuning available for device '%s' at time)rG rA rC r r �_instance_apply_dynamic)r' rW r6 )r* r+ r, r� ? s z"DiskPlugin._instance_apply_dynamicc C s d S )Nr+ )r' rW r6 r+ r+ r, �_instance_unapply_dynamicH s z$DiskPlugin._instance_unapply_dynamic� /sys/block/c C s@ d|kr0t jj||jdd�|�}t jj|�r0|S t jj|||�S )N�/�!)�os�path�join�replace�exists)r' r6 �suffix�prefixZdevr+ r+ r, � _sysfs_pathK s zDiskPlugin._sysfs_pathc C s | j |d�S )Nzqueue/scheduler)r� )r' r6 r+ r+ r, �_elevator_fileR s zDiskPlugin._elevator_filer[ T)Z per_devicec C s0 | j |�}|s,| jj|||r$tjgndd� |S )NF)�no_error)r� r& � write_to_filer? r@ )r' �valuer6 �simrT �sys_filer+ r+ r, � _set_elevatorU s zDiskPlugin._set_elevatorFc C s" | j |�}| jj| jj||d��S )N)r� )r� r& Zget_active_option� read_file)r' r6 �ignore_missingr� r+ r+ r, � _get_elevator] s zDiskPlugin._get_elevatorr\ c C s| | j |�s(|s tjd| � d S t|�S | jtjk rt|sl| jjddt|�d| gt j gd�\}}| j |d� t|�S d S d S )Nz+apm option is not supported for device '%s'r; z-Bz/dev/)r< F) rG rA rC �strrc rl rm r& r> r? r@ ro )r' r� r6 r� rT rE rF r+ r+ r, �_set_apmd s ( zDiskPlugin._set_apmc C s� | j |�s |s tjd| � d S d }d}| jjddd| gtjgd�\}}|tj krZd S |dkrhd}n@tjd |tj �}|r�yt |j d ��}W n t k r� d}Y nX |r�tj d | � |S ) Nz+apm option is not supported for device '%s'Fr; z-Bz/dev/)r< r Tz .*=\s*(\d+).*r z2could not get current APM settings for device '%s')rG rA rC r& r> r? r@ �re�match�S�int�group� ValueError�error)r' r6 r� r� �errrE rF �mr+ r+ r, �_get_apmt s( " zDiskPlugin._get_apmr] c C s| | j |�s(|s tjd| � d S t|�S | jtjk rt|sl| jjddt|�d| gt j gd�\}}| j |d� t|�S d S d S )Nz0spindown option is not supported for device '%s'r; z-Sz/dev/)r< T) rG rA rC r� rd rl rm r& r> r? r@ ro )r' r� r6 r� rT rE rF r+ r+ r, � _set_spindown� s ( zDiskPlugin._set_spindownc C s$ | j |�s |s tjd| � d S dS )Nz0spindown option is not supported for device '%s'� )rG rA rC )r' r6 r� r+ r+ r, � _get_spindown� s zDiskPlugin._get_spindownc C s | j |d�S )Nzqueue/read_ahead_kb)r� )r' r6 r+ r+ r, �_readahead_file� s zDiskPlugin._readahead_filec C s^ t |�jd d�}yt|d �}W n tk r4 d S X t|�dkrZ|d d dkrZ|d }|S )Nr r rn � )r� �splitr� r� r" )r' r� �val�vr+ r+ r, � _parse_ra� s zDiskPlugin._parse_rar^ c C sZ | j |�}| j|�}|d kr0tjd||f � n&|sV| jj|d| |rNtjgndd� |S )Nz,Invalid readahead value '%s' for device '%s'z%dF)r� )r� r� rA r� r& r� r? r@ )r' r� r6 r� rT r� r� r+ r+ r, �_set_readahead� s zDiskPlugin._set_readaheadc C s6 | j |�}| jj||d�j� }t|�dkr.d S t|�S )N)r� r )r� r& r� �stripr" r� )r' r6 r� r� r� r+ r+ r, �_get_readahead� s zDiskPlugin._get_readaheadr_ c C s� |rd S | j d|d�}|r^| j|�}|d kr0d S tt|�| �}| jj||� | j||d� n2| jj|�}|d krvd S | j||d� | jj|� d S )Nr_ )Z command_namerX F) Z _storage_keyr� r� r� Z_storager0 r� rN Zunset) r' ZenablingZ multiplierr6 Zverifyr� Z storage_keyZ old_readaheadZ new_readaheadr+ r+ r, �_multiply_readahead� s" z DiskPlugin._multiply_readaheadc C s | j |d�S )Nzqueue/iosched/quantum)r� )r' r6 r+ r+ r, �_scheduler_quantum_file� s z"DiskPlugin._scheduler_quantum_filer` c C s8 | j |�}|s4| jj|dt|� |r,tjgndd� |S )Nz%dF)r� )r� r& r� r� r? r@ )r' r� r6 r� rT r� r+ r+ r, �_set_scheduler_quantum� s z!DiskPlugin._set_scheduler_quantumc C sH | j |�}| jj||d�j� }t|�dkr@|s<tjd| � d S t|�S )N)r� r z>disk_scheduler_quantum option is not supported for device '%s')r� r& r� r� r" rA rC r� )r' r6 r� r� r� r+ r+ r, �_get_scheduler_quantum� s z!DiskPlugin._get_scheduler_quantum)r� )F)F)F)F)F)0�__name__� __module__� __qualname__�__doc__r r. r: rG � classmethodr4 rR rS rQ rV rY ra rb ri rk ro rq rr r{ rw rx ry r� r� r� r� Z command_setr� Z command_getr� r� r� r� r� r� r� r� r� Zcommand_customr� r� r� r� � __classcell__r+ r+ )r* r, r sZ J 2 r )r? � r Z decoratorsZ tuned.logsZtunedZ tuned.constsrl Ztuned.utils.commandsr r� r� ZlogsrN rA ZPluginr r+ r+ r+ r, �<module> s