blkiocost权重限速AlibabaCloudLinux(Alinux)

cgroupv1和cgroupv2是Linux内核中的两个不同版本的资源管理功能。在AlibabaCloudLinux内核中,blk-iocost功能同时支持cgroupv1和v2接口,但通常在一个系统中只有一个版本是被激活和使用的。您可以通过stat-fc%T/sys/fs/cgroup命令查看当前系统使用的是cgroupv1接口还是cgroupv2接口:

回显为tmpfs:表示cgroupv1接口。

回显为cgroup2fs:表示cgroupv2接口。

该接口用于开启或关闭blk-iocost功能以及基于延迟(latency)权重限制I/O服务质量(QoS)的速率。是一个可读可写接口,接口文件只存在于blkcg根组,且在不同cgroup中的完整名称不同:

cgroupv1:接口文件完整名称为blkio.cost.qos。

cgroupv2:接口文件完整名称为io.cost.qos。

接口配置说明:

每行配置以设备的Major号和Minor号开头,格式为MAJ:MIN(通过lsblk|grep<云盘名称>命令查询设备号),后边衔接其他配置项,说明如下。

enable:是否开启blk-iocost功能。

默认值0:关闭blk-iocost功能。

修改为1:开启blk-iocost功能。

ctrl:控制模式,可选值为auto和user。

auto:系统自动探测设备类型并使用内置参数。

设置ctrl=auto时,如果ECS实例挂载的云盘存储类型为SSD云盘、ESSD云盘或NVMeSSD本地盘等固态存储设备时,需要手动将对应云盘的rotational属性设置为0。blk-iocost可以更准确地估计I/O成本并相应地调整其调度策略,以提高固态存储设备的I/O性能。命令示例如下:

sudosh-c'echo0>/sys/block//queue/rotational'#需替换为实际的云盘名称user:需要用户手动设置以下控制参数。

rpct:读延迟百分比,取值范围为[0,100]。

rlat:读延迟,单位为us。

wpct:写延迟百分比,取值范围为[0,100]。

wlat:写延迟,单位为us。

min:最小速率调整比例,取值范围为[1,10000]。

max:最大速率调整比例,取值范围为[1,10000]。

该接口用于设置成本模型(costmodel)。是一个可读可写接口,接口文件只存在于blkcg根组,且在不同cgroup中的完整名称不同:

cgroupv1:接口文件完整名称为blkio.cost.model。

cgroupv2:接口文件完整名称为io.cost.model。

ctrl:控制模式,可选值为auto和user

auto:系统基于当前工作负载自动优化I/O调度策略。

sudosh-c'echo0>/sys/block//queue/rotational'#需替换为实际的云盘名称user:需要用户手动输入模型参数。

model:模型参数,当前只实现了一种模型linear。当模型参数为linear时,定义如下建模参数。

[r|w]bps:最大顺序IO带宽。

[r|w]seqiops:顺序IOPS(Input/OutputOperationsPerSecond)。

[r|w]randiops:随机IOPS。

以上参数可以使用内核源码中的tools/cgroup/iocost_coef_gen.py脚本来生成,然后写入cost.model接口文件内设置成本模型。

该接口可以为每个设备配置权重,也可以修改该整个子组的默认权重(100),范围为[1,10000]。是一个可读可写接口,接口文件只存在blkcg的子组中,且在不同cgroup中的完整名称不同:

在不同cgroup中的完整名称不同:

cgroupv1:接口文件完整名称为blkio.cost.weight。

cgroupv2:接口文件完整名称为io.weight。

cgroupv2:接口文件完整名称为io.cost.weight。

为接口设置权重值:表示修改blkcg的默认权重。

为接口设置端口号和权重值MAJ:MIN:表示修改设备上的blkcg的权重。

仅以下内核版本的AlibabaCloudLinux镜像支持配置blk-iocost功能:

AlibabaCloudLinux2:4.19.81-17及以上内核版本。

AlibabaCloudLinux3:所有版本。

场景示例:使用cost.qos接口为设备254:48开启blk-iocost功能,并且当读写请求延迟rlat|wlat有5%超过5ms时,认为磁盘饱和。内核将进行磁盘发送请求速率的调整,调整区间为最低降至原速率的50%,最高升至原速率的150%。cgroupv1接口和cgroupv2接口命令分别如下。

sudosh-c'echo"254:48enable=1ctrl=userrpct=95.00rlat=5000wpct=95.00wlat=5000min=50.00max=150.00">/sys/fs/cgroup/blkio/blkio.cost.qos'cgroupv2接口sudosh-c'echo"254:48enable=1ctrl=userrpct=95.00rlat=5000wpct=95.00wlat=5000min=50.00max=150.00">/sys/fs/cgroup/io.cost.qos'步骤二:使用cost.model接口设置成本模型场景示例:使用cost.model接口在设备254:48上使用用户输入的linear建模参数设置模型。cgroupv1接口和cgroupv2接口命令分别如下。

sudomkdir/sys/fs/cgroup/blkio/blkcg1#创建控制组blkcg1sudosh-c'echo"50">/sys/fs/cgroup/blkio/blkcg1/blkio.cost.weight'#将默认权重修改为50sudosh-c'echo"254:4850">/sys/fs/cgroup/blkio/blkcg1/blkio.cost.weight'#将设备上的权重设置为50cgroupv2接口AlibabaCloudLinux2

sudomkdir/sys/fs/cgroup/cg1#创建控制组cg1sudosh-c'echo"50">/sys/fs/cgroup/cg1/io.cost.weight'#将默认权重修改为50sudosh-c'echo"254:4850">/sys/fs/cgroup/cg1/io.cost.weight'#将设备上的权重设置为50AlibabaCloudLinux3

sudomkdir/sys/fs/cgroup/cg1#创建控制组cg1sudosh-c'echo"50">/sys/fs/cgroup/cg1/io.weight'#将默认权重修改为50sudosh-c'echo"254:4850">/sys/fs/cgroup/cg1/io.weight'#将设备上的权重设置为50常用监测工具blk-iocost需要能够监控和评估系统的I/O性能,可以通过以下工具或接口来监测I/O资源的使用情况,以便帮助您更好地理解和调优I/O资源的使用情况。

iocostmonitor脚本

Linux内核源码中的tools/cgroup/iocost_monitor.py脚本基于drgn调试器可以直接获取内核参数进行I/O性能数据的监控输出。脚本使用方式如下。

首先确保安装drgn调试器。示例命令:

(可选)下载iocost_monitor.py。

如果您没有下载完整的Linux内核源码,需要从Linux内核的公共仓库克隆或下载iocost_monitor.py脚本。示例命令:

sudopython3./iocost_monitor.pvdd返回结果示例如下。

vddRUNper=500.0mscur_per=3930.839:v14620.321busy=+1vrate=6136.22%params=hddactiveweighthweight%inflt%dbtdelayusages%blkcg1*50/509.09/9.090.0000*000009:009:009blkcg2*500/50090.91/90.910.0000*000089:091:092cgroupv1接口下的blkio.cost.stat接口

AlibabaCloudLinux内核提供了在cgroupv1接口下的blk-iocost统计接口,该接口文件中记录了每个受控制的设备的QoS数据。查看该接口文档的命令如下。

cat/sys/fs/cgroup/blkio/blkcg1/blkio.cost.stat返回结果示例如下。

254:48is_active=1active=50inuse=50hweight_active=5957hweight_inuse=5957vrate=159571ftrace监测工具

将enable属性设置为1,开启ftrace工具。

sudosh-c'echo1>/sys/kernel/debug/tracing/events/iocost/enable'

THE END
1.13随着低成本航空公司的运力提升,它们的低票价开始迫使老牌的高成本...原文:As the seat capacity of the low-cost operators expanded, their fares began to force the old-line, high-cost airlines to cut their own. The day of reckoning for these airlines could be delayed by infusions of capital (such as ours int......https://xueqiu.com/1586482256/314956254
1.oraclecloudinfrastructure(oci)Test and developmentWith IaaS, DevOps teams can set up and take down test and development environments quickly and at low cost, so they can get new applications to market faster. Traditional applicationsIaaS supports both cloud native applications and traditional enterprise applications, including ERP...https://www.oracle.com/pt/cloud/what-is-iaas/
2.Bestcloudstoragein2024Tom'sGuideWe review and rank the best cloud storage providers of premium services across storage, security, pricing, and much more.https://www.tomsguide.com/us/best-cloud-backup,review-2678.html
3.云计算以及人工智能将为全球国内生产总值贡献数万亿美元北京2024年11月27日/美通社/ -- 亚马逊云科技联合从事经济影响研究的全球知名市场调查与咨询公司——电信咨询服务(Telecom Advisory Services)发布了三项新研究,这些研究评估了云计算的经济影响力、人工智能的采用情况以及上云所能提升的能源生产率。 研究结果显示,2023年,企业上云对GDP(全球国内生产总值)总体贡献超过1...https://www.prnasia.com/story/470639-1.shtml
4.全球化背景下的cloudprocurement挑战与机遇一、引言 随着全球化的深入发展,企业在市场扩张和资源配置上面临前所未有的挑战。传统的采购模式已经难以满足企业快速增长和多元化需求。云采购(Cloud Procurement)作为一种新型的采购方式,以其灵活性、高效性和成本控制能力,逐渐成为企业数字化转型中的重要组成部分。https://www.xtssy.cn/bi-ye-shuo-shuo/858948.html
5.NETA参加额外8.5折单品在单品页面标注"EXTRA 15% OFF AT CHECKOUT"。订单满$200美国境内免运费。点击购买>>额外8.5折 $95.20 $160.00 ON Cloudflyer 4 运动鞋 额外8.5折 $104.55 $175.00 VEJA 小白鞋 额外8.5折 $739.50 $1450.00 CHLOE Woody 中号托特包 额外8.5折 $271.15 $455.00 MOON BOOT 雪地靴 额外...https://www.dealmoon.com/cn/extra-15-off-net-a-porter-black-friday-sale/4630425.html
6.nuscenes完整数据集下载解压并简单检测完整性,同时统计训练集train...问题解决1--下载并解压完整nuscenes数据集 批量下载命令 download.sh 其中网址可以在nuscenes官网找到,建议运行前复制下网址在浏览器运行,检测网址是否有效 运行下载命令在你想要下载数据集的位置 下载时间很久,建议批量下载,省心方便,在每一条wget指令后面加上 “&” ...https://blog.csdn.net/TheDaker/article/details/144144749
7.cloudatcost$7美金终生VPS注册图文教程cloudatcost 出了最低7美金的终生VPS,不过他们家仅支持PayPal支付。听说网络连接不是很稳定,用来扶墙,练手还是不错的。 7美金配置: 1CPU 512MB RAM 10GB OF STORAGE 1gigabit of internet 网址:http://cloudatcost.com/ 注册步骤: 1.点击首页“SIGN UP TODAY!” ...https://www.jiloc.com/42589.html
8.[CloudArchitect]5.CostandMonitoring51CTO博客Cloud Cost Pricing Key Points An accurate cost estimation that meets and exceeds your organization’s budgetary goals requires you to ask important questions, interpret data, and implement AWS best practices Paid AWS Cloud Services include: https://blog.51cto.com/u_15127649/4341394
9.Here'swhatApple'siCloudDrivewillcostyou,comparedwith...Dropbox and Box have been around for years, and Microsoft recently revamped its cloud offering with a new name and new storage tiers. With so many options to choose from, let's take a look at your choices and what they'll cost you. You can make your own decision on which one is ...https://www.cnet.com/news/apples-icloud-drive-cost/
10.CuttingthecloudcomputingcarboncostCloud computing involves displacing data storage and processing from the user's computer on to remote servers. It can provide users with more storage space and computing power that they can then access from anywhere in the world rather than having to conhttps://phys.org/news/2014-09-cloud-carbon.html
11.NovacloudDesktop–CostThe team at Novacloud guided us with our very first steps into the Azure environment - Highly recommended. Novacloud are a cloud ISV and managed services company focusing on providing highly affordable, highly secure Azure cloud solutions and services for SMEs. Keeping Azure simple, cost-effective...https://novacloud.net/
12.IndustriesCloudSolutionsCostBuurst SoftNAS enables cloud storage at the speed ofon-premisesolutions to meet global resources that demand swift performance. Cloud storage performance solutions for: Content collaboration Ease-of-use eDiscovery Cloud storage cost efficacy: https://www.buurst.com/solutions/vertical-markets/
13.CloudKitchens:WhatisaCloudKitchen&HowtoStartit?Marketing modes.Cloud kitchens typically rely on social media and other online promotions for marketing, whereas traditional restaurants can use both online and in-store marketing strategies. Profit margins.Without the overhead cost of a dining section, cloud kitchens are estimated to accumulate at lea...https://www.fooddocs.com/post/cloud-kitchens
14.CloudCostManagementOptimizeYourCloudSpendGain control of your cloud spend: Analyze and forecast your cloud billing data with real-time insights into your organization’s cloud usage..https://www.cloudgenera.com/
15.CloudCostManagementSolutionsIBMUse insights and automation to optimize performance at the lowest cost and align technology with business value Read the Forrester TEI study Want to get your cloud spend under control? Cloud cost management tools from IBM take an application-driven approach to discover your environment and contextuali...https://www.ibm.com/cn-zh/cloud-cost-management
16.CloudCast:CloudServerCostCalculatorDeloitteUSAre you evaluating cloud migration options of your enterprise workloads? If you already have a cloud or hybrid environment, do you lack insight into your infrastructure costs? Deloitte and the CloudCast solution can help speed your cloud cost analysis and accelerate your decision making on the righ...https://www2.deloitte.com/content/www/us/en/pages/consulting/solutions/cloudcast.html
17.CloudHiroCloudCostOptimizationOur state-of-the-art algorithms detect and eliminate waste, ensuring that your cloud infrastructure operates at peak performance while minimizing unnecessary expenses. CostGraphiX Experience unmatched visibility into your cloud costs from Azure, AWS, GCP and K8S infrastructure using CloudHiro's cutting-...https://www.cloudhiro.com/
18.CloudOperationsSolutionsforOptimization&CostManagementMaximize cost savings for VMs and container infrastructure through AI-driven automated optimization Give stakeholders the visibility and context to make the most cost-efficient purchasing decisions that support business needs Optimize cloud costs See what’s new at Spot by NetApp ...https://www.spotinst.com/
19.CloudCostManagement:TheUltimate2023GuideEffective cloud cost management is crucial for organizations that want to get the most out of their cloud investments. Without a well-planned strategy in place, cloud expenses can easily spiral out of control. Research from Gartner finds that without an https://www.tangoe.com/www.tangoe.com/blog/cloud-cost-management-the-ultimate-2023-guide/
20.SynCloud:AIWhile multi-cloud deployments are gaining steam, cost optimization across different cloud services is a huge priority for organizations. There are many best practices to follow in order to control cloud spending for all the cloud services you are using and these are what SynCloud excels at. ...https://appsource.microsoft.com/zh-cn/product/web-apps/kbquesthongkonglimited1590472250449.syncloud-ai-cloud-solution
21.CeeviewCloudCost&BudgetMonitoringReviews&Ratings2024Supported: Root cause analyses: Drill down for detailed cost- and event analyses. Supported: Dashboards: Get a complete insight into the cost performance of the Cloud environment. Supported: Notification: Stay on top of the Cloud environment by notifying the right people at once. Supported: Mult...https://www.trustradius.com/products/ceeview-cloud-cost-budget-monitoring/reviews
22....thebestcollaborationpracticestoensurecloudcost...Successful cloud cost management andoptimizationat scale requires cross-functional collaboration and expertise beyond technical engineering. Failure to tackle the full cloud financial management (CFM) capability leaves critical activities vulnerable to insufficient coordination, ownership, and continuity of resourc...https://www.gartner.com/reprints/?id=1-2FZ0ANPX&ct=231218&st=sb
23.IBMCloudabilityFocus on cloud efficiency by ensuring that only resources that provide benefit to the organization are used and are consumed at the lowest possible cost. Automation Commitment-Based Discounts Rightsizing Scorecards Views Integrations Cloudability works well with others! Robust integrations enable inputs ...https://www.cloudability.com/
24.FreeCloudTCOAnalysisPerformance&CostOptimizedCloud...Industry leading, independent tool for Cloud TCO Analysis and Migration Assessment focused on workload utilization and license optimization.https://www.cloudamize.com/
25.WhatisDataModernization?ServiceBenefits+ChallengesAdopting Cloud Computing Technology: The chain chooses to migrate to a cloud application for its infrastructure and storage capabilities to accommodate larger amounts of data and improve scalability. Why Data Modernization? At the crux of every organization is a data management system. Whether you’re...https://www.couchbase.com/blog/data-modernization-benefits/
26.GeniusCloudFAQWhat is Genius Cloud? Genius Cloud is Genius Scan's cloud service that backs up your documents in the cloud and keeps them synchronized between all your mobilehttps://help.thegrizzlylabs.com/article/399-genius-cloud-faq
27.GainNewPerspectivesonYourCloudBillGain Perspective with this Cloud Cost Management Tool Setting Cloud Budgets on Perspectives In order to gain control of ballooning cloud spend, it’s imperative to create a shared responsibility and culture that spreads cloud cost visibility across many functions. We built Cloud Cost Management to em...https://harness.io/blog/cloud-cost-management/cloud-cost-perspectives
28.CostOptimizationAWSCloudEnterpriseStrategyBlogThis surge is fueled by enterprises’ ongoing migration of existing workloads, the development of new cloud-native applications, and the emergence of innovative use cases like generative AI. At AWS, our Cloud […]Proven Practices for Developing a Multicloud Strategy by Tom Godden on 13 JUL 2023...http://aws.amazon.com/blogs/enterprise-strategy/tag/cost-optimization/
29.TameLargeTo learn how your organization can benefit from DKP’s integrated cost management for Kubernetes and the cloud,speak with the experts at D2iQ. One of the biggest issues related to large-scale cloud deployments is overspending. It’s no surprise that as organizations scale their cloud-native Kuber...https://d2iq.com/blog/tame-large-scale-cloud-deployment-costs-finops
30.CloudOfficeCostAccelerates verification processes while keeping the cost down, and automatically checks for and fixes errors. Hospitality & Public Industries Reduces queuing and transaction time at counters and improves customer satisfaction. Try Free POC Sharing Economy Enhances user data security in real-name verifica...https://www.huaweicloud.com/intl/en-us/solution/ekyc/index.html
31.CloudBasedServerCost:TipsForBudgetFriendlySolutionsHere is the cloud server pricing for these three cloud service benefactors, including their preliminary cloud based server cost: Cloud Servers Vs. Dedicated Servers Cloud servers are less exclusive than dedicated cloud servers, with the lowest cloud plan opening at $5/month, whereas a dedicated clo...https://www.temok.com/blog/cloud-based-server-cost/
32.ProspectsforWidebandVLBICorrelationintheCloudThe total cost would be 12 × $300 = $3600. The two-way shipping cost of the GTAs for a 16 Gbps observation is estimated at $100 per site, or ~$1000. 6.2. Storage Data storage dominates the cost of the cloud correlation architecture. On the GCS, there are four types of storage...https://iopscience.iop.org/article/10.1088/1538-3873/ab32a8
33.WhatIsCloudEmail?Owners and employees of organizations that use cloud-based email can access their emails at any time, from any place, using any digital device. This level of accessibility boosts productivity and allows employees to work from anywhere they want to. Cost Cutting One of the most important advantage...https://heimdalsecurity.com/blog/what-is-cloud-email/