Wednesday, December 21, 2005

CMG05 trip comments and "utilization is useless..."

I have a good time at the Computer Measurement Group meeting in Orlando recently. Mario Jauvin and I put together a tutorial on "Capacity Planning and Performance Monitoring with Free Tools" that was well attended, although relatively few attendees seem to be using free tools, mostly due to policy and support issues. We also attended James Holtman's workshop on using the free statistics package 'R' for performance data analysis and plotting.

The main new theme at this year's conference seemed to be CPU virtualization. Many people using VMware, Zen, Solaris containers and other virtualization facilities are finding that their measurements of CPU utilization don't make sense any more. Both BMC and Teamquest are working on building some support for virtualization concepts into their tools.

My observation is that utilization is useless as a metric and should be abandoned. It has been useless in virtualized disk subsystems for some time, and is now useless for CPU measurement as well. There used to be a clear relationship between response time and utilization, but systems are now so complex that those relationships no longer hold. Instead, you need to directly measure response time and relate it to throughput. Utilization is properly defined as busy time as a proportion of elapsed time. The replacement for utilization is headroom which is defined as the unused proportion of the maximum possible throughput. Dave Fisk calls this Capability Utilization.

I'm thinking of writing a paper, maybe for next year's CMG on this topic....

Happy holidays everyone
Cheers Adrian

5 comments:

  1. I enjoyed your workshop on free tools. I didn't take me long to implement Orca once I got back to the office and we're already using Nagios.

    I'm on the lookout for other uses for the tools you mentiond.

    ReplyDelete
  2. hi adrian,

    thanks for your post.

    I am downloading ORCA!

    Would be nice to know about the other tools your commentator mentioned. Since the tools are free/open source, it will be useful to others as well :-) I know that you would not want to duplicate your conference presentation here but would appreciate if there's something that could be useful.

    BTW, I've discovered tools like Groundwork that build on top of Nagios --- any opinions on this space ?

    Thank you,

    BR,
    ~A

    ReplyDelete
  3. Hi Adrian,
    I really appreciate your comments on the difficulties of measuring CPU/capacity on hyperthreaded systems. I am currently experiencing the difficulty with this at my current company. Can you tell me if there are any new developments in this area?
    thanks,
    Stephen

    ReplyDelete
  4. Hi Stephen, one of the few tools that can model Hyperthreading correctly is the Hyperformix IPS modelling tool.

    I have submitted a paper abstract for CMG06 called "Utilization is virtually useless as a metric" which I now have to finish writing up into an actual paper....

    One new development is the use of power managed CPUs in servers. That nice 2.6GHz Opteron machine will notice that you aren't using it much and decide to save power by running at 1GHz. The CPU utilization is not normalized to the clock rate, so the system looks busier than it is, and the utilization metric is polluted by a large hidden step function as the clock rate changes.

    Adrian

    ReplyDelete
  5. 活得真累,有些时候我们会禁不住的这样感叹,那些不顺心的日子,我们也总感觉活 wow gold 得真烦。在寻找了千百种理由之后,当我蓦然回首曾经走过的那些岁月,我惊然的发现,其实生活赐予我的,并没 wow power leveling 有与别人有什么的不同,呈现在我视野里的生活,每个人其实都一样,不同的仅仅是我们的胸襟中缺少一份“坦然”。   当看见那些假日的钓鱼者,一大早的出门,在夕阳下却拎着空空的鱼篓回家时,一路上却留下欢声笑语。

      当看见那些早出晚归的农民,在晚霞的辉映下回家时,那张写满疲倦的脸上 wow gold 却洋溢着朝霞一样的笑容。

      当看见那些恋人在分手时,虽然脸上带着一份无奈的笑容,眼里带着一份淡淡的忧伤,但却依然潇洒的挥挥手,互道一声珍重时,不禁内心会这样的感叹,坦然真好!

      突然想起来这样的一句话“天空留不下我的痕迹,但我已飞过”其 wow power leveling 实,这不就是对坦然最好的诠释。

      如果失败是一种人生经历,那么这种经历却会使我们成熟,如果说一个人的成熟必须历尽沧桑的话,那么我想,沧桑就是一种美丽。

      我坦然,于是我心美丽!我心 replica rolex 美丽,于是人生跟着美丽。

      坦然,是一种失意后的乐观!坦然,是沮丧时自我的一种调整。

      坦然,其实就是平淡中的一份自信!坦然 wow power level 是一份快乐!是一种潇洒!

      在人生中,许多的成败与得失,并不是我们都能预料到的,很多的事情也并不是我们都能够承担得起的,但,只要我们努力去做,求得一份付出后的坦然,其实得到的也是一种快乐!

      生活里许多的人,我们是捉摸不定的,甚至 power leveling 防不胜防。但,我们不必去计较,更不必去埋怨,我们唯一做的是,当我们必须去面对他们的时候,同样的奉上我们的真心。以君子之心度小人之怀,那不正显示我们的博大的胸襟吗?

      我曾经爱过也哭过,曾经功成名就过,也 rolex replica 曾失败没落过。但,当我回首这一切的时候,我仍然感到骄傲,因为:我曾勇敢地面对了这一切,且光明而磊落!

      假如生活给我们的只是一次又 lotro gold 一次的挫折,一次又一次的失败,其实,这也没什么的,因为那只是命运剥夺了我们活的高贵的权利,但并没有夺走我们活的快乐和自由的权利。

      没有蓝天的蔚蓝,我们 rolex 可以有白云的飘逸。

      没有大海的壮阔,我们可以有小溪的悠然。

      没有草原的芬芳,我们可以 power leveling 有小草的青翠。

      因为生活里是没有旁观者的,每个人都有一个属于自己的位置,每个人也都能找到一种属于自己的精彩。

      坦然,会让我们的生 rs gold 活美丽而快乐!
      朋友,就让我们的胸襟中盈盈感情坦然吧!

    ReplyDelete