Server Specs - A SearchDataCenter.com blog

Server Specs:

 

A SearchDataCenter.com blog


The blog for all things data center, including, design and infrastructure, Unix, Linux, mainframes and x86 servers, power and cooling efficiency, information technology (IT) service management, server consolidation and virtualization and more.

Get the lowdown on UPS batteries

Eaton, one of the big data center UPS manufacturers, is offering a free handbook on uninterruptible power supply (UPS) batteries. Most people know that the most vulnerable part of a UPS are the batteries. Knowing how charged they are and how much juice they have left can mean the difference between having enough through time to get the generators started, and leaving your customers without a data center.

I ordered one. I can always learn more about UPS’s and their batteries. According to Eaton, the guide “covers characteristics, performance and maintenance of UPS battery types along with a comprehensive glossary of battery terms.” Sounds good to me. And since I already get plenty of emails from Eaton for all their products, I didn’t care about putting my information in there. They can only send me so many emails, right?

Static transfer switch alarm headache on uninterruptable power supplies

In June, Chris Johnston, Senior VP and Critcal Facilities Chief Engineer at Syska Hennessy Group wrote a Tip for SearchDataCenter.com, “Uninterruptable power supply load bus synchronization: Yes or no?”. We asked for reader feedback, and heard from Brad Walter, Director of Applications and System Development at Active Power, who shared this story:

The one issue that this article did not address is static transfer switch (STS) alarms. I have a customer who claims that even the STS with asynchronous transfer capability alarms when the phase angle between the two sources drifts beyond a certain limit (say 15 degrees), and that a new instance of the alarm is generated every time the two sources drift out of synch. This would not only be annoying to data center operators but significant time would be wasted in re-setting alarms, and even more importantly, frequent false alarms tend to make people ignore alarms that require attention. Have you seen the same issue, or is this customer either not actually using asynchronous transfer STS as he claims, or has he failed to set up alarm features on his switches correctly for asynchronous transfer operation?

Chris provided this feedback for Brad:

Thanks for your question, Brad. I agree that frequent nuisance alarms are annoying and a potential source of unintended downtime. Repetitive nuisance alarms can obscure our perception of a real problem when it occurs. Human nature is to be lulled into being “asleep at the switch.”

Not knowing any specifics about your customer’s situation, I suspect that the alarm features on the STS may not be set correctly to eliminate nuisance alarms. If synchronization between the two STS sources is unnecessary, then the need for an “out of synch” alarm is unnecessary, regardless of the phase angle between the two sources. I suggest that your customer contact the STS manufacturer.

This lead us to wonder, is this a “Picnic” type problem (problem in chair not in computer) or is this a problem with a certain STS?

I called Brad to follow up, and to get a little edification about how these switches are supposed to work so that I could better understand the problem. Brad kindly talked to me for about 30 minutes, giving me a crash course in Electrical Engineering 101 and a refresher on trigonometry.

He explained that in a large data center with many of these switches and alarms, that the headache from them all going off could be enormous. The particular model involved has software in the switch that is supposed to be able to take care of any out of phase problems, keeping the downstream equipment safe. If the software is working as advertised, there would be no need for an out of phase alarm at all. But for whatever reason, it has an alarm, and it’s going off — all of them, at each UPS in the data center.

Brad declined to point a finger the switch manufacturer specifically (a perfectly sane response), but shared that it was one of the big players in this space: Cyberex, Liebert, PDI, or LayerZero.

Without other stories of the same problem, it’s harder to make a case out of this and ask the manufacturers tough questions. So, this is a bit of a fishing expedition: Have you experienced a similar problem with your STS? If so, did you resolve it? How? Which model STS had this problem?

If you represent any of the four STS manufacturers, are you willing to say that this problem could not happen with your equipment? Or, could it, and what should the end-user do about it?

Microsoft lays down blueprint for adopting PUE

There are plenty of ways to start measuring your data center’s Power Usage Effectiveness, or PUE, which is a comparison of the total facility power to the IT load. But in recent months Microsoft has opened the curtains on its own operations, thanks largely in part to two data center pros there, Michael Manos and Christian Belady.

Back in April, Manos spoke to us about Microsoft’s data center strategy. It was one of the first times the Redmond, Wash. The next month, Manos showed us a demo of Scry (video here), the tool the company uses to measure everything in their data centers.

Now Manos and Belady have written a series of three lengthy blog posts on PUE, why it’s important, and how to go about measuring it. For those of you out there still a little daunted by the task of measuring key analytics in your data center facilities, this could give you a good start.

Flash advancements boost data center efficiency

With the upcoming holiday sure to brighten the skies across the U.S. with colorful flashes of light, IFireworks — Bethany Carlson, www.sxc.hu thought it would be a good time to share some of the advancements in Flash-memory based storage devices. Solid-state drives (SSD) can help bridge the server and storage performance gap and decrease data center power requirements. A few weeks ago, at Hewlett-Packard Co.’s Technology Forum, a relatively new entrant into the field, Fusion io announced that is adapting Fusion-io’s ioMemory architecture to HP’s enterprise-class servers, including the HP BladeSystem c-Class system.

“Adapting this technology specifically for HP servers offers radical increases in associated performance for a broad range of applications and workloads and can dramatically improve the effectiveness of data center architectures,” said Fusion-io CEO Don Basile. “With our ioMemory architecture, we’re getting more than 200,000 IOPS [I/O operations per second] within HP BladeSystem c-Class server blades today.”

When I met with Basile for a mere 30 minutes, he shared an intense amount of information, including a variety of statistics that illustrate the power of the technology. The ioMemory technology is still costly enough that it’s not ideal for long-term archival storage, but the speed that it provides makes it valuable in the active data requirement area. Basile explained that the technology is capable of 3.2 GB/s of sustained bandwidth, with extremely low latency (50 microseconds). In terms of I/O, a traditional enterprise application server that is I/O-intensive may cost $15 to $20 per I/O versus $0.15 per I/O using the Fusion-io system.

In addition, Basile explained that all this speed is possible with less energy expenditure and less heat than a typical storage area network (SAN). Heat and power are reduced because of the lack of mechanical heat that would otherwise be generated by spinning disks. In addition to using less than 1% of the power required by a typical SAN, the footprint is minimal: 16 ioMemory cards can fit into 10U without any oversubscription. Basile noted that consumer electronics such as the iPhone have helped lower the cost of silicone chips.

HP is not alone in integrating SSD technology. Earlier this year EMC announced that it had added SSD in its enterprise Symmetrix system, and more recently rumors have circulated that the company will add it to the Clariion storage array. Sun has also announced that it will release a new version of the Solaris operating system designed to integrate flash and traditional disk-drive storage. And Sun’s CEO Jonathan Schwartz says that it’s not just a flash in the pan. Sun’s Adam Leventhal has also produced an informative technical article outlining the technology and its optimized uses.

In the age of increasing energy costs, efficiencies in data centers are welcome, and the Flash technology is likely to play a key role in the data center of the future. If you’re interested in the topic, check out the Flash Memory Summit in August.

Cloud computing is the future for data centers; resistance is futile

http://www.research.att.com/files/grid_computing_technology.gif

I noticed a common theme at the string of computing conferences I’ve attended in the past couple of months: The future of the data center is going to be cloud computing, and resistance is futile.

I heard this from VMware Inc.’s President and Chief Executive Officer Diane Greene during her keynote at the JP Morgan Technology Conference in Boston in May, and the point was driven into the ground during the Enterprise 2.0 Conference there in June. I heard these predictions repeated during the annual Red Hat Summit and the USENIX 08 conferences, also held in Red Sox Nation last month.

Major league players in the data center space like VMware Inc. are putting their efforts into cloud computing because of predictions that it will eventually be the mainstream way information is handled and software vendors are starting to introduce products to manage cloud computing environments.

David Patterson, a professor of computer science at U.C. Berkeley, said during his keynote speech at USENIX that cloud computing is part of the data center evolution already under way.

“In addition to the processor evolution [from single-core to dual- and now quad-core processors], on a larger scale, there are a number of changes happening in the data center; flash memory is replacing mechanical disks, we have software as a service, and utility computing [a.k.a. cloud computing] is being used to outsource the data center,” Patterson said.

The advantages of cloud computing are clear, he said.

“With cloud computing, you put $0 down for your own data center, and pay as you go, and there is no penalty for scale up, which happens instantly. It allows fast scale up with no dead or idle CPUs, and no provisioning is required,” Patterson said.

This is especially appealing to data centers that have maxed out their power resources, but need to increase their infrastructure.

Though cloud computing is considered an immature technology, it really isn’t. The chief architect of the Xen project, Ian Pratt, said during his session at USENIX, called Xen and the Art if Virtualization, that the folks at Cambridge University who started the XenoServer project with him back in 1999 were architecting it under the cloud computing concept.

Though their ideas about what the cloud would look like differ from what we see today, the concept was similar: Develop a public infrastructure for wide-area distributed computing that can be used by people across the world.

“We originally thought there would be data centers all over the world, and clients would be able to choose a location, perhaps close to another IP address they wanted to interact with,” Pratt said. “The other difference is, we thought the machines would be owned by many different merchants, and there would be a broker acting as a third party recommending the different vendors, and those brokers would take a fee.”

Instead, we have companies like Amazon.com, Google and Salesforce.com offering the complete cloud computing environments , but Pratt expects this to change.

“I think we will see cloud computing move in the direction where it will become more open instead of all of the hardware, software and networking being located at and owned by a Google or Amazon.”

Today, most cloud computing providers host x86-compatible applications on virtualized servers, and most support only the Linux OS, according to Cambridge, Mass.-based Forrester Research Inc. To keep costs low, many cloud providers use a Xen-based hypervisor. Charges for usage are usually based on CPU hours, gigabits consumed and gigabits per second transferred rather than on a monthly service fee.

Specifically, Amazon charges 10 cents per compute hour used and 15 cents per gigabyte of storage. According to Forrester, that translates into about $70 to $150 per month for a fully utilized Amazon server, versus the average $400 a month that it costs an enterprise to run a server.

The benefits aside, IT pros are apprehensive about taking their mission critical apps out of their secure data centers and putting them into something as translucent sounding as cloud computing. This fear was quite evident during the Enterprise 2.0 conference event called “An Evening in the Clouds.” A panel of IT pros sat and listed to Google, Amazon and Salesforce as they fluffed cloud computing, and then they voiced their many concerns.

Is it secure? Is it reliable? Does it perform better than my existing data center?

The answer from all the cloud computing providers was, of course, a resounding “yes.”

But not all applications are available in the cloud, so it isn’t for every company. The cloud computing environment also lacks government standards, which makes some users nervous.

“I wouldn’t suggest moving all of your apps over to the cloud today, but hopefully one day all will be right in the world,” said Jeff Keltner, the business development manager at Google Apps.

Thinking outside the case: Running naked servers

When it comes to data center metrics the one most often talked about is square footage. Nobody ever announces that they’ve built a facility with Y-tons of cooling, or Z-Megawatts. The first metric quoted is X-square feet. Talk to any data center manager however and they’ll tell you that floor space is completely irrelevant these days. It only matters to the real estate people. All that matters to the rest of us is power and cooling - Watts per square foot. How much space you have available is nowhere near as important as what you can actually do with it.

If you look at your data center with a fresh eye, where is the waste really happening?

Since liquid-cooled servers are at the far right-hand side of the bell curve, achieving electrical density for the majority of us is usually a matter of effectively moving air. So what is REALLY preventing the air from moving in your data center? I won’t rehash the raised floor vs. solid floor debate (since we all know that solid floors are better) but even I know that the perforated tiles, or the overhead duct work is not the REAL constraint. A lot of folks have focused a lot of energy on containment; hot aisle containment systems, cold aisle containment systems, and even in-row supplemental cooling systems.

In reality however, all of these solutions are addressing the environment around the servers, not the servers themselves which are after all, the source of all the heat. Why attack symptoms? Let’s go after the problem directly: The server.

First of all, the whole concept of a “rack unit” needs to be discarded. I’ve ranted before on the absurdity of 1U servers, and how they actually decrease data center density when deployed as they are currently built. I’d like to take this a step further and just get rid of the whole idea of a server case. Wrapping a computer in a steel and plastic box, a constrained space, a bottleneck for efficient airflow is a patently absurd thing. It was a good idea in the day of 66 Mhz CPUs and hard drives that were bigger than your head, but in today’s reality of multi-core power hogs burning like magnesium flares it is just asking for trouble. Trouble is what we’ve got right now. Trouble in the form of hot little boxes, be they 1U or blade servers. They are just too much heat in too constrained spaces.

Virtualization won’t solve this problem. If anything it will just make it worse by increasing the efficiency of the individual CPUs making them run hotter more of the time. Virtualization might lower the power bills of the users inside the server, but it won’t really change anything for the facility that surrounds the servers in question. The watts per square foot impact won’t be as big as we hoped and we’ll still be faced with cooling a hot box within a constrained space.

So here is my challenge to the server manufactures: Think outside of the case.

This isn’t a new idea really, nor is it mine. We’ve all seen how Google has abandoned cases for their servers. Conventional wisdom says that only a monolithic deployment such as a Google data center can really make use of this innovation. Baloney. How often does anyone deploy single servers anymore? Hardly ever. If server manufacturers would think outside of the case, they could design and sell servers in 10 or 20 rack unit scale enclosures. They could even sell entire racks. By shedding cases altogether, both server cases and blade chassis, they could create dense, electrically simple, easy to maintain, and most importantly easy to cool servers. The front could be made of I/O ports, fans, and drives. Big fans for quiet efficiency. The backs could be left open, with electrical down one side and network connections down the other. Minimize the case itself to as little as possible… think of Colin Chapman’s famous directive about building a better race car: “Just add lightness.” The case of a server should serve one purpose only: To anchor it to the rack. Everything else is a superfluous obstruction of airflow. No need for steel, as plenty of lighter weight materials exist that can do the job with less mass.

Go look in your data center with this new eye and envision all those server cases and chassis removed. No more artificial restriction of airflow. Your racks also weigh less than half of what they do today. You could pack twice the computing horsepower into the same amount of space and cool it more effectively than what you have installed.

Ten years from now we’ll look back at servers of this era and ask ourselves “what were we thinking??” The case as we know it will vanish from the data center, much like the horse and buggy a century before. We’ll be so much better without them.

Sun’s data center tour: Starline Track Busway and hot-aisle containment

Last week I attended a data center tour with Sun Microsystems’ Dean Nelson, Sr. Director of Global Data Center Design Services.

Nelson’s team consolidated four large Sun Microsystems campuses in California – consolidating over 200,000 square feet of data center down to 80,000 square feet, while still allowing capacity to grow.

This new data center, built into Sun’s existing office space in Santa Clara, is designed for modular growth and is very energy efficient (1.28 PUE in one of the rooms, according to Nelson)

In this first video, Nelson demonstrates the Starline Busway, a power component Nelson Describes as track lighting on steroids. These products allow Sun data center staffers to plug in anything from 120 single phase power to 100 amp 3 phase without an electrician, allowing for modular growth and flexibility. The busways also have IP connections that track power usage in real time.

In this second video, Nelson shows us the hot-aisle cold-aisle containment strategy Sun is using. It’s essentially a ceiling on the hot aisle that prevents hot return air from mixing with the cool intake air.

APC provides free online data center infrastructure calculation tools

Data center power and cooling services companyAPC is offering a number of free online tools, called APC TradeOff Tools, that give IT pros a way to view how infrastructure changes effect costs and performance in the data center.

“The tools answer questions like, ‘what will the ROI be if I increase the water chiller temperatures?’ or ‘what do I need to do to hit my energy efficiency or carbon footprint target’?,” said Neil Rasmussen, senior vice president of innovation for APC.

The West Kingston, RI-based company’s new tools include the power efficiency calculator that allows IT managers to generate “what if” scenarios regarding virtualization, power sizing, efficiency, power density, and cooling decisions.

Another new tool is the Data Center Carbon Calculator, which allows users to input data about their infrastructure and see the impact any changes would have on data center efficiency, energy costs and carbon footprint.

“If a company makes a carbon efficiency pledge, they can use this tool to drill down into different ways to achieve that goal,” Rasmussen said.

The Data Center Capital Cost Calculator details the impact of physical infrastructure design changes on capital costs; the Virtualization Energy Cost Calculator shows the impact of server virtualization and data center design choices on energy and space savings; and the Data Center Power Sizing Calculator gives details about the impact of server and storage configurations on IT load capacity and required utility input power.

There is also the Data Center AC vs. DC Calculator, which compares the efficiency of each, and the Data Center InRow Containment Selector, which recommends cooling options based on the data center infrastructure.

All of the tools can be accessed here on APC’s website.

EPA deadline for data center feedback pushed back

The Environmental Protection Agency program has been trying to get data centers to commit to submitting it data so that it can develop an Energy Star rating for data centers. Its original deadline for data centers to submit a form of interest was June 1, but the agency has now extended it for one more month in the hope of getting more companies to bite.

Andrew Fanara of the EPA’s Energy Star program spoke last month about the National Data Center Energy Efficiency Information Program.

Late last month, I spoke to Fanara at a different event in Chicago about how the data collection was going. He said at the time that it had been slow, although there were a few users at the event who expressed interest in submitting data.

The basic idea is that data centers commit to monitoring, measuring and submitting information about their data center’s energy use to the EPA on a regular basis. All of the information is kept confidential, although the EPA will let each individual company know how they did. The EPA will then collect that data and use it to help create an Energy Star rating for data centers.

Earlier this week I got in touch with Fanara to see how the data collection was going, especially considering the deadline extension. He seemed more encouraged, saying that about 200 data centers had signed on thus far.

That’s much better than at the Chicago event, where Fanara said that “response from the industry has been extremely slow.”

Hopefully in another month they’ll get even more users to commit to submitting data. If you’re interested, visit the Energy Star’s data center site.

Synapsense targets CFD modeling with real time wireless monitors

Folsom, Calif.-based data center monitoring company Synapsense is looking to targeting computational fluid dynamics (CFD) software with its wireless data center monitoring system. The startup is two years old and has been shipping commercial products for six months. The company currently has 15 proof of concept projects at unnamed “Fortune 50” companies, plus support from the data center energy efficiency engineers at Lawrence Berkley National Labs (LBNL), according to Ray Pfeifer, vice president of business development at Synapsense.

Synapsense’s battery powered monitors track data center environmental conditions and use low power wireless [2.4 gigahertz] to communicate that data to a server. Synapsense’s software synthesizes that information and displays it as a live image [example below], which allows data center managers to look at real time maps of their data center and view air pressure distribution, humidity and temperature.

The following is an excerpt of a Q&A with Pfeifer:

Why wireless sensors? Why not wired?
Ray Pfeifer: The majority of the data centers are not new. The IT equipment refreshes every 3-5 years. The facility is there 15-20 years. Low power wireless becomes the first practical way to get in to monitor legacy data centers unobtrusively.

We can deploy in a 10,000 sq ft data center in a day to two days. It takes you weeks or months to do that with a wired solution. Because of the flexibility of wireless, as your data center changes, racks come and go, you can very easily reconfigure the wireless to match the environment. Some data center operators are moving 10-20% of their IT equipment in and out every month.

What specifically do the sensors monitor?
Pfeifer: Our standard installation measures the temperature on inlet and discharge of the racks, the temperature at the inlet and discharge of the Computer Room Air Coniditoner (CRAC) units, humidity at the CRAC units, and sub-floor air pressure.

But what we do with all this data is the interesting thing. A typical data center supplies anywhere two to three times the air that it needs because the majority of the air is being wasted. The strategic placement of the sensors allows you to adjust your airflow methodology. When you raise the return temps on the CRAH units, they become more efficient, you can shut units off.

The LiveImaging gives you a visual map: you can see where your hot spots are, you can see where you’re over-cooling. It enables a data center operator to reconfigure the data center and understand what they need to do to reconfigure it.

How does real-time imaging stack up against CFD analysis?
Pfeifer: There is some great CFD software out there, but the expertise to build a good model is pretty significant, so the people using CFD models are generally professional services folks. A full data center assessment is a $50,000 event for a 25,000 sq ft data center. The problem is, that’s a one time snapshot. They take your readings and they leave. In 90% of those instances, the facility guy looks at it, and it goes on a shelf. A year later, they hire someone else to do another one. If you put sensors cost effectively, do the analysis, collect data real time, you can present it visually to non-eningeering staff. Look at color. If it’s red, it’s hot. This is a dynamic tool that allows continuous commissioning the data center.

What’s the next step for Synapsense?
Pfeifer: The next piece that will complete the full solution will be energy metering, for both infrastructure and IT equipment, down to branch circuit level monitoring. We will also provide real-time DCIE/PUE and overlay it on your existing data center. We’re also working with the LBNL team as they develop DC Pro, the Department of Energy’s data center assessment tool. We’re putting those assessment tools into our software solution.