3

I'm developing an application for my company that will require a lot of compute capacity (running some very big mathematical calculations), and looking for some form of server setup to do this. For various reasons, we want to run this on-site in our office rather than hosting it externally.

It's been a while since I last had to set up my own servers so I thought I would tap into the collective wisdom of serverfault!

My broad requirements are:

  • Budget $30-50k, with an aim to get as much compute capacity as possible for that budget
  • 64-bit servers suitable to run Ubuntu Linux + Java
  • Some relatively standalone rack that can be installed in secure office space
  • Fast/low latency network connections between the servers, but don't really care about connectivity to the outside world
  • Storage capacity shared between the servers - they don't necessarily need their own storage providing they can be booted from a common image
  • Downtime can be tolerated (since the calculations are run in batch mode)
  • The software itself is fault-tolerant, so there is no need for extra resiliency in the server setup (cheap replaceable commodity parts will be fine in general)

Given these requirements what kind of setup would you recommend and why?

mikera
  • 165

1 Answers1

3

Without knowing the answers to any of the above questions, and assuming the software can easily deal with hardware faults, I would consider something like:

  • A pair of HP DL 180 G6 loaded with the necessary storage. These would serve as mirrored storage providers and multimaster (or redundant) cluster masters. PXE-Boot/NFS servers for the nodes too.
  • Roughly 8 HP DL 160 G6 compute nodes (12GB, 2 6-Core X5650).
  • A pair of HP ProCurve E2510-24G Switches, unless you already have Switches

I figured the servers would cost roughly $5k each; of course the exact price depends on RAM/Disk/CPU/Etc configurations.

This doesn't include UPS/Power, Rack Enclosure, Backup, AC/Cooling, or other environmental considerations. I'm biased toward HP equipment because that's what we use; I have no other ties to HP.

One other note, when buying $50k+ worth of gear - no matter HP, Dell, IBM, etc - Get quotes from more than one of them, and make sure they know they're bidding against each others. The prices will drop ~10% right off (or they sometimes like to do in-kind deals, like adding $5k worth of extended warranties).

Chris S
  • 78,455