welcome: please sign in

The following 681 words could not be found in the dictionary of 7 words (including 7 LocalSpellingWords) and are highlighted below:
1x6   2970s   2x   4x2   4x512   5x10   A2   A2001   ability   acceptable   access   Access   according   act   add   additional   Additionally   addon   afford   afs   aklog   all   All   allocated   also   Alternatively   Although   Altus   Amazon   amazon   americas   amount   an   and   Any   anything   appear   appeared   appears   application   are   array   Array   Arrays   as   asacomputers   asp   aspx   assuming   at   Avocent   avocent   avoid   avoiding   Awaiting   B000   Backplane   Base   Baseboard   based   baseline   Basic   basically   be   becwtk1   best   bet   better   bit   boot   both   box   Branch   broken   bsd   build   built   business   but   buying   by   Cables   Cache   can   cannot   capabilities   capacity   Card   cards   case   catalog   category   Cent   center   chain   cheapest   check   Clinton   cm4000   cm4001   cm4008   Code   coexist   collected   com   commands   comparable   Computers   Computing   config   configuration   configure   configured   connect   connected   connecting   Connector   Console   console   consoles   consuming   contacted   Controller   controller   Coop   Copper   core   Core   cores   cost   costs   could   cs   Cs   Curr   current   Current   cursory   customizable   customize   Cyclades   D1   daemon   daisy   data   database   Databases   databases   day   decided   decision   dedicated   default   definite   Deleuze   dell   Dell   dellstore   dev   devices   difficult   direct   disk   disks   Display   do   docelic   docs   Does   does   don   done   down   download   Downloads   dramatically   drive   Drives   drives   dual   Dual   dumb   E16820134835   E16820139024   E16822148395   E16822152185   E5520   each   easy   Ebadi   ecomelectronics   Ecomeletronics   Edge   effect   effective   eight   Email   en   enabled   enforced   enough   ensure   entirely   equivalent   etc   eth0   eth1   ethernet   Ethernet   Even   every   everything   expand   expensive   experiment   fairly   fancier   fancy   fast   features   few   final   fine   Firmware   following   For   for   four   frames   Free   from   From   froogle   ftp   future   gain   gateway   Gateway   Gbps   Gear   General   get   Ghz   Gig   Gigabit   give   Given   go   good   google   got   gp   hard   Hard   hardware   Hardware   has   have   having   Here   high   Hopper   hot   htm   html   http   Hyper   Hz   ibm   Id   id   ideally   if   If   image   images   img4004   in   inaccessible   inch   increase   information   infrastructure   initial   Initially   initially   install   Integrated   integrated   Intel   intended   Intended   interface   interfaces   is   it   It   Item   Java   jumbo   just   kc   Keep   keyboard   keys   kinit   kit   known   Krb   Krb5   L2   L3   lan   lang   large   Large   later   Later   layer   learned   least   less   like   likely   line   Linux   list   listed   little   ll   Local   local   locally   login   look   looks   lower   M4000   M40001   M4001   M4004   M4008   M400x   machine   Machine   machines   Machines   Main   makes   making   managed   management   Management   Manual   manual   Manual3   Max   may   Mem   memory   might   minimal   minimally   Mire   module   modules   money   monitor   more   Most   mostly   Mostly   mount   mounting   much   multiple   N82   need   needed   net   Network   network   networking   new   New   newegg   nice   No   no   Non   Not   not   Notes   now   O2   oc   occasionally   of   offers   office   ok   okvm   Old   on   One   one   Only   only   Onsite   Open   openafs   opengear   Opengear   opengearstore   Opteron   optimized   option   Option   or   other   ought   our   out   over   own   pacificgeek   page   Page   pay   pd   pdf   pedge   Penguin   penguincomputing   people   per   performance   period   phtml   physical   port   Port   portion   Ports   ports   possible   potentially   Power   power   Poweredge   poweredge   powerful   Preload   Price   price   primary   prior   private   probably   processing   processor   processors   procure   prodinfo   product   Product   Products   products   project   proper   protocol   public   purchase   pxe   Quad   quickly   quotas   R2   R3   r300   r410   R410   R997930   rack   Rack   rails   Ram   ram   Ranked   rather   ratio   rbo   really   reasonably   reboot   reconfigured   Redundant   ref   refid   regular   released   Remote   remote   remotely   Repair   replace   Replaces   request   reshuffling   restricting   return   Robotics   role   room   rotate   routing   running   runs   Rx   S2   sac   said   same   sdtcon   secure   secured   seem   seems   semi   Serial   serial   Series   Server   server   servers   service   Services   services   servlet   sets   setup   Shell   shell   ship   shipping   shop   Shopping   should   since   Single   single   six   sku   slots   small   smaller   Smaller   smart   so   Socket   Software   some   Some   Source   sourceforge   space   spare   spares   spec   speced   Specifications   specs   Specs   spend   standalone   Standard   stick   still   storage   store   Store   stores   suboptimal   supplies   support   supporting   switch   Switch   system   System   systems   tax   Tenative   terms   text   tftp   th   than   that   The   the   them   then   there   These   they   things   this   This   thoroughly   throughput   time   to   too   tool   Total   traffic   transport   Trnsprt   Tu   two   Two   type   Unamanged   under   units   unless   Unmanaged   until   upgrade   uplink   us   use   useful   user   User   Users   users   userspace   using   usr   V060   various   Vendors   vendors   Version   via   vlan   vlans   vnc   want   Warranty   warranty   way   wcs   We   we   Web   web   webapp   websites   what   when   which   who   Why   will   win   With   with   without   worst   would   www   x3655   x6   Xeon   year   Year   your   Yr  

Clear message
Edit

Migration2009 / HardwareUpgrade

1. New purchase

We decided to expand the list of HCoop machines with one Dell PowerEdge 2970 as listed on Hardware page under "Awaiting purchase".

2. Hardware reshuffling

With the new purchase, we will rotate our setup in the following way:

Machine

Current role

New role

Replaces

Notes

Dell PowerEdge 2970

/

Main server (Krb5, AFS, LDAP, ...)

Deleuze

Intended as high-power, high throughput, high capacity system with spare disk slots for future capacity increase

Deleuze

Main server

Web server, DB server, local user disk**

Mire

Databases and websites will in this way be on the same machine, and databases will use local disk storage. Local user disk access may be possible for users who want to use Krb5/AFS, but still have access to local disk.

Mire

Web server

Shell server***, local user disk, web server

/

shell server which can kinit and aklog (Krb5 and AFS terms) if needed, but is basically intended as a standalone, regular Linux machine that offers local login (makes SSH keys possible), local disk and local web server for people who do not want to use Krb/AFS infrastructure

Hopper

Email processing

Email processing

/

3. Old information

Here's information collected prior to our final decision.

4. General Specifications

4.1. All Machines

4.2. Core Services Machine

4.3. User Services Machine

4.4. Serial Console Server / IPKVM

We need some type of worst-case access to the physical consoles of the servers. IPKVM/KVM units are fairly expensive, and potentially don't really need everything they give us since we are not running X or anything remotely. Given that we have a nice IPKVM and KVM setup now we may want to ship that to the new data center, but then we will be running for a period of time with no equivalent to physical access remotely on our setup that is known to occasionally go down and be inaccessible.

Alternatively we could procure a serial console for a bit less money and have access to the serial consoles of every machine, which ought to be just as good as having physical keyboard/monitor access via vnc. Additionally we would gain access the the IPMI capabilities of the connected machines (which may lower the cost of each machine by $200-$300 since we could avoid buying service processors for them). If we got a fancy switch it might also have a serial console for configuration.

4.4.1. General Specs

4.4.2. Console Server

4.4.2.1. Avocent Cyclades CS 8-Port Console Server

Does not support IPMI commands it appears; unless the BMCs of the servers we get have some type of text console interface over serial this is suboptimal.

4.4.2.2. OpenGear CM400x

These are not rack mount units, but they seem to be more in line with what we need from a console server. It appears (need to check the docs more thoroughly) they support connecting to IPMI devices via the network (which it seems we can secure by restricting IPMI access to the IP of the console server) in additional to supporting direct serial consoles.

These devices also are running entirely Free Software and there is a dev kit that look reasonably easy to use so we can customize them. ClintonEbadi contacted Opengear and learned that th CM400x consoles cannot be reconfigured to coexist on multiple protocol based vlans making them a bit less useful than they initially appeared.

4.4.2.2.1. OpenGear CM4008

4.4.2.2.2. OpenGear CM4001

If we use Serial-over-LAN (assuming it can be secured without a dedicated management lan) for everything the CM40001 should be fine for our use.

4.4.2.3. OpenGear IM4004-5

The CM4001 cannot coexist on multiple protocol-based vlans so this looks like our best bet for a console server -- we can connect eth0 of each server to the console server's management lan and eth1 to the primary lan. The hardware is fairly powerful and we could later daisy chain the dumb switch to this and add six more devices to the management lan. This has a few other useful features e.g. it can act as a tftp server (pxe boot!). The mostly Free Software and semi-customizable userspace are a definite win. Even better is that the fancy remote console application is also Free Software, runs on GNU/Linux (Java),

4.5. Network Switch

If we can get by with a CM4001 we should spend a bit more on a proper smart switch so that we can setup multiple vlans. Initially at least a public vlan and a private IPMI-only protocol based vlan. Later on we may want to experiment with routing database and afs traffic locally on a vlan with jumbo frames enabled (according to a cursory google this would increase database throughput but would likely have little effect on afs until openafs 1.6 is released with the new RxTCP transport layer).

4.5.1. Unmanaged

4.5.1.1. US Robotics 8-port Gigabit Switch

This looks like it will be an acceptable switch until we can afford (or need) a managed switch.

5. Shopping list

5.1. Non-Dell Vendors

From other vendors, systems comparable to the Poweredge 2970 cost...

5.2. Option A

5.3. Option B

5.3.1. Why Two PowerEdge 2970s

Although this setup would use 6U rather than 5U, the PowerEdge 2970 offers a much better price/performance ratio than the 1U R410. For a bit less than a single processor R410 we could have eight cores on both machines (avoiding a difficult/time consuming processor upgrade later on).

Migration2009/HardwareUpgrade (last edited 2009-12-04 18:31:26 by DavorOcelic)