welcome: please sign in

Diff for "Hardware"

Differences between revisions 20 and 179 (spanning 159 versions)
⇤ ← Revision 20 as of 2006-06-25 14:04:17 →
Size: 7811
Editor: JustinLeitgeb
Comment: Added 3Com switch recommendation, comment on MichaelOlson's Netgear switch rec.
← Revision 179 as of 2013-01-12 08:19:09 → ⇥
Size: 6661
Editor: ClintonEbadi
Comment: fritz backup drive?
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= New System Hardware = #pragma section-numbers off
Line 3: Line 3:
During the HCoop IRC meeting on June 24, 2006, the group decided that it would based it's new system architecture on the following pieces of hardware: This page collects information on the hardware that we have installed or plan to install as part of HCoop infrastructure.
Line 5: Line 5:
 * Two robust servers, one that doesn't allow normal user logins, and one that does.
 * One switch to form a LAN between these servers.
 * One serial port device, to facilitate remote access to our servers.		 <<TableOfContents>>
Line 9: Line 7:
Also, it was mentioned that we should research hardware support contracts from any vendor that will be selling us equipment. = Peer1 =
Line 11: Line 9:
Additionally, group decided that the server that HCoop currently owns, Abulafia, will be brought to he.net for shell service. This will follow a necessary re-load of the OS software at a time to be determined later. Current pictures of the actual Peer1 cabinet are at [[http://hcoop.net/~rkd/hcoop/imgs/]], taken during [[http://wiki.hcoop.net/OnSiteVisits/20090821]].
Line 13: Line 11:
This page will serve as a forum for collaborative research on the pieces of hardware that we need. == fritz ==
Line 15: Line 13:
== Servers ==  * Location: Peer1
 * Model: Dell PowerEdge 2970
 * Processor: 2x Quad Core AMD Opteron™ 2372HE 2.1GHz 4x512K Cache 1Ghz HyperTrnsprt
 * RAM: 8GB (4x2GB), 800MHz, Dual Ranked
 * 1x6 Backplane for 3.5-inch Hard Drives
 * Integrated SAS/SATA No RAID
 * Disks: system disks 2x 160GB 7.2K RPM Serial ATA 3Gbps 3.5-in HotPlug Hard Drive , + AFS disks 2x 1 TB Western Digital in RAID 1
 * Redundant Power Supply with Dual Cords
 * Lan: Dual Embedded Broadcom® NetXtreme II 5708 Gigabit Ethernet NIC
 * Form factor: 2U
 * OS: Debian Squeeze
 * User logins: no
 * Source: purchase from Dell store, 2x 1 TB disks from Newegg
Line 17: Line 27:
We will be purchasing two servers, which will be configured and sent to he.net for colocation. '''Use: AndrewFileSystem fileserver, MitKerberos kdc, KernelVirtualMachine host'''
Line 19: Line 29:
=== Desired Features === === KVM: navajos ===
Line 21: Line 31:
These servers should be as redundant as possible. At this point, we cannot afford to have less than one point of failure in many areas, so we should look for the following features in our new servers:  Location:: virtual machine on fritz
 Allocated Resources:: 4 processors, 2.5G RAM, 60G storage
 Operating System:: Debian Squeeze AMD64
 User Logins:: No
 Intended Use:: Apache hosting and dynamic web content, including HCoop web services
 Details:: ServerNavajos
Line 23: Line 38:
 * Redundant power supplies.
 * Hardware RAID.
 * Dual CPU's, AMD seems to be a stronger option than Intel		 === KVM: bog ===
Line 27: Line 40:
==== Differences Between the Servers ====  Location:: virtual machine on fritz
 Allocated Resources:: 4 processors, 3G RAM, 30G storage
 Operating System:: Debian Squeeze AMD64
 User Logins:: No
 Intended Use:: Member shell and server hosting
 Details:: ServerBog
 
Line 29: Line 48:
The admin-only server will hopefully be serving an AFS file system, which means that fancier kinds of RAID are justified there. The all-members server can get away with cheaper (and maybe even faster) solutions for local disk access. == deleuze ==
 * Location: Peer1
 * Model: Dell PowerEdge 2850
 * Processor: 2 x 2.8 GHz Intel Xeon (2/2)
 * RAM: 4 GB (? slots, 16 GB Max, DDR-2400 SDRAM)
 * Disks (controller Ultra 320 SCSI):
  * 4 x 10K Seagate Cheetah SCSI drives, 73GB '''and'''
  * 2 x 10K Seagate Cheetah SCSI drives, 36GB
 * LAN: 2 x 10/100/1000
 * Extra: RAID kit, with battery, etc., 256 MB RAID cache, 2 power supplies
 * Form factor: 2U
 * OS: Debian stable
 * User logins: no
 * Source: donation by Justin Leitgeb
Line 31: Line 63:
JustinLeitgeb thinks that perhaps RAID 1 would work on the all-members server, and either RAID 5 or RAID 10 on the admin server. It should be RAID 10 if we can afford it, or RAID 5 if we're shorter on cash. :)  * [[https://dcse.dell.com/selfstudy/Associates_7_0/Enterprise/PowerEdge/PE2850/printer_friendly.asp|Maintenance Manual for the PE 2850]]
 * http://www.dell.com/downloads/global/products/pedge/en/2850_specs.pdf
 * DeleuzeHotSwapDrive (instructions for replacing a failed drive without rebooting)
 * [[attachment:ut_linux.html|MegaRC RAID Utility Manual]]
 * Real picture:{{http://hcoop.net/~docelic/deleuze.hcoop.net.jpg}}
Line 33: Line 69:
There may be other factors influencing different configuration choices between the servers. '''Use: email server, backup server'''
Line 35: Line 71:
=== Proposed Models and Vendors === == mire ==
Line 37: Line 73:
Vendors: {{{#!wiki note
This is slated for removal in early-mid 2013. See ToDo.
}}}
Line 39: Line 77:
 * [http://www.penguincomputing.com/index.php?option=com_content&task=view&id=172&Itemid=230 Penguin Computing]
 * [http://www.dell.com/ Dell]
 * [http://www.monarchcomputer.com/Merchant2/merchant.mv?Screen=CTGY&Store_Code=M&Category_Code=allracks Monarch Computer Systems]		  * Location: Peer1
 * Model: Sun Fire v20z
 * Processor: 1 x 1.6GHz AMD64 (Opteron) (1/2)
 * RAM: 5 GB (initial 2x512MB and additional 2x2GB, ? slots, 16 GB Max, DDR1/333 or DDR1/400 SDRAM)
 * Disks (controller Ultra 320 SCSI):
  * 2 x 36 GB (hot swap)
  * CD-Rom
  * Floppy
 * LAN: 2 x 10/100/1000
 * Form factor: 1U
 * Ports: 1 x USB 1.1, 1 x DB9 serial, 2 x PCI-X
 * Power: 100-240 V, 50/60 Hz, 465 W PFC supply, dual redundant fans
 * Dimensions: W 16.94 in / H 1.69 in / D 28.5 in / Weight 35 lbs
 * OS: Debian stable
 * User logins: yes
 * Source: donated by Ray Racine
Line 43: Line 94:
Models:  * [[RebootingMireSp]]
 * [[http://docs.sun.com/source/817-5248-21/|SunFire v20z User Guide]]
 * [[http://docs.sun.com/source/817-5249-17/|Service Processor Manual]]
 * http://docs.sun.com/source/817-5248-20/index.html
 * http://www.sun.com/servers/entry/v20z/index.jsp
 * {{http://hcoop.net/~docelic/sunFIRE_V20z.jpg}}
 * {{http://www.sun.com/servers/entry/v20z/images/gallery/full/img_3.jpg}}
 * {{http://hcoop.net/~docelic/SunFireV20z_expl.gif}}
 * Real picture:{{http://hcoop.net/~docelic/mire.hcoop.net.jpg}}
Line 45: Line 104:
 * Possible web server configuration from [http://www.penguincomputing.com Penguin] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_web_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_web_server.pdf (PDF)]
 * Possible admin server configuration from [http://www.penguincomputing.com Penguin] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_server.pdf (PDF)]
 * Possible web server from [http://www.dell.com/ Dell] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_web_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_web_server.pdf (PDF)], based on the Dell PowerEdge 1850.
 * Possible admin server from [http://www.dell.com/ Dell] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_admin_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_admin_server.pdf (PDF)], based on the Dell PowerEdge 2850 (offers more space for hard disks in our primary file server).
 * Possible admin server configuration from [http://www.penguincomputing.com Penguin], using the 2U server, redundant power supplies, and RAID 5 [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid5_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid5_server.pdf (PDF)]
 * Possible admin server configuration from [http://www.penguincomputing.com Penguin], using the 2U server, redundant power supplies, and RAID 10 [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid10_server_2200.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid10_server_2200.pdf (PDF)]		 '''Use: dynamic web content, services that involve running arbitrary code from members (including custom daemons, etc.)'''
Line 52: Line 106:
Note that when I checked Dell dropped something like $1200 off of the price of each server over $4000, so we should expect some significant discounts. Whichever company we plan on going with, we may be able to negotiate lower prices by emphasizing that we may buy more in the future, etc. With the Penguin models, we seem to have to go to the 2U, Altus 2200 in order to get a redundant power supply. == kvm ==
Line 54: Line 108:
== Ethernet Switch ==  * Location: Peer1
 * Model: StarTech IP KVM
 * Source: Newegg?
Line 56: Line 112:
=== Desired Features ===  * [[KvmAccess]]
 * [[http://www.startech.com/Data/ProductManuals/SV1110IPEXT.pdf?c=US|StarTech manual]] ([[http://hcoop.net/~docelic/SV1110IPEXT.pdf|local copy]]).
Line 58: Line 115:
 * Gigabit
 * 5 ports minimum
 * Managed - so that we can troubleshoot failed NIC's easier
 * Rack-mountable, so that vibration and heat issues are diminished.
 * SNMP monitoring capability

=== Additional Information ===

He.net sent us the following when asked about switch configurations at their site:

''We've got customers using everything from ElCheapoSwitch(tm) to Cisco-grade equipment. The main difference between the two is how much traffic they can deal with, the number of packets they can deal with, and how they can be accesses/monitored. If you're looking at pushing primarily web traffic (<50Mb/s) and do not require any of the more advanced functionality of a managed switch, you could likely just go with a good unmanaged switch. If you were doing higher traffic levels, streaming, or other such traffic which consist of a zillion little packets, especially if it's between your servers, you would be better served by something a bit higher grade.''		 The StarTech Server Remote Control External KVM over IP provides access to systems that may have a degraded network. It allows us to monitor Power-On Self Test (POST), configure BIOS/CMOS, and even reinstall operating system software. It must be connected to another multiple port KVM in order to have access to more than one server.
Line 71: Line 118:
=== Proposed Models and Vendors === == hopper ==
Line 73: Line 120:
==== Vendors ====  * Location: Peer1
 * Model: IBM xSeries 335
 * Processor: 2 x single-core P4 XEON 2.6Ghz with hyperthreading
 * RAM: 4 GB, 2x1 GB, 1x2 GB (3/4 slots, 8 GB Max, PC2100 ECC registered)
 * Disks:
  * 2x SCSI Ultra 320 80 pin. SEAGATE - 5 YEARS MFG WARRANTY. CHEETAH 73.4GB 15000 RPM 80PIN ULTRA320 SCSI HARD DISK DRIVE. 16MB BUFFER 3.5 LOW PROFILE(1.0 INCH). ST373455LC
  * Floppy 3.5"
 * LAN: 2 x 10/100/1000
 * Ports: 3 x USB, 1 x serial, 2 x PCI-X
 * PSU: 1/1
 * Form factor: 1U
 * Dimensions: W 17.5 in / H 1.75 in / D 25.75 in / Weight 33 lbs
 * OS:
 * User logins: no
 * Name voting at https://members.hcoop.net/portal/poll?report=17
 * Source: US Ebay, seller lapkosoft. http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&item=300200776299
 * Real picture:{{http://hcoop.net/~docelic/hopper.hcoop.net.jpg}}
Line 75: Line 138:
[http://newegg.com/ Newegg] has been recommended to several of us.  * [[HopperServiceProcessor]]
 * [[http://www-947.ibm.com/systems/support/supportsite.wss/selectproduct?familyind=5105587&typeind=0&osind=0&continue.x=12&continue.y=13&brandind=5000008&oldbrand=5000008&oldfamily=5105587&oldtype=0&taskind=2&matrix=Y&psid=bm|IBM xSeries 335 Support Page]]
 * {{http://hcoop.net/~docelic/IBM_xSeries335_Front_0Bay.jpg}}
Line 77: Line 142:
==== Models =====

===== NETGEAR GS108 10/100/1000Mbps =====

[http://www.newegg.com/Product/Product.asp?Item=N82E16833122111 Netgear GS108 Switch ]: Highly-rated Netgear switch that is not rack-mountable

Price: ($56.99)

MichaelOlson thinks that we should go with the Netgear switch. It has been rated as a very reliable product, and is very affordable.

I don't like this switch for the following reasons:

1) It is not rack-mountable, meaning that it could raise issues for cooling in the rack, and be more susceptible to shock that could reduce reliability of the switch, or jar patch cables out of the ports.
2) It is not managed, so we can't track important information about performance and possible NIC failures via SNMP.

Basically, I think that if we're going to pay all of this money for equipment and hosting, we shouldn't put an interconnect with insufficient features in the middle of our architecture. But, I'm not a networking expert, so I would welcome any opinions contrary to this! JustinLeitgeb

===== Level One GSW-1655 10/100/1000Mbps =====

 * ($249.99) Level One 16-port rack-mountable switch [[http://www.newegg.com/Product/Product.asp?Item=N82E16833118021 link ]]

I've never heard of this brand (Level 1?) so I don't trust it. Any reviews? JustinLeitgeb

===== 3Com® SuperStack® 3 Switch 3812 =====

[http://www.3com.com/products/en_US/detail.jsp?tab=features&pathtype=purchase&sku=3C17401 3Com® SuperStack® 3 Switch 3812] seems to have most of the features that we need, with a bit of room to grow. Prices range from $1000 to $1500 on [http://froogle.google.com Froogle], in my experience [http://www.cdw.com CDW] is a reliable vendor. Perhaps we should make a jump and get the 24 port, which would support our use of an entire rack in the future, if the price difference is small?

I think that we should look for something in this range, but would welcome critiques -- I'm not a network tech! JustinLeitgeb		 [[attachment:Back of hopper, taken 24feb09.jpg]]
[[attachment:Hopper card closeup, taken 24feb09.jpg]]
[[attachment:Inside hopper, taken 24feb09.jpg]]
Line 107: Line 147:
== Serial Port == '''Use: Secondary KDC and SpamAssassin'''
Line 109: Line 149:
Docelic, or other users -- please update this section since I am entirely ignorant about these devices! :) (The 1x2 GB RAM module was acquired from Newegg, and the two disks from ServerSupply. Purchases were made in Sep 2008, but ServerSupply took good 3 weeks to deliver).
Line 111: Line 151:
=== Desired Features ===
Line 113: Line 152:
=== Proposed Models and Vendors === = Linode =
Line 115: Line 154:
[http://www.cyclades.com/ Cyclades] was mentioned as one vendor of serial port devices which are linux-friendly. == outpost ==

 * Location: Linode (hosted at UK data center)
 * Model: Xen VM
 * Processor: 4 cores (1x priority?)
 * RAM: 512 MB
 * Disk: 40 GB
 * OS: Debian squeeze
 * User logins: no

'''Use: secondary DNS on a different subnet, all tasks requiring remote location.'''


= Awaiting setup =

None.

= Awaiting purchase =

We need new drives for fritz to handle backups with dying. See FritzBackupDriveDiscussion


= Decommissioned =

See [[/Decommissioned]]

----
CategorySystemAdministration

This page collects information on the hardware that we have installed or plan to install as part of HCoop infrastructure.

Contents

  1. Peer1
    1. fritz
      1. KVM: navajos
      2. KVM: bog
    2. deleuze
    3. mire
    4. kvm
    5. hopper
  2. Linode
    1. outpost
  3. Awaiting setup
  4. Awaiting purchase
  5. Decommissioned

Peer1

Current pictures of the actual Peer1 cabinet are at http://hcoop.net/~rkd/hcoop/imgs/, taken during http://wiki.hcoop.net/OnSiteVisits/20090821.

fritz

  • Location: Peer1

  • Model: Dell PowerEdge 2970

  • Processor: 2x Quad Core AMD Opteron™ 2372HE 2.1GHz 4x512K Cache 1Ghz HyperTrnsprt

  • RAM: 8GB (4x2GB), 800MHz, Dual Ranked
  • 1x6 Backplane for 3.5-inch Hard Drives
  • Integrated SAS/SATA No RAID

  • Disks: system disks 2x 160GB 7.2K RPM Serial ATA 3Gbps 3.5-in HotPlug Hard Drive , + AFS disks 2x 1 TB Western Digital in RAID 1

  • Redundant Power Supply with Dual Cords

  • Lan: Dual Embedded Broadcom® NetXtreme II 5708 Gigabit Ethernet NIC

  • Form factor: 2U
  • OS: Debian Squeeze
  • User logins: no
  • Source: purchase from Dell store, 2x 1 TB disks from Newegg

Use: AndrewFileSystem fileserver, MitKerberos kdc, KernelVirtualMachine host

KVM: navajos

Location
virtual machine on fritz
Allocated Resources
4 processors, 2.5G RAM, 60G storage
Operating System
Debian Squeeze AMD64
User Logins
No
Intended Use
Apache hosting and dynamic web content, including HCoop web services
Details

ServerNavajos

KVM: bog

Location
virtual machine on fritz
Allocated Resources
4 processors, 3G RAM, 30G storage
Operating System
Debian Squeeze AMD64
User Logins
No
Intended Use
Member shell and server hosting
Details

ServerBog

deleuze

Use: email server, backup server

mire

This is slated for removal in early-mid 2013. See ToDo.

Use: dynamic web content, services that involve running arbitrary code from members (including custom daemons, etc.)

kvm

The StarTech Server Remote Control External KVM over IP provides access to systems that may have a degraded network. It allows us to monitor Power-On Self Test (POST), configure BIOS/CMOS, and even reinstall operating system software. It must be connected to another multiple port KVM in order to have access to more than one server.

hopper

Back of hopper, taken 24feb09.jpg Hopper card closeup, taken 24feb09.jpg Inside hopper, taken 24feb09.jpg

Use: Secondary KDC and SpamAssassin

(The 1x2 GB RAM module was acquired from Newegg, and the two disks from ServerSupply. Purchases were made in Sep 2008, but ServerSupply took good 3 weeks to deliver).

Linode

outpost

  • Location: Linode (hosted at UK data center)
  • Model: Xen VM
  • Processor: 4 cores (1x priority?)
  • RAM: 512 MB
  • Disk: 40 GB
  • OS: Debian squeeze
  • User logins: no

Use: secondary DNS on a different subnet, all tasks requiring remote location.

Awaiting setup

None.

Awaiting purchase

We need new drives for fritz to handle backups with dying. See FritzBackupDriveDiscussion

Decommissioned

See /Decommissioned

CategorySystemAdministration

Hardware (last edited 2021-04-17 15:58:03 by ClintonEbadi)