welcome: please sign in

Diff for "Hardware"

Differences between revisions 14 and 190 (spanning 176 versions)
Revision 14 as of 2006-06-24 23:29:15
Size: 4991
Comment: added RAID 5 server
Revision 190 as of 2015-04-19 19:42:12
Size: 7026
Editor: ClintonEbadi
Comment: link to the deets on mccarthy
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
= New System Hardware = #pragma section-numbers off
Line 3: Line 3:
During the HCoop IRC meeting on June 24, 2006, the group decided that it would based it's new system architecture on the following pieces of hardware: This page collects information on the hardware that we have installed or plan to install as part of HCoop infrastructure.
Line 5: Line 5:
 * Two robust servers, one that doesn't allow normal user logins, and one that does.
 * One switch to form a LAN between these servers.
 * One serial port device, to facilitate remote access to our servers.
<<TableOfContents>>
Line 9: Line 7:
Also, it was mentioned that we should research hardware support contracts from any vendor that will be selling us equipment. = Peer1 =
Line 11: Line 9:
Additionally, group decided that the server that HCoop currently owns, Abulafia, will be brought to he.net for shell service. This will follow a necessary re-load of the OS software at a time to be determined later. Current pictures of the actual Peer1 cabinet are at [[OnSiteVisits/20130627]].
Line 13: Line 11:
This page will serve as a forum for collaborative research on the pieces of hardware that we need. == fritz ==
Line 15: Line 13:
== Servers == FritzInfo
Line 17: Line 15:
We will be purchasing two servers, which will be configured and sent to he.net for colocation.  * Location: Peer1
 * Model: Dell PowerEdge 2970
 * Processor: 2x Quad Core AMD Opteron™ 2372HE 2.1GHz 4x512K Cache 1Ghz HyperTrnsprt
 * RAM: 8GB (4x2GB), 800MHz, Dual Ranked
 * 1x6 Backplane for 3.5-inch Hard Drives
 * Integrated SAS/SATA No RAID
 * Disks: system disks 2x 160GB 7.2K RPM Serial ATA 3Gbps 3.5-in HotPlug Hard Drive , + AFS disks 2x 1 TB Western Digital in RAID 1
 * Redundant Power Supply with Dual Cords
 * Lan: Dual Embedded Broadcom® NetXtreme II 5708 Gigabit Ethernet NIC
 * Form factor: 2U
 * OS: Debian Squeeze
 * User logins: no
 * Source: purchase from Dell store, 2x 1 TB disks from Newegg
Line 19: Line 29:
=== Desired Features === '''Use: AndrewFileSystem fileserver, MitKerberos kdc, KernelVirtualMachine host'''
Line 21: Line 31:
These servers should be as redundant as possible. At this point, we cannot afford to have less than one point of failure in many areas, so we should look for the following features in our new servers: === KVM: navajos ===
Line 23: Line 33:
 * Redundant power supplies.
 * Hardware RAID.
 * Dual CPU's, AMD seems to be a stronger option than Intel
 Location:: virtual machine on fritz
 Allocated Resources:: 6 processors, 6G RAM, 60G storage
 Operating System:: Debian Wheezy AMD64
 User Logins:: No
 Intended Use:: Apache hosting and dynamic web content, including HCoop web services
 Details:: ServerNavajos
Line 27: Line 40:
==== Differences Between the Servers ==== === KVM: bog ===
Line 29: Line 42:
The admin-only server will hopefully be serving an AFS file system, which means that fancier kinds of RAID are justified there. The all-members server can get away with cheaper (and maybe even faster) solutions for local disk access.  Location:: virtual machine on fritz
 Allocated Resources:: 4 processors, 3G RAM, 30G storage
 Operating System:: Debian Wheezy AMD64
 User Logins:: Yes
 Intended Use:: Member shell and server hosting
 Details:: ServerBog
Line 31: Line 49:
JustinLeitgeb thinks that perhaps RAID 1 would work on the all-members server, and either RAID 5 or RAID 10 on the admin server. It should be RAID 10 if we can afford it, or RAID 5 if we're shorter on cash. :) === KVM: mccarthy ===
Line 33: Line 51:
There may be other factors influencing different configuration choices between the servers.  Location:: virtual machine on fritz
 Allocated Resources:: 4 processors, 2G RAM, 45G storage
 Operating System:: Debian Jessie AMD64
 User Logins:: No
 Intended Use:: Mail server
 Details:: ServerMcCarthy
 
Line 35: Line 59:
=== Proposed Models and Vendors === == deleuze ==
 * Location: Peer1
 * Model: Dell PowerEdge 2850
 * Processor: 2 x 2.8 GHz Intel Xeon (2/2)
 * RAM: 4 GB (? slots, 16 GB Max, DDR-2400 SDRAM)
 * Disks (controller Ultra 320 SCSI):
  * 4 x 10K Seagate Cheetah SCSI drives, 73GB '''and'''
  * 2 x 10K Seagate Cheetah SCSI drives, 36GB
 * LAN: 2 x 10/100/1000
 * Extra: RAID kit, with battery, etc., 256 MB RAID cache, 2 power supplies
 * Form factor: 2U
 * OS: Debian stable
 * User logins: no
 * Source: donation by Justin Leitgeb
Line 37: Line 74:
Vendors:  * [[https://dcse.dell.com/selfstudy/Associates_7_0/Enterprise/PowerEdge/PE2850/printer_friendly.asp|Maintenance Manual for the PE 2850]]
 * http://www.dell.com/downloads/global/products/pedge/en/2850_specs.pdf
 * DeleuzeHotSwapDrive (instructions for replacing a failed drive without rebooting)
 * [[attachment:ut_linux.html|MegaRC RAID Utility Manual]]
 * Real picture:{{http://hcoop.net/~docelic/deleuze.hcoop.net.jpg}}
 * Historical discussion: PowerEdge2850, RebootingDeleuze
Line 39: Line 81:
 * [http://www.penguincomputing.com/index.php?option=com_content&task=view&id=172&Itemid=230 Penguin Computing]
 * [http://www.dell.com/ Dell]
 * [http://www.monarchcomputer.com/Merchant2/merchant.mv?Screen=CTGY&Store_Code=M&Category_Code=allracks Monarch Computer Systems]

Models:

 * Possible web server configuration from [http://www.penguincomputing.com Penguin] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_web_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_web_server.pdf (PDF)]
 * Possible admin server configuration from [http://www.penguincomputing.com Penguin] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_server.pdf (PDF)]
 * Possible web server from [http://www.dell.com/ Dell] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_web_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_web_server.pdf (PDF)], based on the Dell PowerEdge 1850.
 * Possible admin server from [http://www.dell.com/ Dell] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_admin_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_admin_server.pdf (PDF)], based on the Dell PowerEdge 2850 (offers more space for hard disks in our primary file server).
 * Possible admin server configuration from [http://www.penguincomputing.com Penguin], using the 2U server, redundant power supplies, and RAID 5 [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid5_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid5_server.pdf (PDF)]
'''Use: email server, backup server'''
Line 52: Line 84:
Note that when I checked Dell dropped something like $1200 off of the price of each server over $4000, so we should expect some significant discounts. Whichever company we plan on going with, we may be able to negotiate lower prices by emphasizing that we may buy more in the future, etc. The Penguin option doesn't seem to have redundant power supplies, which is disappointing. Does anyone know of a non-Dell vendor that can provide redundant power supplies? == kvm ==
Line 54: Line 86:
== Ethernet Switch ==  * Location: Peer1
 * Model: StarTech IP KVM
 * Source: Newegg?
Line 56: Line 90:
=== Desired Features ===  * [[KvmAccess]]
 * [[http://www.startech.com/Data/ProductManuals/SV1110IPEXT.pdf?c=US|StarTech manual]] ([[http://hcoop.net/~docelic/SV1110IPEXT.pdf|local copy]]).
Line 58: Line 93:
 * Gigabit
 * 5 ports minimum
The StarTech Server Remote Control External KVM over IP provides access to systems that may have a degraded network. It allows us to monitor Power-On Self Test (POST), configure BIOS/CMOS, and even reinstall operating system software. It must be connected to another multiple port KVM in order to have access to more than one server.
Line 61: Line 95:
=== Proposed Models and Vendors ===
Line 63: Line 96:
[http://newegg.com/ Newegg] has been recommended to several of us. == hopper ==
Line 65: Line 98:
 * ($56.99) Highly-rated Netgear switch that is not rack-mountable [[http://www.newegg.com/Product/Product.asp?Item=N82E16833122111 link ]]
 * ($249.99) Level One 16-port rack-mountable switch [[http://www.newegg.com/Product/Product.asp?Item=N82E16833118021 link ]]
 * Location: Peer1
 * Model: IBM xSeries 335
 * Processor: 2 x single-core P4 XEON 2.6Ghz with hyperthreading
 * RAM: 4 GB, 2x1 GB, 1x2 GB (3/4 slots, 8 GB Max, PC2100 ECC registered)
 * Disks:
  * 2x SCSI Ultra 320 80 pin. SEAGATE - 5 YEARS MFG WARRANTY. CHEETAH 73.4GB 15000 RPM 80PIN ULTRA320 SCSI HARD DISK DRIVE. 16MB BUFFER 3.5 LOW PROFILE(1.0 INCH). ST373455LC
  * Floppy 3.5"
 * LAN: 2 x 10/100/1000
 * Ports: 3 x USB, 1 x serial, 2 x PCI-X
 * PSU: 1/1
 * Form factor: 1U
 * Dimensions: W 17.5 in / H 1.75 in / D 25.75 in / Weight 33 lbs
 * OS: Debian Squeeze
 * User logins: no
 * Name voting at https://members.hcoop.net/portal/poll?report=17
 * Source: US Ebay, seller lapkosoft. http://cgi.ebay.com/ws/eBayISAPI.dll?ViewItem&item=300200776299
 * Real picture:{{http://hcoop.net/~docelic/hopper.hcoop.net.jpg}}
Line 68: Line 116:
MichaelOlson thinks that we should go with the Netgear switch. It has been rated as a very reliable product, and is very affordable.  * [[HopperServiceProcessor]]
 * [[http://www-947.ibm.com/systems/support/supportsite.wss/selectproduct?familyind=5105587&typeind=0&osind=0&continue.x=12&continue.y=13&brandind=5000008&oldbrand=5000008&oldfamily=5105587&oldtype=0&taskind=2&matrix=Y&psid=bm|IBM xSeries 335 Support Page]]
 * {{http://hcoop.net/~docelic/IBM_xSeries335_Front_0Bay.jpg}}
Line 70: Line 120:
== Serial Port == [[attachment:Back of hopper, taken 24feb09.jpg]]
[[attachment:Hopper card closeup, taken 24feb09.jpg]]
[[attachment:Inside hopper, taken 24feb09.jpg]]
Line 72: Line 124:
Docelic, or other users -- please update this section since I am entirely ignorant about these devices! :)
Line 74: Line 125:
=== Desired Features === '''Use: Secondary KDC, secondary openafs volume and fileserver, and SpamAssassin'''
Line 76: Line 127:
=== Proposed Models and Vendors === (The 1x2 GB RAM module was acquired from Newegg, and the two disks from ServerSupply. Purchases were made in Sep 2008, but ServerSupply took good 3 weeks to deliver).
Line 78: Line 129:
[http://www.cyclades.com/ Cyclades] was mentioned as one vendor of serial port devices which are linux-friendly.
= Linode =

== outpost ==

 * Location: Linode (hosted at UK data center)
 * Model: Xen VM
 * Processor: 8 cores (1x priority?)
 * RAM: 1024 MB
 * Disk: 40 GB
 * OS: Debian wheezy
 * User logins: no

'''Use: secondary DNS on a different subnet, all tasks requiring remote location.'''


= Awaiting setup =

None.

= Awaiting purchase =

We need a new KVM host and drives for staging offsite backups of openafs. See NewServerDiscussion2013


= Decommissioned =

== mire ==

{{{#!wiki note
Turned off, left in rack in case we end up re-using it as a wheezy based console server
}}}

 * Location: Peer1
 * Model: Sun Fire v20z
 * Processor: 1 x 1.6GHz AMD64 (Opteron) (1/2)
 * RAM: 5 GB (initial 2x512MB and additional 2x2GB, ? slots, 16 GB Max, DDR1/333 or DDR1/400 SDRAM)
 * Disks (controller Ultra 320 SCSI):
  * 2 x 36 GB (hot swap)
  * CD-Rom
  * Floppy
 * LAN: 2 x 10/100/1000
 * Form factor: 1U
 * Ports: 1 x USB 1.1, 1 x DB9 serial, 2 x PCI-X
 * Power: 100-240 V, 50/60 Hz, 465 W PFC supply, dual redundant fans
 * Dimensions: W 16.94 in / H 1.69 in / D 28.5 in / Weight 35 lbs
 * OS: Debian stable
 * User logins: yes
 * Source: donated by Ray Racine

 * [[RebootingMireSp]]
 * [[http://docs.sun.com/source/817-5248-21/|SunFire v20z User Guide]]
 * [[http://docs.sun.com/source/817-5249-17/|Service Processor Manual]]
 * http://docs.sun.com/source/817-5248-20/index.html
 * http://www.sun.com/servers/entry/v20z/index.jsp
 * {{http://hcoop.net/~docelic/sunFIRE_V20z.jpg}}
 * {{http://www.sun.com/servers/entry/v20z/images/gallery/full/img_3.jpg}}
 * {{http://hcoop.net/~docelic/SunFireV20z_expl.gif}}
 * Real picture:{{http://hcoop.net/~docelic/mire.hcoop.net.jpg}}

'''Former Use: dynamic web content, services that involve running arbitrary code from members (including custom daemons, etc.)'''


See [[/Decommissioned]] for older machines

----
CategorySystemAdministration

This page collects information on the hardware that we have installed or plan to install as part of HCoop infrastructure.

Peer1

Current pictures of the actual Peer1 cabinet are at OnSiteVisits/20130627.

fritz

FritzInfo

  • Location: Peer1
  • Model: Dell PowerEdge 2970

  • Processor: 2x Quad Core AMD Opteron™ 2372HE 2.1GHz 4x512K Cache 1Ghz HyperTrnsprt

  • RAM: 8GB (4x2GB), 800MHz, Dual Ranked
  • 1x6 Backplane for 3.5-inch Hard Drives
  • Integrated SAS/SATA No RAID
  • Disks: system disks 2x 160GB 7.2K RPM Serial ATA 3Gbps 3.5-in HotPlug Hard Drive , + AFS disks 2x 1 TB Western Digital in RAID 1

  • Redundant Power Supply with Dual Cords
  • Lan: Dual Embedded Broadcom® NetXtreme II 5708 Gigabit Ethernet NIC

  • Form factor: 2U
  • OS: Debian Squeeze
  • User logins: no
  • Source: purchase from Dell store, 2x 1 TB disks from Newegg

Use: AndrewFileSystem fileserver, MitKerberos kdc, KernelVirtualMachine host

KVM: navajos

Location
virtual machine on fritz
Allocated Resources
6 processors, 6G RAM, 60G storage
Operating System
Debian Wheezy AMD64
User Logins
No
Intended Use
Apache hosting and dynamic web content, including HCoop web services
Details

ServerNavajos

KVM: bog

Location
virtual machine on fritz
Allocated Resources
4 processors, 3G RAM, 30G storage
Operating System
Debian Wheezy AMD64
User Logins
Yes
Intended Use
Member shell and server hosting
Details

ServerBog

KVM: mccarthy

Location
virtual machine on fritz
Allocated Resources
4 processors, 2G RAM, 45G storage
Operating System
Debian Jessie AMD64
User Logins
No
Intended Use
Mail server
Details

ServerMcCarthy

deleuze

Use: email server, backup server

kvm

The StarTech Server Remote Control External KVM over IP provides access to systems that may have a degraded network. It allows us to monitor Power-On Self Test (POST), configure BIOS/CMOS, and even reinstall operating system software. It must be connected to another multiple port KVM in order to have access to more than one server.

hopper

Back of hopper, taken 24feb09.jpg Hopper card closeup, taken 24feb09.jpg Inside hopper, taken 24feb09.jpg

Use: Secondary KDC, secondary openafs volume and fileserver, and SpamAssassin

(The 1x2 GB RAM module was acquired from Newegg, and the two disks from ServerSupply. Purchases were made in Sep 2008, but ServerSupply took good 3 weeks to deliver).

Linode

outpost

  • Location: Linode (hosted at UK data center)
  • Model: Xen VM
  • Processor: 8 cores (1x priority?)
  • RAM: 1024 MB
  • Disk: 40 GB
  • OS: Debian wheezy
  • User logins: no

Use: secondary DNS on a different subnet, all tasks requiring remote location.

Awaiting setup

None.

Awaiting purchase

We need a new KVM host and drives for staging offsite backups of openafs. See NewServerDiscussion2013

Decommissioned

mire

Turned off, left in rack in case we end up re-using it as a wheezy based console server

Former Use: dynamic web content, services that involve running arbitrary code from members (including custom daemons, etc.)

See /Decommissioned for older machines


CategorySystemAdministration

Hardware (last edited 2021-04-17 15:58:03 by ClintonEbadi)