|
Size: 9113
Comment: Added "budget" altus server with SATA RAID for web.
|
Size: 3376
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| = New System Hardware = | #pragma section-numbers off |
| Line 3: | Line 3: |
| During the HCoop IRC meeting on June 24, 2006, the group decided that it would based it's new system architecture on the following pieces of hardware: | This page collects information on the hardware that we have installed or plan to install as part of HCoop infrastructure. |
| Line 5: | Line 5: |
| * Two robust servers, one that doesn't allow normal user logins, and one that does. * One switch to form a LAN between these servers. * One serial port device, to facilitate remote access to our servers. |
<<TableOfContents>> |
| Line 9: | Line 7: |
| Also, it was mentioned that we should research hardware support contracts from any vendor that will be selling us equipment. | = Peer1 = |
| Line 11: | Line 9: |
| Additionally, group decided that the server that HCoop currently owns, Abulafia, will be brought to he.net for shell service. This will follow a necessary re-load of the OS software at a time to be determined later. | Current pictures of the actual Peer1 cabinet are at [[OnSiteVisits/20130627]]. |
| Line 13: | Line 11: |
| This page will serve as a forum for collaborative research on the pieces of hardware that we need. | == fritz == |
| Line 15: | Line 13: |
| == Servers == | FritzInfo |
| Line 17: | Line 15: |
| We will be purchasing two servers, which will be configured and sent to he.net for colocation. | * Location: Peer1 * Model: Dell PowerEdge 2970 * Processor: 2x Quad Core AMD Opteron™ 2372HE 2.1GHz 4x512K Cache 1Ghz HyperTrnsprt * RAM: 24GB (4x2GB + 4x4GB), 800MHz, Dual Ranked * 1x6 Backplane for 3.5-inch Hard Drives * Integrated SAS/SATA No RAID * Disks: system disks 2x 160GB 7.2K RPM Serial ATA 3Gbps 3.5-in HotPlug Hard Drive , + AFS disks 2x 1 TB Western Digital in RAID 1 * Redundant Power Supply with Dual Cords * Lan: Dual Embedded Broadcom® NetXtreme II 5708 Gigabit Ethernet NIC * Form factor: 2U * OS: Debian Squeeze * User logins: no * Source: purchase from Dell store, 2x 1 TB disks from Newegg |
| Line 19: | Line 29: |
| === Desired Features === | '''Use: AndrewFileSystem fileserver, MitKerberos kdc, KernelVirtualMachine host''' |
| Line 21: | Line 31: |
| These servers should be as redundant as possible. At this point, we cannot afford to have less than one point of failure in many areas, so we should look for the following features in our new servers: | === KVM: navajos === |
| Line 23: | Line 33: |
| * Redundant power supplies. * Hardware RAID. * Dual CPU's, AMD seems to be a stronger option than Intel |
Location:: virtual machine on fritz Allocated Resources:: 6 processors, 6G RAM, 60G storage Operating System:: Debian Wheezy AMD64 User Logins:: No Intended Use:: Apache hosting and dynamic web content, including HCoop web services Details:: ServerNavajos |
| Line 27: | Line 40: |
| ==== Differences Between the Servers ==== | === KVM: bog === |
| Line 29: | Line 42: |
| The admin-only server will hopefully be serving an AFS file system, which means that fancier kinds of RAID are justified there. The all-members server can get away with cheaper (and maybe even faster) solutions for local disk access. | Location:: virtual machine on fritz Allocated Resources:: 4 processors, 3G RAM, 30G storage Operating System:: Debian Wheezy AMD64 User Logins:: Yes Intended Use:: Member shell and server hosting Details:: ServerBog |
| Line 31: | Line 49: |
| JustinLeitgeb thinks that perhaps RAID 1 would work on the all-members server, and either RAID 5 or RAID 10 on the admin server. It should be RAID 10 if we can afford it, or RAID 5 if we're shorter on cash. :) | === KVM: mccarthy === |
| Line 33: | Line 51: |
| There may be other factors influencing different configuration choices between the servers. | Location:: virtual machine on fritz Allocated Resources:: 4 processors, 2G RAM, 45G storage Operating System:: Debian Jessie AMD64 User Logins:: No Intended Use:: Mail server Details:: ServerMcCarthy |
| Line 35: | Line 58: |
| Perhaps we can get away with SATA RAID 1 on the web server -- hopefully this machine won't be IO-bound, especially if we add enough RAM later. | = Linode = |
| Line 37: | Line 60: |
| === Proposed Models and Vendors === | == outpost == |
| Line 39: | Line 62: |
| Vendors: | * Location: Linode (hosted at UK data center) * Model: Xen VM * Processor: 8 cores (1x priority?) * RAM: 1024 MB * Disk: 40 GB * OS: Debian wheezy * User logins: no |
| Line 41: | Line 70: |
| * [http://www.penguincomputing.com/index.php?option=com_content&task=view&id=172&Itemid=230 Penguin Computing] * [http://www.dell.com/ Dell] * [http://www.monarchcomputer.com/Merchant2/merchant.mv?Screen=CTGY&Store_Code=M&Category_Code=allracks Monarch Computer Systems] |
'''Use: secondary DNS on a different subnet, all tasks requiring remote location.''' |
| Line 45: | Line 72: |
| Models: | = Digital Ocean = |
| Line 47: | Line 74: |
| * Possible web server configuration from [http://www.penguincomputing.com Penguin] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_web_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_web_server.pdf (PDF)] * Possible admin server configuration from [http://www.penguincomputing.com Penguin] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_server.pdf (PDF)] * Possible web server from [http://www.dell.com/ Dell] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_web_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_web_server.pdf (PDF)], based on the Dell PowerEdge 1850. * Possible admin server from [http://www.dell.com/ Dell] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_admin_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/dell_admin_server.pdf (PDF)], based on the Dell PowerEdge 2850 (offers more space for hard disks in our primary file server). * Possible admin server configuration from [http://www.penguincomputing.com Penguin], using the 2U server, redundant power supplies, and RAID 5 [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid5_server.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid5_server.pdf (PDF)] * Possible admin server configuration from [http://www.penguincomputing.com Penguin], using the 2U server, redundant power supplies, and RAID 10 [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid10_server_2200.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/penguin_admin_raid10_server_2200.pdf (PDF)] * Possible web server configuration with SATA RAID 1, budget configuration about $2700 [http://www.penguincomputing.com Penguin], [http://www.hcoop.net/~leitgebj/hcoop_servers/altus_budget_web.ps (postscript)] [http://www.hcoop.net/~leitgebj/hcoop_servers/altus_budget_web.pdf (PDF)] |
== gibran == |
| Line 55: | Line 76: |
| Note that when I checked Dell dropped something like $1200 off of the price of each server over $4000, so we should expect some significant discounts. Whichever company we plan on going with, we may be able to negotiate lower prices by emphasizing that we may buy more in the future, etc. With the Penguin models, we seem to have to go to the 2U, Altus 2200 in order to get a redundant power supply. | Location:: DigitalOcean NYC3 Allocated Resources:: 6 vCPU, 16G RAM, 320G storage. Additional block storage volume for OpenAFS `/vicepa` Operating System:: Debian Stretch AMD64 User Logins:: No Intended Use:: Primary AndrewFileSystem fileserver and dbserver, primary MitKerberos KDC Details:: ServerGibran |
| Line 57: | Line 83: |
| == Ethernet Switch == | == marsh == |
| Line 59: | Line 85: |
| === Desired Features === | Location:: DigitalOcean NYC3 Allocated Resources:: 4vCPU, 8G RAM, 160G storage Operating System:: Debian Stretch AMD64 User Logins:: No Intended Use:: Member logins Details:: ServerMarsh |
| Line 61: | Line 92: |
| * Gigabit * 5 ports minimum * Managed - so that we can troubleshoot failed NIC's easier * Rack-mountable, so that vibration and heat issues are diminished. * SNMP monitoring capability |
== minsky == |
| Line 67: | Line 94: |
| === Additional Information === | Location:: DigitalOcean NYC3 Allocated Resources:: 2vCPU, 4G RAM, 80G storage Operating System:: Debian Stretch AMD64 User Logins:: No Intended Use:: Mail server and ejabberd server Details:: ServerMinsky |
| Line 69: | Line 101: |
| He.net sent us the following when asked about switch configurations at their site: | == shelob == |
| Line 71: | Line 103: |
| ''We've got customers using everything from ElCheapoSwitch(tm) to Cisco-grade equipment. The main difference between the two is how much traffic they can deal with, the number of packets they can deal with, and how they can be accesses/monitored. If you're looking at pushing primarily web traffic (<50Mb/s) and do not require any of the more advanced functionality of a managed switch, you could likely just go with a good unmanaged switch. If you were doing higher traffic levels, streaming, or other such traffic which consist of a zillion little packets, especially if it's between your servers, you would be better served by something a bit higher grade.'' | Location:: DigitalOcean NYC3 Allocated Resources:: 4vCPU, 8G RAM, 160G storage Operating System:: Debian Stretch AMD64 User Logins:: No Intended Use:: Web Server Details:: ServerShelob |
| Line 73: | Line 110: |
| And from another support rep at he.net (their responsiveness has been impressive so far!): | = Awaiting setup = |
| Line 75: | Line 112: |
| ''Depends on their needs. If they want to run MRTG, then they need a managed switch. If they just need a switch, a netgear or linksys or d-link will accomplish the job. |
None. |
| Line 79: | Line 114: |
| Cost differences are greater managed versus non-managed. Non-managed can be 50-$100, whereas managed can start at about $250 and go into the $thousands depending on model and capabilities.'' |
= Awaiting purchase = |
| Line 83: | Line 116: |
| === Proposed Models and Vendors === | New virtual servers, see VirtualizedHosting2018 and ServerMigration2018. |
| Line 85: | Line 118: |
| ==== Vendors ==== | = Decommissioned = |
| Line 87: | Line 120: |
| [http://newegg.com/ Newegg] has been recommended to several of us. | See [[/Decommissioned]] for older machines |
| Line 89: | Line 122: |
| ==== Models ==== ===== NETGEAR GS108 10/100/1000Mbps ===== [http://www.newegg.com/Product/Product.asp?Item=N82E16833122111 Netgear GS108 Switch ]: Highly-rated Netgear switch that is not rack-mountable Price: ($56.99) MichaelOlson thinks that we should go with the Netgear switch. It has been rated as a very reliable product, and is very affordable. I don't like this switch for the following reasons: 1. It is not rack-mountable, meaning that it could raise issues for cooling in the rack, and be more susceptible to shock that could reduce reliability of the switch, or jar patch cables out of the ports. 2. It is not managed, so we can't track important information about performance and possible NIC failures via SNMP. Basically, I think that if we're going to pay all of this money for equipment and hosting, we shouldn't put an interconnect with insufficient features in the middle of our architecture. But, I'm not a networking expert, so I would welcome any opinions contrary to this! JustinLeitgeb ===== Level One GSW-1655 10/100/1000Mbps ===== * ($249.99) Level One 16-port rack-mountable switch [[http://www.newegg.com/Product/Product.asp?Item=N82E16833118021 link ]] I've never heard of this brand (Level 1?) so I don't trust it. Any reviews? JustinLeitgeb ===== 3Com® SuperStack® 3 Switch 3812 ===== [http://www.3com.com/products/en_US/detail.jsp?tab=features&pathtype=purchase&sku=3C17401 3Com® SuperStack® 3 Switch 3812] seems to have most of the features that we need, with a bit of room to grow. Prices range from $1000 to $1500 on [http://froogle.google.com Froogle], in my experience [http://www.cdw.com CDW] is a reliable vendor. Perhaps we should make a jump and get the 24 port, which would support our use of an entire rack in the future, if the price difference is small? I think that we should look for something in this range, but would welcome critiques -- I'm not a network tech! JustinLeitgeb == Serial Port == === Desired Features === Is this device really necessary? For an extra $1000 - $2000, and utilization of 1U, I am not convinced that this is worth the expense. It seems that in the rare event that our machine is inaccessible from ssh we can use remote hands with he.net and put our resources elsewhere. If someone does think that this is necessary, please put a link to specific models that would be helpful, and a list of reasons why they will come in handy that would justify the additional cost and space in our rack. JustinLeitgeb === Proposed Models and Vendors === [http://www.cyclades.com/ Cyclades] was mentioned as one vendor of serial port devices which are linux-friendly. |
---- CategorySystemAdministration |
This page collects information on the hardware that we have installed or plan to install as part of HCoop infrastructure.
Contents
Peer1
Current pictures of the actual Peer1 cabinet are at OnSiteVisits/20130627.
fritz
- Location: Peer1
Model: Dell PowerEdge 2970
Processor: 2x Quad Core AMD Opteron™ 2372HE 2.1GHz 4x512K Cache 1Ghz HyperTrnsprt
- RAM: 24GB (4x2GB + 4x4GB), 800MHz, Dual Ranked
- 1x6 Backplane for 3.5-inch Hard Drives
- Integrated SAS/SATA No RAID
Disks: system disks 2x 160GB 7.2K RPM Serial ATA 3Gbps 3.5-in HotPlug Hard Drive , + AFS disks 2x 1 TB Western Digital in RAID 1
- Redundant Power Supply with Dual Cords
Lan: Dual Embedded Broadcom® NetXtreme II 5708 Gigabit Ethernet NIC
- Form factor: 2U
- OS: Debian Squeeze
- User logins: no
- Source: purchase from Dell store, 2x 1 TB disks from Newegg
Use: AndrewFileSystem fileserver, MitKerberos kdc, KernelVirtualMachine host
KVM: navajos
- Location
- virtual machine on fritz
- Allocated Resources
- 6 processors, 6G RAM, 60G storage
- Operating System
- Debian Wheezy AMD64
- User Logins
- No
- Intended Use
- Apache hosting and dynamic web content, including HCoop web services
- Details
KVM: bog
- Location
- virtual machine on fritz
- Allocated Resources
- 4 processors, 3G RAM, 30G storage
- Operating System
- Debian Wheezy AMD64
- User Logins
- Yes
- Intended Use
- Member shell and server hosting
- Details
KVM: mccarthy
- Location
- virtual machine on fritz
- Allocated Resources
- 4 processors, 2G RAM, 45G storage
- Operating System
- Debian Jessie AMD64
- User Logins
- No
- Intended Use
- Mail server
- Details
Linode
outpost
- Location: Linode (hosted at UK data center)
- Model: Xen VM
- Processor: 8 cores (1x priority?)
- RAM: 1024 MB
- Disk: 40 GB
- OS: Debian wheezy
- User logins: no
Use: secondary DNS on a different subnet, all tasks requiring remote location.
Digital Ocean
gibran
- Location
DigitalOcean NYC3
- Allocated Resources
6 vCPU, 16G RAM, 320G storage. Additional block storage volume for OpenAFS /vicepa
- Operating System
- Debian Stretch AMD64
- User Logins
- No
- Intended Use
Primary AndrewFileSystem fileserver and dbserver, primary MitKerberos KDC
- Details
marsh
- Location
DigitalOcean NYC3
- Allocated Resources
- 4vCPU, 8G RAM, 160G storage
- Operating System
- Debian Stretch AMD64
- User Logins
- No
- Intended Use
- Member logins
- Details
minsky
- Location
DigitalOcean NYC3
- Allocated Resources
- 2vCPU, 4G RAM, 80G storage
- Operating System
- Debian Stretch AMD64
- User Logins
- No
- Intended Use
- Mail server and ejabberd server
- Details
shelob
- Location
DigitalOcean NYC3
- Allocated Resources
- 4vCPU, 8G RAM, 160G storage
- Operating System
- Debian Stretch AMD64
- User Logins
- No
- Intended Use
- Web Server
- Details
Awaiting setup
None.
Awaiting purchase
New virtual servers, see VirtualizedHosting2018 and ServerMigration2018.
Decommissioned
See /Decommissioned for older machines