welcome: please sign in

Diff for "ClintonEbadi"

Differences between revisions 19 and 31 (spanning 12 versions)
Revision 19 as of 2013-01-02 23:59:46
Size: 4306
Editor: ClintonEbadi
Comment:
Revision 31 as of 2013-01-17 19:38:47
Size: 6808
Editor: ClintonEbadi
Comment: more notes to self
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
I am Clinton Ebadi. I am Clinton Ebadi. I am the reluctant President of the coop (someone has to do it), and the current lead sysadmin / DomTool maintainer / lo-fi AdamChlipala replacement.
Line 11: Line 11:
 * October 2012: New website online, navajos and bog both up with new members using them
 * October 2012->
January 2013: Big push for new members. New website should make us seem more alive, we've finally fixed about 3/4 of the "temporary" hacks from when we first moved to Peer1, etc. In the background, prioritize getting rid of mire (less work: we just have to get people off of it), but also work toward getting rid of deleuze. Web services first (low hanging fruit), even if it means punting on fully converting to domtool managed sites (at least packaged and documented). AFAICT other than those we're just left with:
 * January 2013: New website online, navajos and bog both up with new members using them
 * February 2013->December 2013:
Big push for new members. New website should make us seem more alive, we've finally fixed about 3/4 of the "temporary" hacks from when we first moved to Peer1, etc. mire is gone (less work: we just have to get people off of it), but also work toward getting rid of deleuze. Web services first (low hanging fruit), even if it means punting on fully converting to domtool managed sites (at least packaged and documented). AFAICT other than those we're just left with:
Line 21: Line 21:
 * April 2013: Election and hopefully 150 members. Mire has been turned off for at least a month at this point.
 * Summer 2013: Assuming 150+ members, more disk space and perhaps more bandwidth are in order. Deleuze should be safe to turn off by now at the latest.
 * Late Summer 2013: Catch the sales on the last generation Dell 2U/2-socket machines and create a clean counterpart to fritz
 * March 2013: Catch the sales on the last generation Dell 2U/2-socket machines and create a clean counterpart to fritz.
Line 26: Line 24:
     * For the first time, this is realistic: all of those months packaging our configuration pay off by sparing future-me from herculean efforts.
   * Fritz becomes the last-generation backup server (secondary dns + kdc + MX + xmpp + load balancing with apache? + automagic database replication for members + ???)
     * For the first time, this is realistic: all of those months packaging our configuration pay off by sparing future-me from herculean efforts. And SteveKillen, BtTempleton, and I are probably available for a road trip to Peer1.
 * March 2013->July 2013: Transition remaining services off of deleuze onto KernelVirtualMachine``s on new kvm host
 * April 2013: Election and hopefully 120 members. Mire has been turned off for at least a month at this point.
 * Winter 2013: Assuming 150+ members, perhaps more bandwidth is in order. Deleuze should be safe to turn off by now at the latest.
Line 29: Line 29:
   * IPv6, mediagoblin, diaspora, gitorious, xmpp works again (and ability to use vanity domains), ...
Line 43: Line 44:
= Immediate Tasks =

 * Reattempt contacting members who have ignored the roll-call
   * Each board member gets 15, mail Non-HCoop Email, application email if it is available
 * Get website online
   * Planet
   * Prettier urls
 * Networked domtool-tail
 * `fwtool regen` with no host (= all hosts)
 * Possible donations for new server
 * Board meeting
 * Backups (blocked by lack of hardware)
 * Spec out new server
 * Consolidate web stuff onto navajos
   * Upgrade bugzilla
   * Restore phpmyadmin
   * Upgrade squirrelmail
   * Upgrade wiki
   * webdav/svn
     * Can we support gssapi negotiate? Seems like it should be trivial on the server side.
Line 44: Line 66:

== etc. ==

 * default DirectoryIndex does not include index.shtml, should this be changed?
Line 49: Line 75:
 * Removing ns3.hcoop.net, and outpost's IP changing. Members have been using the literal IPs in their low-level `domain` configs. Define `nsN_ip` values in hcoop.dtl and force members to use them.
Line 52: Line 77:
=== Mail ===
Line 54: Line 78:
 * Change `DefaultAlias` to false in the vain hope it makes gmail like us more. Side effect is less spam for everyone.
   * Really need to support $user+$local addresses for this to work well
   * Ideally we could drop spam and whatever, but that's a lot of work and possibly not the right thing
 * Change SPF for `hcoop.net` to mandate that all mail come from `mail.hcoop.net`.
   * And something like `addHcoopSPF` for members to set the same record if they want to forward through us
   * "-all" spf for mire/navajos/fritz/hopper.hcoop.net ? Possibly no, need to figure out rewriting to make sure no mail gets out with the hostname
 * Don't generate backscatter when spammers send mail to users forwarding offsite
   * Really not sure how to do this and not violate various RFCs
   * Looks basically impossible for gmail, best strategy is to mitigate spam sent to them in the first place
 * https://support.google.com/mail/bin/answer.py?hl=en&answer=175365
   * Inform members what they can do...
     * Add receipt address to send as, exim filter rule to nuke spam, ...
     * Can we add SPAM to the subject of all messages going to gmail that are marked as such by SA?
== domtool plans ==
Line 68: Line 80:
Immediate steps:  * Feature backlog
 * SSL improvements (SNI, intermediate certificates, ...)
 * Networked domtool-tail
 * FastCGI
   * Seems like the most straightforward of the fancy CGI to persistent server replacement to gets working, and has wide support. MoinMoin can use it... and it's a lot less tricky for members to get working than proxied servers on another host.
   * Ideally, support wsgi and whatnot later, assuming they can do suexec
 * `default CSymbol = Value` for binding default environment variable settings
    * Expands the scope of extensions that can be written in pure DomTool, slight flexibility gains
 * Improve `fwtool` as needs become clearer
   * `fwtool regen` without node to regen all nodes, `fwtool verify` and possibly something akin to `visudo`
   * Programmitic interface to adding/removing/etc rules?
     * At least need a way to kill rules when destroying the user, ideally just disabling them? (existing code ignores users who do not exist, so it sort of works to ignore it, but cleanliness of the rules file will become a problem).
   * "Proper" parser. Read rules into typed structure using the magic of SML, and work on that form (more natural, type safe, etc.)
   * groups or similar for common ports
     * We need a way to grant users who just want general net access a reasonably unrestrictive firewall, without needlessly opening things for members who don't use our shell services extensively. Since we can't restrict socket permissions generally, defining groups that provide common firewall rules seems like an ok solution.
Line 70: Line 96:
 * Change SPF records for hcoop.net and define `addDefaultSPF` (`mx -all`, making it effectively universal)
 * Recommend DefaultAlias = false
 * Point members at google forwarding docs
   * Directly suggest "send as..." change
   * Don't forward spam if possible (solicit an exim rule from a member...)
 * Fix exim TLS certificate (deleuze instead of mail)
== Major Sysadmin Tasks for 2013 ==

 * Acquire and install new server, cleaning up the back of the rack in the process
 * Get everything off of deleuze
 * Clean up keytabs (at least `$user.mail` for mail delivery, sync to as few nodes as needed, etc.)
 * Overhaul mail delivery
   * Revisit routing/transport; the current routing config has too many entry and exit points making changes extremely complicated (i.e. likely to break mail delivery)
   * Take advantage of new exim features like DKIM.
   * Secondary MX

= Board Stuff =

 * What address should we be using for the "owner" of hcoop services? It's a mix of the current treasurer, registered agent, and data center right now... is the registered agent correct? Do we need to get a PO Box or something?
 * We need a private wiki of some sort for filing sensitive information like welcome emails for services and various credentials... is it safe enough to do that using the public moin and acls? I'm not sure sure...

== Roll Call ==

https://members.hcoop.net/portal/roll?view=10

After an initial burst of acknowledgement, acknowledgements came to a stand still after only four days. We need to contact everyone by alternate means.

Write SQL to extract initial member app email and non-hcoop email so that we can either automatically or manually re-contact everyone.

  * Can we use paypal/wallet addresses? It might be against the TOS for those services to email members like that, but if it's not... paying us is basically the only contact we have with most members so I bet they'd be the most reliable.

 * WebUser.paypal, WebUser.checkout, MemberApp.email, Contact.v (what ContactKind for email?)

I am Clinton Ebadi. I am the reluctant President of the coop (someone has to do it), and the current lead sysadmin / DomTool maintainer / lo-fi AdamChlipala replacement.

1. Board Statements

See /BoardStatements

2. General Coop Goals

Unstructured musing on when/what I think the coop ought to be.

  • January 2013: New website online, navajos and bog both up with new members using them
  • February 2013->December 2013: Big push for new members. New website should make us seem more alive, we've finally fixed about 3/4 of the "temporary" hacks from when we first moved to Peer1, etc. mire is gone (less work: we just have to get people off of it), but also work toward getting rid of deleuze. Web services first (low hanging fruit), even if it means punting on fully converting to domtool managed sites (at least packaged and documented). AFAICT other than those we're just left with:

    • DomTool dispatcher

    • Master DNS
    • Exim
    • IMAP (might have to patch courier-authdaemon)
    • A few straggling openafs volumes (+ AFSDB records?)
    • Backups
    • MailMan

    • The portal
  • March 2013: Catch the sales on the last generation Dell 2U/2-socket machines and create a clean counterpart to fritz.
    • Minimal KVM host setup for base OS. We might run the KDC and OpenAFS on the bare metal, not entirely certain.
    • Create new wheezy based VMs, duplicating (and turning into master) services hosted in VMs on fritz
      • For the first time, this is realistic: all of those months packaging our configuration pay off by sparing future-me from herculean efforts. And SteveKillen, BtTempleton, and I are probably available for a road trip to Peer1.

  • March 2013->July 2013: Transition remaining services off of deleuze onto KernelVirtualMachines on new kvm host

  • April 2013: Election and hopefully 120 members. Mire has been turned off for at least a month at this point.
  • Winter 2013: Assuming 150+ members, perhaps more bandwidth is in order. Deleuze should be safe to turn off by now at the latest.
  • Spring 2014: Ponies for everyone.
    • IPv6, mediagoblin, diaspora, gitorious, xmpp works again (and ability to use vanity domains), ...

3. Contact

  • <clinton at unknownlamer dot org> (Email)

  • unknownlamer (AOL Instant Messenger)
  • <clinton at hcoop dot net> (Jabber)

  • unknown_lamer on freenode (IRC) in #hcoop

  • +1 443 538 8058 (Phone, SMS preffered)

4. Websites

5. Immediate Tasks

  • Reattempt contacting members who have ignored the roll-call
    • Each board member gets 15, mail Non-HCoop Email, application email if it is available
  • Get website online
    • Planet
    • Prettier urls
  • Networked domtool-tail
  • fwtool regen with no host (= all hosts)

  • Possible donations for new server
  • Board meeting
  • Backups (blocked by lack of hardware)
  • Spec out new server
  • Consolidate web stuff onto navajos
    • Upgrade bugzilla
    • Restore phpmyadmin
    • Upgrade squirrelmail
    • Upgrade wiki
    • webdav/svn
      • Can we support gssapi negotiate? Seems like it should be trivial on the server side.

6. Admin Stuff

6.1. etc.

  • default DirectoryIndex does not include index.shtml, should this be changed?

6.2. Terrible Things

Since we are having a roll call soon, we need to deal with these.

  • phpVersion needs to change

6.3. domtool plans

  • Feature backlog
  • SSL improvements (SNI, intermediate certificates, ...)
  • Networked domtool-tail
  • FastCGI
    • Seems like the most straightforward of the fancy CGI to persistent server replacement to gets working, and has wide support. MoinMoin can use it... and it's a lot less tricky for members to get working than proxied servers on another host.

    • Ideally, support wsgi and whatnot later, assuming they can do suexec
  • default CSymbol = Value for binding default environment variable settings

    • Expands the scope of extensions that can be written in pure DomTool, slight flexibility gains

  • Improve fwtool as needs become clearer

    • fwtool regen without node to regen all nodes, fwtool verify and possibly something akin to visudo

    • Programmitic interface to adding/removing/etc rules?
      • At least need a way to kill rules when destroying the user, ideally just disabling them? (existing code ignores users who do not exist, so it sort of works to ignore it, but cleanliness of the rules file will become a problem).
    • "Proper" parser. Read rules into typed structure using the magic of SML, and work on that form (more natural, type safe, etc.)
    • groups or similar for common ports
      • We need a way to grant users who just want general net access a reasonably unrestrictive firewall, without needlessly opening things for members who don't use our shell services extensively. Since we can't restrict socket permissions generally, defining groups that provide common firewall rules seems like an ok solution.

6.4. Major Sysadmin Tasks for 2013

  • Acquire and install new server, cleaning up the back of the rack in the process
  • Get everything off of deleuze
  • Clean up keytabs (at least $user.mail for mail delivery, sync to as few nodes as needed, etc.)

  • Overhaul mail delivery
    • Revisit routing/transport; the current routing config has too many entry and exit points making changes extremely complicated (i.e. likely to break mail delivery)
    • Take advantage of new exim features like DKIM.
    • Secondary MX

7. Board Stuff

  • What address should we be using for the "owner" of hcoop services? It's a mix of the current treasurer, registered agent, and data center right now... is the registered agent correct? Do we need to get a PO Box or something?
  • We need a private wiki of some sort for filing sensitive information like welcome emails for services and various credentials... is it safe enough to do that using the public moin and acls? I'm not sure sure...

7.1. Roll Call

https://members.hcoop.net/portal/roll?view=10

After an initial burst of acknowledgement, acknowledgements came to a stand still after only four days. We need to contact everyone by alternate means.

Write SQL to extract initial member app email and non-hcoop email so that we can either automatically or manually re-contact everyone.

  • Can we use paypal/wallet addresses? It might be against the TOS for those services to email members like that, but if it's not... paying us is basically the only contact we have with most members so I bet they'd be the most reliable.


CategoryHomepage

ClintonEbadi (last edited 2021-11-06 17:50:12 by ClintonEbadi)