Project infrastructure

News and Announcements related to GhostBSD
Post Reply
kraileth
Posts: 312
Joined: Sun Sep 04, 2016 12:30 pm

Project infrastructure

Post by kraileth »

Ok, we currently have one Canadian server that does "everything" for the project but I'm not really aware what all this is. And we're planning to add a package build server and a package mirror. Since documenting existing stuff is maybe not that easy, my suggestion is to plan out the new server(s) first. Once we've found a way of documenting things that works well for all of us we can add the missing info for the Canadian main server.

Please comment on this! Here's my take at what I'd like to do (this is to be discussed - the FQDN does not resolve yet and stuff; it's just a proposal. Also since we don't need it in production, yet, it makes sense to test stuff there that we need in the future):

------------------

Host: eu.ghostbsd.org
Intended for: EU package mirror (eventually), test system (currently)
Specs:
  • Type: VM
  • CPU: 4 Cores @ 3.0 GHz
  • RAM: 8192 MB
  • Storage: 2x 100 GB
Main IP: 212.77.245.35
Access: SSH (username@fqdn, port 1022)
Disk layout: zpool (mirror)

Function: Salt minion
  • Installed directly on host: Saltstack
  • Allows the host to be managed using Saltstack
Function: Backup client
  • Installed directly on host: Bacula client
  • Allows configuration data and things like that to be backed up
Function: Non public Git server
  • Provided by: Gitolite jail
  • Jail IP: ?
  • Repository 1: Saltstack states, pillar and files
  • Repository 2: Server documentation and other internal material
  • Repository 3: Experimental stuff?
Function: Salt master
  • Provided by: Salt master jail
  • Jail IP: ?
  • Experimental salt master for all minions (should move to the main server at some point)
Function: Backup server
  • Provided by: Bacula server jail
  • Jail IP: ?
  • Backs up important data from backup clients
Function: Mail server
  • Provided by: OpenSMTPD jail
  • Jail IP: ?
  • Mailserver for ghostbsd.org
Function: FTP server
  • Provided by: Pureftpd jail?
  • Provides an FTP mirror for GhostBSD ISOs and packages
Function: Anything else that we might need to test...

------------------

Host: buildserver.ghostbsd.org
Intended for: Package building
Specs: To be decided
  • Type: 1HE?
  • CPU: ?
  • RAM: ?
  • Storage: ?
Main IP: ?
Access: SSH (username@fqdn, port 1022)
Disk layout: ?

Function: Salt minion
  • Installed directly on host: Saltstack
  • Allows the host to be managed using Saltstack
Function: Backup client
  • Installed directly on host: Bacula client
  • Allows configuration data and things like that to be backed up
Function: Package builder
  • Installed directly on host: Synth
  • Allows for building packages
ASX
Posts: 988
Joined: Wed May 06, 2015 12:46 pm

Re: Project infrastructure

Post by ASX »

A note about the next to be buildserver: I'm currently trying to have a complete repo on our canadian server, it is currently building for 5 hours, at a rate of 375 pkgs per hour.

So far, a total of 4000 pkgs is using 26 GB.

I'm evaluating if we could do with 2 SSD x 300 GB only ... that would allow us to use a relatively cheap server.

Note that I'm not pushing the machine to the maximum ... so I would expect we could easily reach something like 600 to 800 pkgs per hour.

And, a limited repo (10000 pkgs) is however something to consider as a fallback.
Post Reply