Collective: Difference between revisions
No edit summary |
|||
| (15 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
[[File:Collective.jpg|thumb|250px]] | [[File:Collective.jpg|thumb|250px|HP ProLiant MicroServer]] | ||
=The Borg= | =The Borg= | ||
The hackspace infrastructure is now run on small Borg collective of 3 HP Borg ProLiant MicroServer N40L, it | <blockquote>''We are the Borg. Lower your shields and surrender your ships. We will add your biological and technological distinctiveness to our own. Your culture will adapt to service us. Resistance is futile.''</blockquote> | ||
All three have identical base spec but Queen has two extra | |||
The hackspace infrastructure is now run on small Borg collective of 3 HP Borg ProLiant MicroServer N40L, it started as just one server collective but we have since added two more identical machines to the group.<br/> | |||
All three have identical base spec but different drive setups, Unimatrix and Locutus have two 1TB HDD's as a RAID 1, Queen has a 250GB SSD (OS), two extra 4TB HDD's (RAID 1) for backup storage and two extra 2TB HDD's (RAID 1) for data storage (docker / grafana). | |||
===Spec=== | ===Spec=== | ||
* AMD Turion II Neo N40L 1.5GHz Dual-Core CPU | * AMD Turion II Neo N40L 1.5GHz Dual-Core CPU | ||
* | * 2x8GB DDR3 ECC UDIMM | ||
* Internal SATA Cold Plug | * Four Internal SATA Cold Plug Hard-Drive's Bays | ||
* Embedded RAID 0/1 | * Embedded RAID 0/1 | ||
* 1x Gigabit Ethernet | * 1x Gigabit Ethernet | ||
* 150W PSU | * 150W PSU | ||
* 1 x HP NC360T dual port gigabit network card | * 1 x HP NC360T dual port gigabit network card | ||
<br style="clear: both" /> | <br style="clear: both" /> | ||
===Interconnection=== | ===Interconnection=== | ||
| Line 18: | Line 20: | ||
====HDD replication==== | ====HDD replication==== | ||
The direct link between Unimatrix and Locutus is used to do block level HDD replication and keeps this traffic off out main networks<br/> | The direct link between Unimatrix and Locutus is used to do block level HDD replication and keeps this traffic off out main networks<br/> | ||
Unimatrix and Locutus each have two | Unimatrix and Locutus each have two 200GB partitions for the VM storage. There primary store and there opposites backup store.<br/> | ||
The primary store is mounted read write and holds the VMs that cube runs. | The primary store is mounted read write and holds the VMs that cube runs. | ||
* Unimatrix | * Unimatrix | ||
[ | [50GB Host OS][200GB Primary][200GB Locutus replication][200GBB Jarvis homes replication] | ||
*Locutus | *Locutus | ||
[ | [50GB Host OS][200GB Primary][200GB Unimatrix replication][200GBB Jarvis homes replication] | ||
====Backups==== | ====Backups==== | ||
Queen handles the backups for the collective cubes, using the direct connections to Unimatrix and Locutus to keep the backup traffic off the main network. | Queen handles the backups for the collective cubes, using the direct connections to Unimatrix and Locutus to keep the backup traffic off the main network. | ||
It's 2TB HDD are configure in a software RAID 1 array and using the following LVM partition layout | It's 2TB HDD are configure in a software RAID 1 array and using the following LVM partition layout | ||
[100GB DB Backups][1TB VM Backups][Free space] | [100GB DB & etc Backups][1TB VM Backups][Free space] | ||
===Database Cluster=== | ===Database Cluster=== | ||
Each cube in the collective is part of our SQL database cluster we use mariadb and galera.<br/> | Each cube in the collective is part of our SQL database cluster we use mariadb and galera.<br/> | ||
VM's running on a host connect directly to the host node of the cluster. | VM's running on a host connect directly to the host node of the cluster. | ||
=Unimatrix= | =Unimatrix= | ||
Unimatrix is a HP Borg ProLiant MicroServer N40L<br/> | Unimatrix is a HP Borg ProLiant MicroServer N40L<br/> | ||
Original destined to be a direct replacement for [[Holly]] but was setup with VMware ESXi giving us the option to run multiple VM's<br/> | Original destined to be a direct replacement for [[Holly]] but was setup with VMware ESXi giving us the option to run multiple VM's<br/> | ||
As an ESXi host Unimatrix (then called Collective) ran all the hackspace | As an ESXi host Unimatrix (then called Collective) ran all the hackspace VMs, until September 2016 with the addition of the two new cubes all the VM where migrated to Debian + KVM | ||
Unimatrix is now installed with Debian | Unimatrix is now installed with Debian and KVM<br/> | ||
The the following VM's are hosted | The the following VM's are hosted | ||
*Kryten | *<s>Kryten</s> | ||
*Holly | *[[Holly]] | ||
* | *[[Gibson]] | ||
=Locutus= | =Locutus= | ||
Installed with Debian | Installed with Debian and KVM<br/> | ||
The the following VM's are hosted | The the following VM's are hosted | ||
* | *[[JARVIS]] | ||
* | *[[Rommie]] | ||
* | *<s>Ziggy</s> | ||
=Queen= | =Queen= | ||
Installed with Debian | Installed with Debian and KVM<br/> | ||
Queen does not currently host any VM but looks after the database and VM backups for the collective | Queen does not currently host any VM but looks after the database and VM backups for the collective. More recently Queen also host multiple docker based services. | ||
[[Category:Network]] | [[Category:Network]] | ||
Latest revision as of 13:55, 5 December 2025
The Borg
We are the Borg. Lower your shields and surrender your ships. We will add your biological and technological distinctiveness to our own. Your culture will adapt to service us. Resistance is futile.
The hackspace infrastructure is now run on small Borg collective of 3 HP Borg ProLiant MicroServer N40L, it started as just one server collective but we have since added two more identical machines to the group.
All three have identical base spec but different drive setups, Unimatrix and Locutus have two 1TB HDD's as a RAID 1, Queen has a 250GB SSD (OS), two extra 4TB HDD's (RAID 1) for backup storage and two extra 2TB HDD's (RAID 1) for data storage (docker / grafana).
Spec
- AMD Turion II Neo N40L 1.5GHz Dual-Core CPU
- 2x8GB DDR3 ECC UDIMM
- Four Internal SATA Cold Plug Hard-Drive's Bays
- Embedded RAID 0/1
- 1x Gigabit Ethernet
- 150W PSU
- 1 x HP NC360T dual port gigabit network card
Interconnection
Each cube is fitted with a HP NC360T dual port gigabit network card. These extra ports are used to create direct network links to the other cubes in the collective
HDD replication
The direct link between Unimatrix and Locutus is used to do block level HDD replication and keeps this traffic off out main networks
Unimatrix and Locutus each have two 200GB partitions for the VM storage. There primary store and there opposites backup store.
The primary store is mounted read write and holds the VMs that cube runs.
- Unimatrix
[50GB Host OS][200GB Primary][200GB Locutus replication][200GBB Jarvis homes replication]
- Locutus
[50GB Host OS][200GB Primary][200GB Unimatrix replication][200GBB Jarvis homes replication]
Backups
Queen handles the backups for the collective cubes, using the direct connections to Unimatrix and Locutus to keep the backup traffic off the main network. It's 2TB HDD are configure in a software RAID 1 array and using the following LVM partition layout
[100GB DB & etc Backups][1TB VM Backups][Free space]
Database Cluster
Each cube in the collective is part of our SQL database cluster we use mariadb and galera.
VM's running on a host connect directly to the host node of the cluster.
Unimatrix
Unimatrix is a HP Borg ProLiant MicroServer N40L
Original destined to be a direct replacement for Holly but was setup with VMware ESXi giving us the option to run multiple VM's
As an ESXi host Unimatrix (then called Collective) ran all the hackspace VMs, until September 2016 with the addition of the two new cubes all the VM where migrated to Debian + KVM
Unimatrix is now installed with Debian and KVM
The the following VM's are hosted
Locutus
Installed with Debian and KVM
The the following VM's are hosted
Queen
Installed with Debian and KVM
Queen does not currently host any VM but looks after the database and VM backups for the collective. More recently Queen also host multiple docker based services.