Infrastructure configs and automation for Kosmos servers
Go to file
Râu Cao 03fa49ed0c
Remove unused import
2023-01-17 17:15:16 +08:00
.chef Whitelist Chef attributes for newer client versions 2022-10-21 10:46:16 +02:00
clients Deploy second dirsrv supplier 2022-11-26 16:47:55 +01:00
cookbooks Set up fail2ban for nginx, move IPFS gateway to proxy role 2022-11-24 14:02:43 +01:00
data_bags Finish up Garage S3 config for kosmos.social 2023-01-14 15:59:47 +08:00
doc Add basic Garage doc 2022-11-25 10:56:22 +00:00
environments Set up libretranslate for kosmos.social 2023-01-17 17:12:22 +08:00
nodes Set up libretranslate for kosmos.social 2023-01-17 17:12:22 +08:00
roles Set up libretranslate for kosmos.social 2023-01-17 17:12:22 +08:00
scripts Merge pull request 'Add script for notifying Kosmos channels from Ruby' (#279) from feature/notify_xmpp_from_ruby into master 2021-01-25 10:59:05 +00:00
site-cookbooks Remove unused import 2023-01-17 17:15:16 +08:00
.gitignore WIP RSK cookbook 2021-06-13 16:58:53 +02:00
.gitmodules Use our own fork of the postgresql cookbook 2020-06-07 12:29:34 +02:00
.ruby-version Use chef-workstation Ruby with rbenv 2021-05-28 14:40:02 +02:00
Berksfile Set up fail2ban for nginx, move IPFS gateway to proxy role 2022-11-24 14:02:43 +01:00
Berksfile.lock Set up fail2ban for nginx, move IPFS gateway to proxy role 2022-11-24 14:02:43 +01:00
Gemfile Upgrade knife-zero for Ruby 3.0 2022-02-02 17:31:13 -06:00
Gemfile.lock Upgrade knife-zero for Ruby 3.0 2022-02-02 17:31:13 -06:00
README.md Update README 2023-01-05 17:14:46 +08:00
Vagrantfile Finish multi-VM config 2022-05-24 12:46:37 +02:00

README.md

This repository contains all infrastructure automation code that we use to set up and configure servers, virtual machines, and applications for Kosmos hosted services.

Chef cookbooks are written in Ruby, and based on Chef Infra resources. Some cookbooks contain integration test suites based on Test Kitchen.

Note: Manual configuration of servers and applications is highly discouraged, and can be overwritten or lost without notice!

Setup

Install Chef Workstation

rbenv

If you use rbenv to manage Ruby versions on your system, install the rbenv-chef-workstation plugin.

Install gem dependencies

Clone this repository, cd into it, and run:

bundle install

Common tasks

Bootstrap a new host server

knife zero bootstrap root@server-name.kosmos.org --run-list "role[base],role[kvm_host]" --secret-file .chef/encrypted_data_bag_secret

Bootstrap a new VM

knife zero bootstrap ubuntu@zerotier-ip-address -x ubuntu --sudo --run-list "role[base],role[kvm_guest]" --secret-file .chef/encrypted_data_bag_secret

Run Chef Zero on a host server

knife zero converge -p2222 name:server-name.kosmos.org

Run Chef Zero on a VM

knife zero converge -a knife_zero.host name:vm-name-23

Update Chef Client on a server:

knife zero converge name:dev.kosmos.org --client-version 15.3.14

Managing cookbooks

Cookbooks are managed via Berkshelf. Run berks --help for command help.

Install cookbooks listed in Berksfile:

berks install

Vendor installed cookbooks to the cookbooks/ dir:

berks vendor cookbooks/ --delete

"Expired" TLS certificates

If you encounter expired TLS certificates during a Chef run (e.g. for remote files), the issue is likely that the certificate has been issued by Let's Encrypt and Chef is still using its own, outdated CA cert store (see here for example).

As a hotfix, you can manually remove the "DST Root CA X3" cert from /opt/chef/embedded/ssl/cert.pem on the machine you're trying to converge.