kosmos/chef
8
3
Fork 0
Code Issues 38 Pull Requests 2 Projects 2 Activity
1,525 Commits 9 Branches 0 Tags
1a7fd5ac657beea05bd57f15cc92b3488959d40d
Commit Graph
90 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Râu Cao 3933e4c310 Fix endpoint URL 2023-01-17 15:36:42 +08:00
Râu Cao f777af22b8 Finish up Garage S3 config for kosmos.social 2023-01-14 15:59:47 +08:00
Râu Cao 345ba14f0e Add garage S3 config for Mastodon 2023-01-14 15:03:38 +08:00
Râu Cao 89865bcd2a Allow send_message endpoint from akkounts 2023-01-12 15:37:08 +08:00
Râu Cao 62d1a86555 Configure Webhook URL for lndhub.go 2023-01-12 15:37:04 +08:00
Râu Cao 2eb0544ea9 Update README 2023-01-05 17:14:46 +08:00
Râu Cao e54112418e Upgrade Gitea 1.18.0 
Requires some config changes for the mailer.
 2022-12-30 23:05:40 +07:00
Râu Cao 176dd64438 Remove peerswap policy file from recipe 
This will be auto-created anyway, and we don't want to overwrite changes
added by the CLI.
 2022-12-26 11:29:17 +07:00
Râu Cao 4f1b1aff30 Set up PeerSwap 
Allows to swap sats in and out of Lightning channels without a 3rd party
(and their fees). Instead, swaps can be initiated directly with the
channel peer.

https://www.peerswap.dev/
 2022-12-26 11:16:22 +07:00
Râu Cao b3465e186f Fix comment 2022-12-26 11:16:01 +07:00
Râu Cao ea635a52e9 Formatting 2022-12-26 11:14:40 +07:00
Râu Cao 90e17b0abc Rename bitcoind recipe 
Was still using a name from when the cookbook didn't set up anything
else
 2022-12-25 16:28:14 +07:00
Râu Cao 8c8e978ae9 Update node configs 2022-12-24 00:58:31 +07:00
Râu Cao 3d7b4df376 Add rate limit config for lndhub-go 2022-12-24 00:58:11 +07:00
Râu Cao b738dc1e80 Add nginx proxy hosts for Garage Web access 
The respective bucket needs to be configured with a domain alias. When a
new alias is added to the `s3_web_domains` config, a new nginx site can
then be deployed to the `nginx_proxy` hosts.
 2022-12-23 18:07:39 +07:00
Râu Cao 3641ea7a60 Deploy lndhub.go branch of akkounts 2022-12-23 18:02:42 +07:00
Râu Cao a7e04f4e63 Exclude lndhub backups in dev 2022-12-23 14:17:43 +07:00
Râu Cao e0c400c007 Use correct asset URL for lndhub logo 2022-12-22 20:03:58 +07:00
Râu Cao 7802ea25e6 Ignore chef environment when looking up primary 
We use mixed environments still, not everything is in "production" yet.
 2022-12-22 19:45:45 +07:00
Râu Cao fb1206d03f Refactor bitcoin-related roles and node config 2022-12-22 19:35:41 +07:00
Râu Cao 379a503dd0 Move lndhub nginx site to proxy 
And configure for lndhub-go. Also configure branding for public lndhub
dashboard
 2022-12-22 19:35:30 +07:00
Râu Cao 7d11450c4e Set up lndhub.go 
closes #454
 2022-12-11 14:30:27 +01:00
Râu Cao a460302728 Add missing sidekiq queue 2022-12-01 17:08:17 +01:00
Râu Cao 2ecb4e2385 Upgrade Ruby to 3.0.4 2022-12-01 15:29:38 +01:00
Râu Cao cdd3f026c4 Always use config for skipping post-deployment migrations 2022-12-01 15:05:24 +01:00
Râu Cao 5d05d5c187 Move Mastodon nginx to proxy/LB 2022-11-30 12:07:54 +01:00
Râu Cao f3ca307e64 Fix Tor access 
Configure alternate_domains for Rails app to re-enable Tor access (was
throwing 403s without this config)
 2022-11-30 12:06:25 +01:00
Râu Cao 66f5217a41 Refactor Mastodon nginx recipe for proxy usage 
Works both as local deployment and proxy (via roles and environments)

* Use upstreams for proxy_pass
* Access static assets from proxy, configure caching for them
* Move Tor config to environment, install via role
* ...
 2022-11-30 12:02:17 +01:00
Râu Cao 83e55c84a2 Use domain name for log file paths 2022-11-30 12:00:01 +01:00
Râu Cao 83513dbd9d Remove request limits for ipfs proxy 
In favor of fail2ban
 2022-11-30 11:58:22 +01:00
Râu Cao c4d43b7f4e Make Mastodon services listen on private IP in prod 
And allow access to them from the private network
 2022-11-30 11:57:51 +01:00
Râu Cao c3e98688fd Deploy second dirsrv supplier 
Manually configured (once) to replicate data from and to the first
supplier on `ldap-3`.
 2022-11-26 16:47:55 +01:00
Râu Cao 2958ba4b81 Use *.kosmos.local hostnames for LDAP nodes 2022-11-26 16:47:28 +01:00
Râu Cao 991458208d Use a role for configuring LDAP hostname on clients 
This way it's also easy to converge all LDAP clients at once.
 2022-11-26 16:45:45 +01:00
Râu Cao 8d4db7290e Rename dirsrv_primary role 
The term used in 389 docs is "supplier" instead (ex "master")
 2022-11-26 16:44:05 +01:00
Râu Cao e0fb84e56c Store Gitea data (avatars, attachments, etc.) in Garage/S3 
Also adds a new garage gateway role, which only allows RPC (inter-node)
traffic to Garage.
 2022-11-26 13:05:07 +01:00
Râu CaoandGitea 9a89af0fe3 Add basic Garage doc 2022-11-25 10:56:22 +00:00
Râu CaoandGitea 20e6bdb7f9 Add production environment, replication for garage 
Also deploy a third node in a different data center
 2022-11-25 10:56:22 +00:00
Râu CaoandGitea b5ff60214c Install/configure Garage 
Add a garage cookbook that installs the garage binary distribution and
creates the necessary configuration and system service.

Also deploy two new VMs to act as storage nodes.

refs #428
 2022-11-25 10:56:22 +00:00
Râu Cao d06f5d7723 Set up fail2ban for nginx, move IPFS gateway to proxy role 2022-11-24 14:02:43 +01:00
Râu Cao 7f545404b1 Update node info 2022-11-22 21:23:39 +01:00
Râu Cao 4188b2976b Use Ruby 3.0.3, skip post-deployment migrations 2022-11-07 14:53:52 +01:00
Râu Cao 3620a43190 Upgrade Elasticsearch from 6.x to latest 7.x 2022-11-06 13:56:15 +01:00
Râu Cao 28454c0849 Change VM backup schedule for draco 2022-11-05 17:43:53 +01:00
Râu Cao 6df168f32f Prune VM backups after every run 2022-11-05 17:43:48 +01:00
Râu Cao 65933bef4b Move hubot nginx sites to proxy role, deploy to fornax 2022-11-04 14:41:21 +01:00
Râu Cao 6cce1d9df8 Upgrade hal8000 setup for new hubot-kredits 2022-11-04 14:41:12 +01:00
Râu Cao 534f23eebc Remove obsolete recipes 2022-11-04 14:38:51 +01:00
Râu Cao 37710be28b Bundle main IPFS node recipes in a role 
So we can find the VM/IP
 2022-11-04 14:37:23 +01:00
Râu Cao 76fd629e40 Deploy new kredits ipfs-pinner 
refs kredits/meta#10
 2022-11-03 14:16:37 +01:00
Râu Cao 0297298ce0 Upgrade LND to 0.15.4 
Fixes a critical issue that prevents block sync in production
 2022-11-03 11:02:52 +01:00
Râu Cao 90b62e3fc1 Remove ufw logging for ipfs 2022-11-02 19:27:09 +01:00
Râu Cao b1922d26f6 Allow IPFS connections on private network 
(HAProxy is now also using the private network.)

This fixes IPFS connections to Kosmos nodes from outside the network, as
well as in between nodes on the private network.
 2022-11-02 14:06:07 +01:00
Râu Cao f7ff1248fe Enable Web UI on private network 2022-11-02 14:05:43 +01:00
Râu Cao bc11301782 Move bitcoind datadir from host to VM storage 2022-10-27 11:52:05 +02:00
Râu Cao 756382ec9f Move block data files to CIFS share 
This is the vast majority of disk space used on the host currently.
 2022-10-26 15:49:03 +02:00
Râu Cao 458558fb26 Deploy different content on kosmos.org for now 2022-10-24 15:13:18 +02:00
Râu Cao 67f6e1b34a Downgrade go-ipfs to 0.15 
Fixes #435
 2022-10-24 14:18:19 +02:00
Râu Cao 58e6e7de03 Remove ufw logs 
Just added them to check the blocking for a while
 2022-10-22 13:03:16 +02:00
Râu Cao 1afc3a5de5 Block outgoing traffic to local networks by default 
Some software, e.g. go-ipfs, is rather aggressive in scanning local
networks for peers, which can trigger abuse reports and IP locks in the
data center.
 2022-10-21 13:37:38 +02:00
Râu Cao 61710aa4a4 Set up systemd service and timer for backups 2022-10-21 10:50:04 +02:00
Râu Cao 95941c830f Remove verbose stats outout from backup script 2022-10-21 10:49:30 +02:00
Râu Cao a5b2eb5f97 Move borg credentials to a separate file 
To be used from a service
 2022-10-21 10:49:02 +02:00
Râu Cao 374654f8fd Update chef/ohai on hosts 2022-10-21 10:47:46 +02:00
Râu Cao 7051cc9da8 Update draco's main IP address 2022-10-21 10:47:17 +02:00
Râu Cao 51163ca3a3 Whitelist Chef attributes for newer client versions 2022-10-21 10:46:16 +02:00
Râu Cao 927bb63535 Add kvm_guest role to nodes 2022-10-19 16:28:07 +02:00
Râu Cao 34a57fa298 Merge branch 'lnd_tor_changes' into feature/qemu_snapshots 2022-10-19 15:23:39 +02:00
Râu Cao 6d765f959d Fix backup VM name for ldap-3 
(and potentially other guests where the name differs from the libvirt
domain name)
 2022-10-19 12:51:46 +02:00
Râu Cao 82f50b0caa Only back up domain-specific XML per archive 2022-10-19 12:24:10 +02:00
Râu Cao 6c8f9055c1 Create directories for KVM host backup files 2022-10-19 12:23:54 +02:00
Râu Cao 2e2ebbcc02 Fix filenames for guest agent sockets 2022-10-19 12:23:17 +02:00
Râu Cao a3844b7ef6 WIP Add KVM host backup recipe 
Add a recipe that configures scripts for live backups of VM images via
libvirt and borg.
 2022-10-19 12:08:05 +02:00
Râu Cao 6d50a32aca Add FIXME note 2022-10-19 12:08:05 +02:00
Râu Cao 7848b4d365 Add jitsi-meet-1 VM 2022-10-19 12:08:04 +02:00
Râu Cao 063e9e070c Add borg credentials 2022-10-19 12:08:04 +02:00
Râu Cao b78e6685ed Add kvm_guest role to VMs on fornax 2022-10-19 12:07:56 +02:00
Râu Cao 895d293899 Update RSKj version 2022-10-18 18:46:53 +02:00
Râu Cao 315cd247e5 Enable qemu-guest-agent after install 
This is actually automatically done for the service from the apt
package, but I like specifying it explicitly as well.
 2022-10-12 15:55:08 +02:00
Râu Cao e73b8fb01f Add guest agent device when creating VMs 
This is necessary for qemu-guest-agent to actually work
 2022-10-12 15:53:00 +02:00
Râu Cao e90b265f7e Remove superfluous license headers 2022-10-10 15:29:17 +02:00
Râu Cao bec54e6ffb Upgrade LND, bitcoind 
LND needs an emergency hotfix, released in 0.15.2, due to a subtle
Taproot transaction parsing limitation in a library it depends on.
 2022-10-10 13:46:12 +02:00
Râu Cao ff907384d9 Upgrade Gitea to 1.17.2 2022-09-21 11:32:20 +02:00
Râu Cao 80c3e4e270 Create ldap-3 VM 2022-08-22 13:40:26 +01:00
Râu Cao f17a420a64 Update VM base image 2022-08-22 13:40:07 +01:00
Râu Cao 65adc84e5b Upgrade Gitea to 1.17.0 
Also adds a new Nginx directive to allow larger uploads to the Docker
registry endpoints.

closes #422
 2022-08-09 11:58:56 +02:00
Râu Cao 37b948cbe5 Remove custom cron job 
refs #395
 2022-08-08 12:57:30 +02:00
Râu Cao 08b7c7a5ac Enable cron job to delete repo archives 
closes #395
 2022-08-08 12:51:26 +02:00
Râu Cao 206bb69100 Update node info 2022-07-31 13:05:59 +02:00
Râu Cao 41d4f87710 Move Zerotier controller 
It's running on fornax now, and the VMs have been deleted. This way,
there's no internal routing needed for it to be publicly accessible by
any network member nodes.
 2022-07-28 15:38:42 +02:00