kosmos/chef
8
3
Fork 0
Code Issues 38 Pull Requests 1 Projects 2 Activity
2,143 Commits 8 Branches 0 Tags
ae14a1f35372b8ac7696fc082eb4dcc27b043556
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
raucao b700baac37 Configure alerts for disk/filesystem usage, memory, CPU 2026-07-09 14:04:27 +02:00
raucao 6f93820936 Update node configs 2026-07-07 16:58:36 +02:00
raucao 9fca5386f3 Increase padding for NodeDown rule 2026-07-07 16:57:22 +02:00
raucao b6ba5ba679 Update node configs 2026-07-07 15:20:48 +02:00
raucao 4976888358 Remove unnecessary include 2026-07-07 15:20:33 +02:00
raucao e4ad52d413 Update dirsrv node configs 2026-07-07 15:05:25 +02:00
raucao 94a3c41964 Show severity for new alerts, number of firing vs resolved 2026-07-07 14:26:21 +02:00
raucao 704d0bca0e Document upgrading Chef client 2026-07-06 18:50:07 +02:00
raucao 02dc95b7de Update node configs 2026-07-06 18:47:51 +02:00
raucao 2a14837f64 WIP Add prometheus rules, improve alerts 2026-07-06 18:01:22 +02:00
raucao 1ae5210813 Send critical alerts via email (in addition to XMPP) 2026-07-06 14:52:17 +02:00
raucao 20f67d7261 Change prometheus scrape/eval intervals 2026-07-06 14:52:10 +02:00
raucao 4ce77e1a6e Fix postfix relay sending (on newer Ubuntu versions) 
Requires relay restrictions to be configured explicitly
 2026-07-06 14:50:49 +02:00
raucao 21513e6d10 Critical icon only for critical severity 2026-07-06 13:53:52 +02:00
raucao 33987402e3 Fix port attribute 2026-07-06 13:16:10 +02:00
raucao 81aae3d1bb Add icons to visualize alert severity 2026-07-06 12:38:07 +02:00
raucao 65c1933a99 WIP Add default alertmanager route and receiver 2026-07-06 12:38:07 +02:00
raucao c736468259 Merge branch 'master' into feature/prometheus_cookbook 2026-07-05 17:39:08 +02:00
raucao 6370069e9d Add new vm_host attribute/value to all VM nodes 2026-07-05 17:32:43 +02:00
raucao 0e9bcca72d Add vm_host label to prometheus targets 2026-07-05 17:32:14 +02:00
raucao c762dfe8c1 Merge pull request 'Sanitize node configs via script, and do it automatically in a Git hook' (#635) from dev/sanitize_node_configs into feature/prometheus_cookbook 
Reviewed-on: #635
 2026-07-05 15:26:30 +00:00
raucao 53cf95c4e7 Remove decommissioned nodes 2026-07-05 17:22:48 +02:00
raucao 959d506cfb Remove newline from all node files 
Was actually added by manually editing the files, but Chef writes them
without newline, so our sanitization script also does it that way
 2026-07-05 17:22:39 +02:00
raucao 8c71261fc9 Add pre-commit hook for sanitizing node configs 2026-07-05 17:22:34 +02:00
raucao 6c3da8a711 Add util script for sanitizing nodes 
Deletes the "override" and "default" properties, which may contain
sensitive data
 2026-07-05 17:22:26 +02:00
raucao 53de8ea119 Merge branch 'master' into feature/prometheus_cookbook 2026-07-05 17:20:48 +02:00
raucao 639800a838 Remove decommissioned node 2026-07-05 17:19:16 +02:00
raucao 1e2ff76797 Merge pull request 'Move allowed node attrs to config file, apply automatically' (#634) from dev/allowed_node_attrs into master 
Reviewed-on: #634
 2026-07-05 15:11:22 +00:00
raucao 301565b910 Move allowed node attrs to config file, apply automatically 
This moves the whitelist for nodes' "normal" attributes to a config
file, which is loaded live during every run and applied in memory in
case the node's local file hasn't been updated before the client run.

Fixes allowed attributes being overwritten/removed in the node info
JSON files.
 2026-07-05 17:07:56 +02:00
raucao 171db0fb7c Add altermanager section to prometheus config 2026-07-05 13:19:18 +02:00
raucao 821b56e6ab Set node name as prometheus instance name 
And DRY up the recipe so it's easy and expressive to add more
metrics/targets
 2026-07-05 12:41:46 +02:00
raucao e29d90d3d0 Use full domain as fqdn for leo 2026-07-05 12:40:50 +02:00
raucao f2ebda4a1a Update node configs 2026-07-04 16:30:15 +02:00
raucao 67f62ebd6c Scrape garage metrics 2026-07-04 16:14:36 +02:00
raucao 7dc4895da3 Remove old garage nodes 2026-07-04 15:51:39 +02:00
raucao 153b1e77c5 Add all nodes with base role as node exporter targets 2026-07-04 15:46:41 +02:00
raucao ea69c7cec6 Add prometheus node exporter to base role 2026-07-04 15:45:57 +02:00
raucao 5813a45987 Use base role instead of recipe in all runlists 2026-07-04 15:45:23 +02:00
raucao 63534e1cf5 Remove upstream prometheus cookbook, migrate to our own 2026-07-04 15:27:18 +02:00
raucao 2d835335b5 Re-add global config, change values 2026-07-04 14:15:55 +02:00
raucao e21797b402 Apply changed configs to prometheus and alertmanager 2026-07-04 14:15:38 +02:00
raucao 7396af5ca4 WIP Add node exporter 2026-07-04 14:15:33 +02:00
raucao df8c8d1742 Remove obsolete CLI option 
Was left over from trying to overwrite the defaults before
 2026-07-04 13:31:20 +02:00
raucao 3e6faf34c4 Use private IP for ejabber Tor proxy targets 2026-07-04 13:28:25 +02:00
raucao 13b61a3639 Remove node 2026-07-04 12:45:16 +02:00
raucao ec73dd5b57 Set Chef environment for node 2026-07-03 15:52:46 +02:00
raucao 850db344b7 Add prometheus node 2026-07-03 15:50:15 +02:00
raucao 99e8259696 Merge pull request 'Update Gitea to 1.26.4, Gitea Runner to 2.0.0' (#631) from chore/upgrade_gitea_and_runner into master 
Reviewed-on: #631
 2026-07-01 12:30:57 +00:00
raucao 96bab62af1 Merge pull request 'Set up Blossom server on blossom.kosmos.org' (#630) from feature/blossom_server into master 
Reviewed-on: #630
Reviewed-by: Greg <greg@kosmos.org>
 2026-05-26 12:49:54 +00:00
raucao 2169e7904c Add LDAP support for blossom-server 
Only available in our feature branch atm
 2026-05-19 16:32:03 +02:00
raucao 5a4905aa97 Upgrade deno 2026-05-14 07:52:45 +02:00
raucao 21e31440a7 Update node config 2026-05-14 07:52:12 +02:00
raucao 894ae3f77e Add new garage node 2026-05-14 07:51:53 +02:00
raucao 8afe2ad05d Update blossom whitelist 2026-05-14 07:51:23 +02:00
raucao ef6e4e3319 Upgrade blossom-server 2026-05-14 07:50:48 +02:00
raucao f8ce544452 Set up Blossom server on blossom.kosmos.org 2026-04-18 16:37:00 +04:00
raucao 2c2780a9f0 Update node info 2026-04-17 18:57:32 +04:00
raucao 6bcdd3f4d6 Upgrade .NET and BTCPay 2026-04-17 18:56:54 +04:00
raucao abc3f7a0cd Update node info 2026-04-17 15:47:10 +04:00
raucao 6d35c0a415 Update node info 2026-04-14 10:36:48 +04:00
raucao be0d7105d3 Merge pull request 'Migrate PostgreSQL cluster to PG14' (#625) from feature/postgresql_migration into master 
Reviewed-on: #625
Reviewed-by: Greg <greg@kosmos.org>
 2026-04-12 14:16:22 +00:00
raucao b24a6107d2 Merge branch 'master' into feature/postgresql_migration 2026-04-12 18:15:01 +04:00
raucao 1f7a1d0909 Remove commented lines 2026-04-12 16:11:40 +04:00
raucaoandgreg 29fb3ae9c9 Automatically determine OS package name 
Co-authored-by: Greg Karékinian <greg@karekinian.com>
 2026-04-12 10:32:53 +00:00
raucao 3a1c3e20b8 Add new RSK testnet VM 2026-04-12 10:32:53 +00:00
raucao d7782ba41e Upgrade rskj to v9.0.1 and Ubuntu 24.04 2026-04-12 10:32:53 +00:00
raucao a3be57afbc Fix default apt keyring dir not existing on older Ubuntu 
Recent Chef client versions use it
 2026-04-12 09:10:58 +04:00
raucao 22d459b558 Create new VMs with Ubuntu 24.04 2026-04-12 08:54:47 +04:00
raucao 5ed5af6d50 Use hardware clock sync on Ubuntu 24.04+ VMs 2026-04-12 08:53:50 +04:00
raucao aaed9a56d1 Slow down Gitea 404s to mess with scrapers/bots 
Seems to have helped quite a lot for dealing with AI scrapers using
up all available server resources
 2026-04-11 15:37:38 +04:00
raucao 41e6b29b97 Add AGENTS.md 2026-04-11 15:36:54 +04:00
raucao f0314e0b99 Update vendored cookbooks 2026-04-11 15:34:44 +04:00
raucao ac4fb0c9ca Fix Java/Homebrew cookbook resource failing with recent Chef 
Required by our Mastodon cookbook
 2026-04-11 15:23:30 +04:00
raucao d5e3d62522 Add new postgres cluster, remove old one 2026-04-11 15:22:34 +04:00
raucao 061880536b Fix akkounts systemd unit stop command 
Typo (not using pumactl), but we don't need to specify it to do the
right thing anyway. systemd can just send sigterm on its own.
 2026-04-11 14:56:15 +04:00
raucao 9de37cde96 Update doc 2026-04-11 14:55:32 +04:00
raucao 64d5d34d85 Update postgres roles 
Reset to normal/final
 2026-04-11 14:55:02 +04:00
raucao db9177c9c6 Improve RAM usage allowance 
Queries can spawn more processed and then use more RAM than
`shared_buffers`
 2026-04-11 14:53:28 +04:00
raucao c92f9157a5 Fix method undefined in heredoc 2026-04-11 14:52:53 +04:00
raucao a89db454d0 Improve postgres management scripts 2026-04-11 14:51:51 +04:00
raucao fddcd4899e Ignore default db for migration/management 2026-04-10 12:57:51 +04:00
raucao 8e11df4544 Update PG migration runbook 2026-04-10 12:49:28 +04:00
raucao 0020677ab2 Drone: Make database details configurable 2026-04-10 08:37:06 +04:00
raucao 09412f69e8 Move doc 2026-04-10 08:36:54 +04:00
raucao bc3f291bd2 WIP Prepare postgres for migration by replication 2026-04-10 08:25:55 +04:00
raucao 6583cd7010 Upgrade WAL config for PG14 2026-04-08 15:41:13 +04:00
raucao 290af8177a Refactor postgres server recipes/resource 2026-04-08 15:41:10 +04:00
raucao 2cb5540a7b Add new postgres replica (v12) 2026-04-07 16:56:01 +04:00
raucaoandgreg 002ad2ca62 Update Gandi API key 
Co-authored-by: Greg Karékinian <greg@karekinian.com>
 2026-04-07 16:53:43 +04:00
raucao 7710231fc4 Add CORS headers for Garage web access 
Fixes Discourse plugin JS usage
 2026-04-07 16:53:09 +04:00
raucao 01cdd000cb Update nodes 2026-03-27 14:30:46 +04:00
raucao ea8e2de70a Merge pull request 'Use Ubuntu 22.04 for new VMs' (#521) from jammy_jellyfish into master 
Reviewed-on: #521
 2026-03-27 10:28:22 +00:00
raucao 8ad3674c4d Install libvirt CLI on KVM hosts 2026-03-27 14:27:28 +04:00
raucao a23c7d536a Merge pull request 'Improve BTC price tracking script' (#624) from feature/btc_price_tracker into master 
Reviewed-on: #624
 2026-03-07 06:21:51 +00:00
raucao d492cd18cc Improve BTC price tracking script 
1. Robust API helper: Add make_request with retry logic for both
   GET (price data) and PUT (upload) requests
2. Arithmetic precision: Switch to awk for floating-point average
   calculation
3. Correct error handling: Updated get_price_data to return status
   codes and the main script to exit on failure
4. Safer JSON: Use jq to construct valid JSON payloads
5. Safety Flags: Add set -e/-o to fail fast on any command errors
 2026-03-06 23:20:12 +04:00
raucao 161b78be97 Configure Gitea commit signing with SSH key 2026-02-13 17:29:23 +04:00
raucao 6e83384da5 Use more attributes for Gitea config 2026-02-13 16:07:24 +04:00
raucao be8278fbdc Upgrade act_runner 2026-02-13 16:06:08 +04:00
raucao ff3f05452f Merge pull request 'Update Gitea to 1.25.4' (#622) from chore/upgrade_gitea into master 
Reviewed-on: #622
Reviewed-by: Râu Cao <raucao@kosmos.org>
 2026-02-13 10:18:36 +00:00
raucao e9dff82628 Merge pull request 'Add IPv6 support for all OpenResty sites' (#618) from feature/614-ipv6 into master 
Reviewed-on: #618
 2026-02-12 13:09:25 +00:00