Set up Redis VM, upgrade all cookbooks for Chef 18, major cleanup #496

2023-06-19T14:07:25Z

greg commented

2023-06-19 14:07:25 +00:00

This replaces the deprecated redis cookbook. Compiles the latest version of Redis, currently 7.0.11. Running on redis-1. (The database is empty right now, there's no dump to check the backup functionality. It's more convenient to check that after we have data.)

The new redisio cookbook required upgrading to Chef client 16+, so we did a general upgrade of all code to be compatible with 18.x (latest stable). #500 will be a follow-up to complete the Chef 18 upgrades on the actual hosts.

Done in this PR:

Set up Redis VM
Upgrade all existing VMs with Redis to latest version of the redisio cookbook and Chef client 18.x
Refactor all cookbooks using poise dependencies (application, application-ruby, application-javascript, etc.) with vanilla Chef resources, deploy on the various VMs and upgrade them to Chef 18
Remove all obsolete and unused cookbooks
Various other cleanups

Refs #488, #500

This replaces the deprecated redis cookbook. Compiles the latest version of Redis, currently 7.0.11. Running on redis-1. (The database is empty right now, there's no dump to check the backup functionality. It's more convenient to check that after we have data.) The new redisio cookbook required upgrading to Chef client 16+, so we did a general upgrade of all code to be compatible with 18.x (latest stable). #500 will be a follow-up to complete the Chef 18 upgrades on the actual hosts. Done in this PR: * Set up Redis VM * Upgrade all existing VMs with Redis to latest version of the redisio cookbook and Chef client 18.x * Refactor all cookbooks using poise dependencies (application, application-ruby, application-javascript, etc.) with vanilla Chef resources, deploy on the various VMs and upgrade them to Chef 18 * Remove all obsolete and unused cookbooks * Various other cleanups Refs #488, #500

greg added the kredits-2 feature labels 2023-06-19 14:07:25 +00:00

greg self-assigned this 2023-06-19 14:07:26 +00:00

greg added 1 commit 2023-06-19 14:07:26 +00:00

Set up Redis using the latest version of redisio 6116729907

This replaces the deprecated redis cookbook. Compiles the latest version
of Redis, currently 7.0.11

Refs #488

greg added 2 commits 2023-06-19 14:09:33 +00:00

Merge branch 'master' into feature/488-redis_server 44e23ffa1f

Add redis_server role to redis-1 3fb89517ab

greg requested review from raucao 2023-06-19 14:10:52 +00:00

greg added 1 commit 2023-06-19 14:13:28 +00:00

Add missing Berksfile changes 76a952dbac

greg commented

2023-06-20 12:36:36 +00:00

I forgot to add the firewall rule to only allow connections to Redis from Zerotier, doing that in a bit. Marking as WIP

greg marked the pull request as work in progress 2023-06-20 12:36:43 +00:00

greg added 1 commit 2023-06-20 13:19:56 +00:00

Add firewall rule to allow access to Redis on Zerotier network b19fca6e7c

greg marked the pull request as ready for review 2023-06-20 13:20:08 +00:00

raucao reviewed 2023-06-20 13:28:30 +00:00

Berksfile Outdated

						
				@@ -8,4 +8,0 @@

				cookbook 'redis',

				  git: 'https://github.com/phlipper/chef-redis.git',

				  ref: 'v0.5.6'

				cookbook 'redisio',                '= 5.0.0' # TODO upgrade to 6.x when we use Chef 16

raucao commented

2023-06-19 16:08:50 +00:00

Are we actually using Chef 16 now on all machines that need Redis? If not, this would break Chef runs...

greg commented

2023-06-20 19:31:12 +00:00

I just checked the node files. We do need to update Chef on the following machines, they're on Chef 15 and used an older version of the redisio cookbook

akkounts-1
bitcoin-2
mastodon-3
nodejs-4

I'll take care of that ~~tomorrow~~ on Friday

I just checked the node files. We do need to update Chef on the following machines, they're on Chef 15 and used an older version of the redisio cookbook * akkounts-1 * bitcoin-2 * mastodon-3 * nodejs-4 I'll take care of that ~~tomorrow~~ on Friday

👍 1

greg marked this conversation as resolved

greg added 1 commit 2023-06-28 12:15:48 +00:00

Merge branch 'master' into feature/488-redis_server d1a4e4cbc5

raucao added 3 commits 2023-06-28 12:29:42 +00:00

Add primary domain config for akkounts bcbee255f1

Configure remaining options for akkounts 01977e088a

And refactor attributes/variables to use the various service cookbook's
own attributes.

Merge pull request 'Configure all new and remaining options for akkounts' (#498 ) from chore/akkounts_config into feature/488-redis_server 0506b75115

Reviewed-on: #498

greg added 11 commits 2023-06-28 16:55:42 +00:00

Deploy akkounts without the application_git cookbook b9cf396d42

Use the built-in git resource from Chef instead. poise/application does
not work on modern Chef.

Update chef-sugar to fix a conflict in Chef 16+ ddeebc739d

Override the attributes in attributes, not the default recipe 0564165e81

Install the latest backup gem 88caae26e4

It added a few dev dependencies, install them

Remove unused lndhub recipe 9378df23db

Deploy RTL without the deprecated application cookbook 57fdf0723f

Deploy mastodon without the application cookbooks 3cf9c3868b

Replace application cookbook with git resource 3a5a038f7e

Replace application cookbook with git resource 54098a450c

Replace application cookbook with git resource b7d17c1ad7

Update Chef on these servers d7bc5e6f08

raucao was assigned by greg

2023-06-28 16:55:55 +00:00

greg added 1 commit 2023-06-28 17:00:08 +00:00

Get rid of the application and poise cookbooks 05834b6013

greg added 6 commits 2023-06-29 15:06:29 +00:00

Get rid of the build-essential cookbook 916ae8094c

The build_essential resource has been part of Chef since 14.0

Update the firewall cookbook to the latest version 68ce3c4834

This gives us comments from the named resources

Update the elasticsearch cookbook 7683de09a2

Get rid of the chef-sugar dependency 462bdabf01

It's now deprecated

Get rid of compat_resource and mariadb 1f29d8a01a

Remove deleted servers b550c1b79e

greg added 1 commit 2023-06-29 15:17:18 +00:00

Remove old server 2637d755af

greg was unassigned by raucao

2023-06-29 15:41:09 +00:00

raucao removed their assignment 2023-06-29 15:41:09 +00:00

raucao added kredits-3 and removed kredits-2 labels 2023-06-30 11:59:28 +00:00

greg changed title from ~~Set up Redis using the latest version of redisio~~ to Set up Redis using the latest version of redisio & general cookbooks update and cleanup

2023-07-01 09:30:28 +00:00

raucao changed title from ~~Set up Redis using the latest version of redisio & general cookbooks update and cleanup~~ to Set up Redis VM, upgrade all cookbooks for Chef 18, major cleanup

2023-07-01 12:14:14 +00:00

raucao approved these changes 2023-07-01 12:22:25 +00:00

raucao merged commit 8072fafa46 into master

2023-07-01 12:22:39 +00:00

raucao deleted branch feature/488-redis_server

2023-07-01 12:22:39 +00:00

raucao referenced this issue from a commit

2023-07-01 12:22:40 +00:00

Merge pull request 'Set up Redis VM, upgrade all cookbooks for Chef 18, major cleanup' (#496) from feature/488-redis_server into master

Sign in to join this conversation.

2 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: kosmos/chef#496