Commit Graph

281 Commits

Author SHA1 Message Date
Garret Alfert 88f2dceb27 Use single letters for Redis metadata keys
Saves 16 characters per document object and 10
characters per directory object
2016-03-02 15:00:33 +01:00
Garret Alfert 650da91a1d Shorten Redis metadata keys
Use rsm:<username>:<dir>:i instead of
rs_meta:<username>:<dir>:items
2016-03-02 14:43:28 +01:00
Garret Alfert 067f4a1553 Use shorter Redis key for dir backend config
rsc:db:username instead of rs_config:dir_backend:username
2016-03-02 14:33:48 +01:00
Garret Alfert ff25b40385 Save last modified timestamp for objects as well 2016-03-02 14:05:53 +01:00
Garret Alfert 19f6fcd068 Use actual Last-Modified time we get from Swift 2016-03-02 14:00:59 +01:00
Garret Alfert d18de83893 Strip trailing whitespace from Swift token 2016-03-02 13:59:44 +01:00
Garret Alfert f1f450cc72 Don't add double trailing slash to container URL
The directory name already contains a trailing slash.
2016-03-01 22:57:54 +01:00
Greg Karékinian 7107c77a3f Turn Redis parameters into symbols 2016-03-01 15:06:23 +01:00
Garret Alfert 41074e35b3 Log usernames for failed migration to separate file
This way they can be easily retried later on.
2016-02-29 15:35:37 +01:00
Garret Alfert 33731f793a Set dry_run via environment variable
Can be enabled via `DRYRUN=true`
2016-02-24 19:07:26 +01:00
Garret Alfert 3b391246ed Use proper logger for migration script 2016-02-24 19:07:15 +01:00
Garret Alfert 570e3dcdb5 Set directory backend type during migration 2016-02-24 19:06:48 +01:00
Garret Alfert 54176b6928 Use data directly from Swift for metadata migration 2016-02-22 16:22:38 +01:00
Garret Alfert 5370df9c75 Basic migration script using actual RS dir listings 2016-02-15 15:15:01 +01:00
Greg Karékinian 0e10f3b6ff Change the way to load the Redis config to allow clusters 2016-02-02 22:20:38 +00:00
Garret Alfert c730333143 Don't try to do put or delete requests to root dir in order to update etag 2016-02-02 18:07:12 +01:00
galfert 902917d3ad Merge pull request #72 from 5apps/redis_metadata_storage
Redis metadata storage
2016-02-02 14:35:49 +01:00
Garret Alfert d7a71d039f Comment out the Riak settings from example config 2016-02-02 01:04:49 +01:00
Garret Alfert 2516e9090e Make Travis only run Swift specs for now 2016-02-02 00:57:53 +01:00
Garret Alfert 2e6ad907ef Merge branch 'master' into redis_metadata_storage 2016-02-02 00:36:30 +01:00
Garret Alfert 954f046dd9 Make Travis install Redis 2016-02-02 00:19:15 +01:00
Garret Alfert 536df23336 Make Travis create a Swift token file 2016-02-02 00:10:47 +01:00
Garret Alfert 409628c9e7 Trying to fix specs when run on Travis 2016-02-01 18:04:35 +01:00
Garret Alfert 9ba85446ef Use parentheses to fix syntax warnings 2016-02-01 15:00:39 +01:00
Garret Alfert 7084a50d1b Make dir_empty? method use Redis metadata 2016-01-29 16:45:17 +01:00
Garret Alfert 573dadf365 Respond with 503 when directory backend is locked 2016-01-29 16:18:49 +01:00
Garret Alfert a4673e9661 Use directory backend config from redis instead of config file 2016-01-29 16:18:09 +01:00
Garret Alfert 16dcc56fba No need to stub has_name_collision? anymore 2016-01-29 15:16:24 +01:00
Garret Alfert 4ca67c7ea9 Do collision detection via Redis metadata 2016-01-28 19:15:50 +01:00
Garret Alfert 4e7c8f68bb Add missing arguments to method call 2016-01-28 17:48:20 +01:00
Garret Alfert d973771192 Remove some duplication 2016-01-26 20:33:43 +01:00
Garret Alfert 0745354b8a Retrieve directory listing from Redis via Lua 2016-01-26 20:32:29 +01:00
Garret Alfert 737be34e73 Configure the source of dir listing (redis or swift) 2016-01-26 20:21:45 +01:00
Garret Alfert 15196ca4b9 Check IF_NONE_MATCH header for directory listings 2016-01-23 14:29:37 -05:00
Garret Alfert bec9f7a6cc Set ETag header for directory listings 2016-01-23 14:29:18 -05:00
Garret Alfert c676c1a6a8 Add metadata entry for root directory 2016-01-23 14:28:14 -05:00
Garret Alfert 599865cf3f Generate directory listing from Redis metadata 2016-01-23 13:26:38 -05:00
Garret Alfert dfc8a59096 Fix redis keys and content for nested directories 2016-01-23 13:20:42 -05:00
Garret Alfert f73c286ce9 Purge all keys from redis before every test run 2016-01-23 12:34:08 -05:00
Greg Karékinian 7d5bd3a624 Fix .travis.yml file 2016-01-22 23:01:33 +00:00
Greg Karékinian 9fe03498ea Force legacy Blue Box build for now on Travis 2016-01-22 23:00:13 +00:00
Garret Alfert 25c170021e Delete metadata from Redis when deleting objects 2016-01-22 16:04:28 -05:00
Garret Alfert 02e5d0b5ab Fix relative path in riak specs 2016-01-22 14:49:57 -05:00
Garret Alfert 972378e67f Don't care for order of array when comparing 2016-01-22 14:46:41 -05:00
Garret Alfert 189d04af25 Save list of directory items in redis 2016-01-20 17:27:00 -05:00
Greg Karékinian d1651799cf Revert "Add riak service to Travis CI"
This reverts commit d0dd4af3d9.
2016-01-20 21:40:28 +00:00
Greg Karékinian d8ba27cb63 Back to precise builds on Travis 2016-01-20 21:00:42 +00:00
Garret Alfert cd2c0865e8 Save directory metadata in redis (WIP) 2016-01-20 15:53:22 -05:00
Garret Alfert 990ea9cf28 Save object metadata in redis 2016-01-20 15:33:35 -05:00
Garret Alfert 77bd54b009 Move old specs into riak subdir 2016-01-20 15:32:44 -05:00