352 Commits

Author SHA1 Message Date
Greg Karékinian
9386666610 Add a migration runner to be able to run the script on all users...
... on as many servers as we want

Set the migration key in platform for all users:

    User.storage_customer.each do |u|
      FiveAppsStore::Application.redis_remotestorage.hset(
        "rs:size_migration", u.username, "not_started"
      )
    end
2016-12-15 16:28:19 +01:00
Greg Karékinian
97a77e2a2c Remove unused test key passed to the eval command 2016-12-15 15:34:51 +01:00
Greg Karékinian
a7c5808593 Add a script to calculate a user's storage size from the metadata...
... And write it to Redis

Usage:

   ENVIRONMENT=development ./migrate_storage_size_from_metadata.rb username
2016-12-15 13:21:54 +01:00
e575398854 Merge pull request #97 from 5apps/feature/single_container_migration
Remove container migration checks and scripts
2016-09-12 12:26:09 +01:00
Garret Alfert
07533e139d Remove migration scripts 2016-09-12 12:32:31 +02:00
Garret Alfert
35abddc4ea Remove container migration checks 2016-09-12 11:49:23 +02:00
d81a4b8314 Merge pull request #96 from 5apps/feature/single_container_migration
Skip migration for users with too many files
2016-09-08 12:52:29 +02:00
Garret Alfert
08a2754936 Skip migration for users with too many files 2016-09-08 11:45:41 +02:00
9ca8a7d507 Merge pull request #95 from 5apps/feature/swift_migration
Swift migration for single shared container
2016-09-07 22:38:52 +02:00
Garret Alfert
41baecbf35 Use a MigrationRunner to iterate over all unmigrated users 2016-09-07 19:58:32 +02:00
Garret Alfert
74428408b1 Use new Redis migration hash in Liquor Cabinet itself 2016-09-07 18:13:52 +02:00
Garret Alfert
710657748b Use full dir listing instead of per subdir 2016-09-07 17:59:14 +02:00
Garret Alfert
685c82d068 Use Redis hash for storing migration state instead of one key per user 2016-09-07 17:05:27 +02:00
Garret Alfert
ad8a75a0ad Use COPY method instead of GET and PUT 2016-09-07 14:07:13 +02:00
Garret Alfert
90a6753d88 Use container path directly, instead of hiding it behind a method 2016-09-06 16:36:43 +02:00
Garret Alfert
6b7bb8144e Fix migration script to work without dir objects 2016-09-06 16:24:12 +02:00
Garret Alfert
e6fa6ca586 User proper container and path based on migration state 2016-09-05 18:27:35 +02:00
Garret Alfert
22ce52d00c Migration for moving to a single shared container for all users 2016-09-02 20:03:48 +02:00
Garret Alfert
c79b86bff5 Change Redis key for container migration 2016-09-02 16:41:36 +02:00
Garret Alfert
fdc819d53d Determine which container to use from Redis 2016-09-02 15:15:48 +02:00
Garret Alfert
49ec6effa7 Remove unused method 2016-09-02 15:10:01 +02:00
8ad882d5ab If user container doesn't exist, use shared container 2016-09-01 18:12:52 +02:00
6448642477 Return 503 for PUT/DELETE during user migration 2016-09-01 17:14:42 +02:00
Greg Karékinian
b68c5d8409 Merge pull request #94 from 5apps/feature/86-respond_with_201_on_create
Respond with status 201 when creating new objects
2016-08-08 14:47:07 +02:00
Greg Karékinian
c9be5eaaca Merge pull request #93 from 5apps/bugfix/80-make_sure_to_delete_metadata
Make sure to delete existing metadata on DELETE
2016-08-08 14:46:16 +02:00
Garret Alfert
7a8694fd55 Respond with status 201 when creating new objects
closes #86
2016-08-05 17:43:47 +02:00
Garret Alfert
5891cb9cf0 Make sure to delete existing metadata on DELETE
fixes #80
2016-08-05 17:17:59 +02:00
d786dc235a Merge pull request #91 from 5apps/bugfix/reload_tokens_more_often
Reload swift token from file every 30 minutes
2016-07-23 12:09:47 +02:00
Greg Karékinian
74063a3f66 Reload swift token from file every 30 minutes
We have seen requests fail because of an expired token that was loaded
from file less than an hour ago
2016-07-23 11:30:55 +02:00
55835ac341 Merge pull request #90 from 5apps/update_dependencies
Update dependencies
2016-07-21 12:10:50 +02:00
Greg Karékinian
8caff843d6 Update gem dependencies 2016-07-21 11:26:32 +02:00
Greg Karékinian
56474bc08f Bump Ruby version on Travis 2016-07-21 11:26:21 +02:00
Greg Karékinian
5b0757dc65 Merge pull request #89 from 5apps/update_nokogiri
Update nokogiri
2016-07-21 11:17:11 +02:00
Greg Karékinian
9710bb320c Update nokogiri 2016-07-21 11:06:53 +02:00
4cd32b2e1b Merge pull request #88 from 5apps/bugfix/87-empty_bearer_token
Return 401 when getting an empty bearer token
2016-07-20 18:05:16 +02:00
Greg Karékinian
ad0ea12059 Return 401 when getting an empty bearer token
For example:

Authorization: Bearer

The cause of the empty bearer also needs to be investigated
2016-07-20 17:27:44 +02:00
14d462be41 Merge pull request #85 from 5apps/feature/81-count_storage_size_in_redis
Log user's storage size in Redis
2016-07-04 11:20:33 +02:00
Garret Alfert
995ba52886 Log user's storage size in Redis 2016-06-13 13:18:10 +02:00
fa1f7bccba Merge pull request #84 from 5apps/feature/update_to_recent_rs_spec
Update to recent remoteStorage spec
2016-06-03 10:49:16 +02:00
Garret Alfert
c1d60586ec Improve some spec wordings 2016-06-03 01:08:52 +02:00
Garret Alfert
28b6a7f22d Merge branch 'master' into feature/update_to_recent_rs_spec
# Conflicts:
#	spec/swift/app_spec.rb
2016-06-02 22:21:16 +02:00
a9e4b93cdc Merge pull request #83 from 5apps/feature/message_body_contents
Send message body contents for 401, 404, 409 and 412 responses
2016-06-02 22:04:44 +02:00
Garret Alfert
a349db5243 Spec for directory listing of non-existing directories 2016-06-02 18:57:40 +02:00
Garret Alfert
576e4a9afb Specs for response headers on GET requests 2016-06-02 18:57:37 +02:00
Garret Alfert
16e51038b1 Send ETag of deleted item in header 2016-06-02 18:56:45 +02:00
Garret Alfert
23f0908f38 No need for Expires header anymore 2016-06-02 18:54:49 +02:00
Garret Alfert
ed8061b594 Use content type "application/ld+json" for directory listings 2016-06-02 18:54:47 +02:00
Garret Alfert
c897959029 Send "Precondition Failed" message body with 412 responses 2016-06-02 18:49:44 +02:00
Garret Alfert
cc91b5c4cd Send "Not Found" message body with 404 responses (refs #42) 2016-06-02 13:19:06 +02:00
Garret Alfert
83d8f29a04 Send "Conflict" message body with 409 responses (closes #409) 2016-06-02 13:18:59 +02:00