Neil Williams 2265908f20 upload_static_files_to_s3: Don't list the whole bucket to find changes. ...

The static files S3 bucket has been getting a lot larger recently,
between subreddit stylesheets being in there and the static file cleaner
being disabled due to a bug. This is causing the deploy process to take
upwards of 3 minutes just to determine that no files need to be uploaded
to the bucket.

As a short-term workaround, this changes the uploader to check each key
individually with an S3 HEAD request rather than listing the whole
bucket. This is slower than best case of listing the bucket, but is
significantly faster than the current condition (~25 second runtime
now).

2013-06-16 22:35:40 -07:00

..

migrate

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

traffic

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

clean_static_files.py

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

gen_all_profiles.sh

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

gen_time_listings.sh

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

log_q.py

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

manage-consumers

Fix manage-consumers not correctly iterating over files.

2013-01-28 13:39:01 -08:00

promoted_links.py

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

saferun.sh

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

tracker.py

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00

upload_static_files_to_s3.py

upload_static_files_to_s3: Don't list the whole bucket to find changes.

2013-06-16 22:35:40 -07:00

wrap-job

wrap-job: Don't cd into r2/r2/ when we just want to be in r2/.

2013-02-14 14:18:47 -08:00

write_live_config

Update and fix license headers for 2013.

2013-03-19 20:03:40 -07:00