This file is used to list changes made in each version of the et_upload cookbook.
- Updated process_uploads to ignore reports folder
- Added a reporting folder to all clients
- Need to shellword escape the file name in gzip command
- Use gzip command for compressing files
- Ensure files are in the uploads folders and not a subfolder
- Added partner upload support
- Added new solicitors file type to upload process
- Upload files in the order we receive them
- Run process_uploads every 2 minutes now that missing org files have been removed
- Fix for capturing mtime before deleting file
- Remove files from orgs that are not found
- Run process_uploads every 5 minutes
- Notify customer support about invalid zip files
- Use newer version of gem
- Update evertrue group permissions on uploads and exports
- Revert group change on the home dir
- Fix .ssh permission
- Give evertrue user permission to see inside upload users' home dir
- Blake blew out a return statement for the s3_filename, put that back in
- File naming convention can be singular
- Only download export once
- Add special exception for yale
- Process assignment imports
- Log scheduled export to a different file
- Run scheduled export job every 10 minutes
- Clean scheduled export every 90 days
- Remove extension from process scheduled export.
- Add process scheduled export to the cookbook file.
- Process Scheduled Exports: Add script to process latest scheduled exports from CAPI per org.
- Process uploads: Make sure the algorithm for REMOVING slug random numbers matches the one for adding them
- Process uploads: Make sure the algorithm for REMOVING slug random numbers matches the one for adding them
- Add reboot coordinator exemption
- Have upload scripts use their own sentry dsn
- Fix bug with pagerduty key
- Add support for interaction imports
- Add support for full gift imports
- Add email notification support for genius@evertrue.com
- Upgrade to Ruby 2.0 for upload processing scripts
- Use sudo to allow group evertrue users to run chef-client and restart the service
- Don't fail the process_uploads script for API response codes of 400, since it keeps other files from being processed
- Re-enable pagerduty for the process uploads script
- Send support emails to onboarding instead of Jenna
- Use env var
DEBUG_EMAILinstead ofalex@evertrue.com
- Fixes authentication issue when hitting new DNA endpoint
- Use non-legacy DNA endpoint for org setting values
- Rotate logs weekly to get a better historical view of import statuses
- Fix bug causing script to fail in production
- Many improvements to the process uploads script (mostly more logging and alerting)
- Resolve script error that prevents DNA updates for unrecognized csv headers
s/work_dir/archive_dir/
- Refactor the process uploads script
- Move working directory and uploads (users) directories to ephemeral storage
- Add support for header changes
- Add tests for general Contact import path in process_uploads
- Filter out users with action property set to 'remove'
- Allow Transactional Gift file processing through the process_uploads script
- Refactor process_upload script and surrounding infrastructure
- Testing on Ubuntu 14.4
- Add integration test for process_upload script
- Many minor bug fixes and improvements
- Handle user deletes
- Remove legacy code path
- Use greater-than version constraint for cron cookbook
- Fix hostname for hb
- Add notification when queueing a job
- Escape spaces only for shell exec
- Escape spaces in filenames
- Change auto-ingestion flow to only gate new importer queuing
- Fix syntax error
- Ensure no duplicate submissions due to timeout
- Clean up unused file open block
- Handle individual file failure
- Fix chefspec tests
- Fix job queueing flow (thanks @haizhou)
- Use console gate to route imports
- Fix issue with mismatched username/OID, properly rescue DNA
- Pin to cron v1.3.8 to avoid "predefined_value" bug.
- Fix script to skip processing of trial user uploads
- Refactor upload processing scripts to ship import data to S3
- Remove @ehrenfoss from cronjob MAILTO notifications
- Adjust code so any user with a username includes the string
trialis treated as a shared trial user
- Add
trial-usershared SFTP account to use for trial customers to improve security - Adjust tests to check permissions properly for
trial-useruploads directory
- Refactor scripts to only search users based on upload users data bag item content
- Fix FC023 in
et_upload::users - Add installation of Ruby 1.9.1 & aws-sdk RubyGem
- Paves way forward for using Ruby for scripts instead of Bash
- Add ChefSpec & ServerSpec tests for newly created functionality
- Fix name of script that had been renamed
- Add Ehren to cronjob notifications
- Remove email notification for cleanup cronjob
- Refactor user provision script to a username & password generation script
- Change path for
findto be relative - Fix path to uploads users' home folders
- Add Serverspec integration tests
- Tweak ChefSpec tests to use test data bag item, consistent w/ Serverspec
- Add ChefSpec unit tests
- Fix mode of scripts to be executable
- Use OpenSSH’s built-in SFTP user jailing instead of building a chroot jail
- Add setup of chroot jail using Jailkit
- Fix user creation to add all necessary folders & set ownership properly
- Add authorized_keys template exists
- Add Test Kitchen config for Chef Zero
- Initial release of et_upload