Temporary PR to integrate PDL's mass of bug fixes and enhancements#148

Open

devanshk wants to merge 132 commits intoautolab:masterfrom xyzisinus:master

+2,274-517

Commits on Aug 11, 2017

When considering a vm for a job, ask aws if it is still running.
Xiaolin (Charlene) Zang
committed
When number of jobs is larger than the number of available vms, N,
Xiaolin (Charlene) Zang
committed
Add pid in the logs of the modules used by jobManager.
Xiaolin (Charlene) Zang
committed
When job manager restarts, it empties its vm "total" pool and "free"
Xiaolin (Charlene) Zang
committed
Add ability to pull amis from aws and to exact a tag "Name" as the image
Xiaolin (Charlene) Zang
committed
Remove DEFAULT_AMI since amis are automatically loaded from aws now.
Xiaolin (Charlene) Zang
committed

Commits on Aug 15, 2017

Add script to drive lab submissions into tango.
Xiaolin Charlene Zang
committed
Add scripts to access ec2 and redis.
Xiaolin Charlene Zang
committed
remove trailing lines.
Xiaolin Charlene Zang
committed

Commits on Aug 16, 2017

Check if output file exists before comparing modification time.
Xiaolin Charlene Zang
committed

Commits on Aug 18, 2017

resetTango should only be called from jobManager. Remove the call from restful server.
Xiaolin Charlene Zang
committed
Add and subtract some logging.
Xiaolin Charlene Zang
committed
Fix a condition for running all students' jobs.
Xiaolin Charlene Zang
committed

Commits on Aug 22, 2017

Use tangoHostPort to distinguish multiple tango containers on the same host.
Xiaolin Charlene Zang
committed
Add logging in destroyVM.
Xiaolin Charlene Zang
committed

Commits on Aug 23, 2017

Modified pool allocation logic to 1) not to allocate all vms allowed
Xiaolin Charlene Zang
committed

Commits on Aug 30, 2017

When job manager restarts, it now destroy the vm instances that not
Xiaolin Charlene Zang
committed
Improve tool script that exercises job manager and the code beneath.
Xiaolin Charlene Zang
committed
Add ability to submit jobs for a given list of students.
Xiaolin Charlene Zang
committed
Fix incomplete test script
xyzisinus
committed

Commits on Aug 31, 2017

Check if the vm still exists before terminating.
Xiaolin Charlene Zang
committed
Check output file for the missing "scores:" line and
Xiaolin Charlene Zang
committed

Commits on Sep 1, 2017

Fix typos that prevents job manager to start.
Xiaolin Charlene Zang
committed

Commits on Sep 5, 2017

Improvements to run_jobs: ability to run failed submissions, to dry run and
Xiaolin Charlene Zang
committed
Add a separate config file for run_jobs to separate config settings
Xiaolin Charlene Zang
committed
Separate "class Config" from util.py.
Xiaolin Charlene Zang
committed
Move student submission range into config file.
Xiaolin Charlene Zang
committed
Correct a typo.
Xiaolin Charlene Zang
committed

Commits on Sep 6, 2017

Better check for output files with missing scores.
Xiaolin Charlene Zang
committed
remove trailing spaces.
Xiaolin Charlene Zang
committed

Commits on Sep 7, 2017

Move logging init in TangoServer to the beginning to capture all
Xiaolin Charlene Zang
committed

Commits on Sep 14, 2017

1. Add ability to shrink preallocated pool. 2. preliminary code to attach
Xiaolin Charlene Zang
committed
Add ability to test decrementing pool size
Xiaolin Charlene Zang
committed

Commits on Sep 15, 2017

Add vm pool low water mark.
Xiaolin Charlene Zang
committed
test for existence of the newly config variables for backward compatibility.
Xiaolin Charlene Zang
committed

Commits on Oct 11, 2017

Fix a condition that checks low_water_mark config variable.
Xiaolin Charlene Zang
committed
A useful suggestive setting for pool low water mark.
Xiaolin Charlene Zang
committed
Merge branch 'master' of https://github.com/xyzisinus/Tango
Xiaolin Charlene Zang
committed

Commits on Oct 12, 2017

Add -j flag to list all jobs. Exam output file in next iteration of
Xiaolin Charlene Zang
committed
When low water mark is zero, the free_destroy vm op works now.
Xiaolin Charlene Zang
committed

Commits on Oct 13, 2017

Add option to direct query to diferent redis servers with port number.
Xiaolin Charlene Zang
committed
Sort the lists of vms and pool items.
Xiaolin Charlene Zang
committed
Wait a bit after requesting an instance from aws. also allows a redis
Xiaolin Charlene Zang
committed
Add comments.
Xiaolin Charlene Zang
committed

Commits on Nov 7, 2017

Fix a problem when failed job is last finished, it's not recognized.
Xiaolin Charlene Zang
committed

Commits on Nov 13, 2017

checkpoint. 1. fix a bug in finding the last submission. 2. scan submissions for exising failures.
Xiaolin Charlene Zang
committed

Commits on Nov 16, 2017

report inconsistency between current results and existing.
Xiaolin Charlene Zang
committed
Recover the old content of the config file after a mistaken commit.
Xiaolin Charlene Zang
committed
When a job is done, report inconsistency between existing result and new.
Xiaolin Charlene Zang
committed

Commits on Nov 17, 2017

Now about to print interesting attributes of each instance.
Xiaolin Charlene Zang
committed
Only look at running instances.
Xiaolin Charlene Zang
committed

Commits on Nov 18, 2017

print instance launch time in local zone.
Xiaolin Charlene Zang
committed
Save the code of tag changing. Its mission is finished now the
Xiaolin Charlene Zang
committed
Add ability to KEEP_VM_AFTER_FAILURE.
Xiaolin Charlene Zang
committed

Commits on Nov 27, 2017

disable a testing statement in the ec2 tool.
Xiaolin Charlene Zang
committed

Commits on Nov 29, 2017

Move timeout report to the right place. add duration reporting.
Xiaolin Charlene Zang
committed

Commits on Dec 4, 2017

temporarily commmit experimental file before moving its useful parts into autodriver.
Xiaolin Charlene Zang
committed

Commits on Dec 12, 2017

Add config for autodriver logging.
Xiaolin Charlene Zang
committed
checkpoint before adding timestamp insersion into user output.
Xiaolin Charlene Zang
committed

Commits on Dec 18, 2017

checkpoint. Add timekeeping thread. change printing macros.
Xiaolin Charlene Zang
committed

Commits on Dec 22, 2017

checkpoint. code complete but need to move file creation to parent proc.
Xiaolin Charlene Zang
committed

Commits on Jan 17, 2018

checkpoint autodriver, after file creation being moved to parent process
Xiaolin Charlene Zang
committed

Commits on Jan 23, 2018

Cleanup in autodriver
Xiaolin Charlene Zang
committed

Commits on Jan 24, 2018

audodriver should not exit for minor errors
Xiaolin Charlene Zang
committed

Commits on Jan 26, 2018

Ready to be made into an image.
Xiaolin Charlene Zang
committed
Add an output generator to help test autodriver.
Xiaolin Charlene Zang
committed
Add pthread lib into build.
Xiaolin Charlene Zang
committed
remove old experiment file.
Xiaolin Charlene Zang
committed

Commits on Jan 30, 2018

Add autodriver timestamp interval in tango config.
Xiaolin Charlene Zang
committed

Commits on Feb 1, 2018

Remove redundant wording in error messages.
Xiaolin Charlene Zang
committed

Commits on Feb 2, 2018

chown output file to autograde. notify child thread job finish.
Xiaolin Charlene Zang
committed
Add new arguments for autodriver. Remove the confusing term autograder.
Xiaolin Charlene Zang
committed

Commits on Feb 9, 2018

Streamline logging in worker's important run() function.
Xiaolin Charlene Zang
committed

Commits on Feb 14, 2018

worker's job exec (copyin/run/copyout) logic flow cleanup complete.
Xiaolin Charlene Zang
committed

Commits on Feb 22, 2018

jobs with big ids starve after job id wraps. Fix with a timestamp.
Xiaolin Charlene Zang
committed
Disable wrap-around of vm ids.
Xiaolin Charlene Zang
committed

Commits on Feb 26, 2018

Move timestamping into appendTrace function and use local time.
Xiaolin Charlene Zang
committed

Commits on Feb 28, 2018

Remove unused function descrementPoolSize
Xiaolin Charlene Zang
committed
Cleanup script and add ability to terminate aws instances.
Xiaolin Charlene Zang
committed

Commits on Mar 12, 2018

Change boolean variable name to avoid the word "not".
Xiaolin Charlene Zang
committed
Remove reference to aws auto scaling group, also fix a problem with the last commit.
Xiaolin Charlene Zang
committed
make autodriver config variables optional for backward compatibility.
Xiaolin Charlene Zang
committed
Add missing config variable and comments.
Xiaolin Charlene Zang
committed
Add a couple of git ignore files.
Xiaolin Charlene Zang
committed

Commits on Mar 20, 2018

Better comments for run_job scripts.
Xiaolin Charlene Zang
committed

Commits on Apr 9, 2018

ec2Read can delete vms with name tag matching at the beginning or the end.
Xiaolin Charlene Zang
committed

Commits on Apr 17, 2018

more comments, isolate timestamp insertion for easy understanding of code.
Xiaolin Charlene Zang
committed

Commits on Apr 18, 2018

Add info about the HostPort config variables.
Xiaolin Charlene Zang
committed

Commits on Apr 24, 2018

Better error report in case of write failure.
Xiaolin Charlene Zang
committed

Commits on Apr 26, 2018

Change redis port name ec2Read to match the config variable.
Xiaolin Charlene Zang
committed

Commits on May 14, 2018

Fix a buffer over-read problem in audodriver.c.
Xiaolin Charlene Zang
committed
Tougher autodriver unit test -- random length long lines.
Xiaolin Charlene Zang
committed

Commits on Jun 12, 2018

Add -l (list instances and pools) and -e (empty pools) to ec2Read.
Xiaolin Charlene Zang
committed

Commits on Jun 22, 2018

First round of converting all ec2 code to using boto3
Xiaolin Charlene Zang
committed

Commits on Jun 29, 2018

Clean up the tool that experiments on aws instances and tango vms.
Xiaolin Charlene Zang
committed

Commits on Jul 2, 2018

Cleanup the ec2 tool script.
Xiaolin Charlene Zang
committed

Commits on Jul 5, 2018

ec2 tool script uses boto3 API consistent with Tango code.
Xiaolin Charlene Zang
committed

Commits on Jul 9, 2018

consolidate boto3 connection naming, make aws access id/key work again and add tests.
Xiaolin Charlene Zang
committed

Commits on Jul 10, 2018

Use boto3 resource API to process images for consistent use of boto3 api.
Xiaolin Charlene Zang
committed

Commits on Jul 13, 2018

In detachVM, remove the replace_vm feature which allows a "bad" vm (os
Xiaolin Charlene Zang
committed

Commits on Jul 16, 2018

destroyVM doesn't return a value for ohter vmms modules. remove from tashi.
Xiaolin Charlene Zang
committed
Rework exception catch for vmms/ec2 module.
Xiaolin Charlene Zang
committed

Commits on Jul 17, 2018

reindent to use 4 spaces.
Xiaolin Charlene Zang
committed

Commits on Jul 31, 2018

Tell autolab web server Tango's timezone and offset from UTC.
Xiaolin Charlene Zang
committed

Commits on Aug 6, 2018

Add OVERRIDE_INST_TYPE to force the aws instance type when necessary.
Xiaolin Charlene Zang
committed

Commits on Aug 13, 2018

Add ability to create aws instance with specified instance type.
Xiaolin Charlene Zang
committed

Commits on Aug 16, 2018

rework tango's reset code. It fails to remove existing vms on clean restart
Xiaolin Charlene Zang
committed
getVMs for ec2 should returns only vms that belongs to Tango (with prefix)
Xiaolin Charlene Zang
committed

Commits on Aug 22, 2018

Rename TangoMachine's name property to pool. vmms/ec2 is done.
Xiaolin Charlene Zang
committed

Commits on Aug 28, 2018

remove bad references to locations.
Xiaolin Charlene Zang
committed

Commits on Aug 30, 2018

log file copied from vm is now readable to all.
Xiaolin Charlene Zang
committed

Commits on Nov 15, 2018

Add script to check the health of Tango.
xyzisinus
committed

Commits on Nov 19, 2018

check in a working version of check_jobs
xyzisinus
committed

Commits on Nov 20, 2018

fix: timezone issue, default instance type not observed, undefined variable
Xiaolin Charlene Zang
committed

Commits on Aug 14, 2019

Fix check_jobs (cron job in production Autolab): comment its purpose,
xyzisinus
committed

Commits on Aug 20, 2019

Add README for autodriver
Xiaolin Charlene Zang
committed

Commits on Sep 3, 2019

Commits on Sep 9, 2019

Commit changes to build/admin files.
Xiaolin Charlene Zang
committed
remove the unusual redis port mapping from run_jobs config file.
Xiaolin Charlene Zang
committed
Make redis port available outside the container
Xiaolin Charlene Zang
committed

Commits on Oct 8, 2019

Swap the order of wating from pending to running and instance tagging.
Xiaolin Charlene Zang
committed

Commits on Oct 9, 2019

Add timed cleanup for untagged stale vms. Add tests
Xiaolin Charlene Zang
committed
Use proper timezone to log instance launch time.
Xiaolin Charlene Zang
committed
Add exception handling to cleanup function.
Xiaolin Charlene Zang
committed
Add python pytz package.
Xiaolin Charlene Zang
committed
Manually start the cleanup function from test script.
Xiaolin Charlene Zang
committed
ec2SSH is activated from multiple tango services, probably unnecessarily.
Xiaolin Charlene Zang
committed

Commits on Oct 18, 2019

Remove tool's reference to redis and close redis's open door
Xiaolin Charlene Zang
committed

Commits on Nov 9, 2019