The test infrastructure contains test assitant and test harness.
-
Pull down cmumars/cp1_base
-
Build
cmumars/p3-cp1_rb
:cd rainbow-planner docker build -t cmumars/p3-cp1_rb .
-
Build
cmumars/cp1_ta
:cd ta docker build -t cmumars/cp1_ta .
-
Build
cmumars/cp1_th
:cd th docker build -t cmumars/cp1_th .
- Create test spectifications by using 'th/generate_test_set.py' and have them placed in the directory, 'th/tests'
- Save logs to AWS S3 bucket
export AWS_ACCESS_KEY=<...> AWS_SECRET_ACCESS_KEY=<...> cd th CUR_EVAL_ID=<...> S3_PATH=<...> ./test_run.sh | tee stdout.log