Autograder [Thu Apr 30 18:27:49 2020]: Received job 11785-s20_hw4p1_18_carunach@andrew.cmu.edu:1307
Autograder [Thu Apr 30 18:28:20 2020]: Success: Autodriver returned normally
Autograder [Thu Apr 30 18:28:20 2020]: Here is the output from the autograder:
---
Autodriver: Job exited with status 0
mkdir -p handin
tar xf handin.tar -C handin
tar: training.ipynb: time stamp 2020-04-30 18:27:04 is 14345.858650612 s in the future
tar: predictions.npy: time stamp 2020-04-30 18:27:03 is 14344.843949561 s in the future
tar: generated.txt: time stamp 2020-04-30 18:27:04 is 14345.843874188 s in the future
tar: generated_logits.npy: time stamp 2020-04-30 18:27:04 is 14345.84378628 s in the future
tar xf autograde.tar
AUTOLAB=1 /usr/local/depot/anaconda3/bin/python3 autograde/runner.py --module-path=./handin/
Your mean NLL for generated sequences: 2.5791678428649902
.Your mean NLL for predicting a single word: 5.367617607116699
.
Run time:  14.951568126678467
{"scores": {"Prediction": 50.0, "Generation": 50.0}}