Autograder [Wed Apr  8 04:52:44 2020]: Received job 11785-s20_hw4p1_4_vnatu@andrew.cmu.edu:1273
Autograder [Wed Apr  8 04:53:01 2020]: Success: Autodriver returned normally
Autograder [Wed Apr  8 04:53:01 2020]: Here is the output from the autograder:
---
Autodriver: Job exited with status 0
mkdir -p handin
tar xf handin.tar -C handin
tar xf autograde.tar
AUTOLAB=1 /usr/local/depot/anaconda3/bin/python3 autograde/runner.py --module-path=./handin/
FYour mean NLL for predicting a single word: 5.425961494445801
F
=================================== FAILURES ===================================
_______________________________ test_generation ________________________________

    def test_generation():
        inp = np.load(fixture_path('generation.npy'))
        forward = 10
        n = inp.shape[0]
        t = inp.shape[1]
>       pred = np.load(handin_path('generated_logits.npy'))

autograde/tests/test_generation.py:222: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
/usr/local/depot/anaconda3/lib/python3.5/site-packages/numpy/lib/npyio.py:406: in load
    pickle_kwargs=pickle_kwargs)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

fp = <_io.BufferedReader name='/home/autograde/autolab/autograde/../handin/generated_logits.npy'>
allow_pickle = True, pickle_kwargs = {'encoding': 'ASCII', 'fix_imports': True}

    def read_array(fp, allow_pickle=True, pickle_kwargs=None):
        """
        Read an array from an NPY file.
    
        Parameters
        ----------
        fp : file_like object
            If this is not a real file object, then this may take extra memory
            and time.
        allow_pickle : bool, optional
            Whether to allow reading pickled data. Default: True
        pickle_kwargs : dict
            Additional keyword arguments to pass to pickle.load. These are only
            useful when loading object arrays saved on Python 2 when using
            Python 3.
    
        Returns
        -------
        array : ndarray
            The array from the data on disk.
    
        Raises
        ------
        ValueError
            If the data is invalid, or allow_pickle=False and the file contains
            an object array.
    
        """
        version = read_magic(fp)
        _check_version(version)
        shape, fortran_order, dtype = _read_array_header(fp, version)
        if len(shape) == 0:
            count = 1
        else:
            count = numpy.multiply.reduce(shape)
    
        # Now read the actual data.
        if dtype.hasobject:
            # The array contained Python objects. We need to unpickle the data.
            if not allow_pickle:
                raise ValueError("Object arrays cannot be loaded when "
                                 "allow_pickle=False")
            if pickle_kwargs is None:
                pickle_kwargs = {}
            try:
>               array = pickle.load(fp, **pickle_kwargs)
E               AttributeError: Can't get attribute '_rebuild_tensor_v2' on <module 'torch._utils' from '/usr/local/depot/anaconda3/lib/python3.5/site-packages/torch/_utils.py'>

/usr/local/depot/anaconda3/lib/python3.5/site-packages/numpy/lib/format.py:637: AttributeError
_______________________________ test_prediction ________________________________

    def test_prediction():
        fixture = np.load(fixture_path('prediction.npz'))
        inp = fixture['inp']
        targ = fixture['out']
        out = np.load(handin_path('predictions.npy'))
        assert out.shape[0] == targ.shape[0]
        vocab = np.load(fixture_path('vocab.npy'))
        assert out.shape[1] == vocab.shape[0]
        out = log_softmax(out, 1)
        nlls = out[np.arange(out.shape[0]), targ]
        nll = -np.mean(nlls)
        print("Your mean NLL for predicting a single word: {}".format(nll))
>       assert nll < 5.4
E       assert 5.4259615 < 5.4

autograde/tests/test_prediction.py:31: AssertionError
Run time:  1.1308071613311768
{"scores": {"Prediction": 0.0, "Generation": 0.0}}