Question about validation

[itsfrank98]

Hi, I am doing a project similar to this and I stumbled upon your code. Looking at the validate function, I don't understand the following:

for (batch, (inp, tar)) in enumerate(dataset_val):    
        tar_inp = tar[:, :-1] # <startseq> hi im moein
        tar_real = tar[:, 1:] # hi im moein <endseq>

Why for tar_real you take all the tokens except the last one? Since the sequences are padded, shouldn't you be looking for the last non zero token instead?