The validation error was computed on the training data. That's embarassing.