I've been playing with SyntaxNet. After each run, a line like this is printed:
INFO:tensorflow:Seconds elapsed in evaluation: 20.65, eval metric: 11.48%
I've traced it to line 134 of parser_eval.py:
tf_eval_epochs, tf_eval_metrics, tf_documents = sess.run([
parser.evaluation['epochs'],
parser.evaluation['eval_metrics'],
parser.evaluation['documents'],
])
num_tokens += tf_eval_metrics[0]
num_correct += tf_eval_metrics[1]
(...)
eval_metric = 100.0 * num_correct / num_tokens
(...)
logging.info('Seconds elapsed in evaluation: %.2f, '
'eval metric: %.2f%%', time.time() - t, eval_metric)
It seems to be a measure of accuracy, but how is it calculated and what does it mean?