1

The following is hyperparameters in demo.sh of glove. What is the meaning of VERBOSE, MEMORY, WINDOW_SIZE and BINARY.

The WINDOW_SIZE is 15, is that means chose 15 words from right and chose 15 words from left?

VERBOSE=2        ?
MEMORY=4.0       ?
VOCAB_MIN_COUNT=5
VECTOR_SIZE=128
MAX_ITER=15
WINDOW_SIZE=15   ?
BINARY=2         ?
NUM_THREADS=8
X_MAX=100
Animeta
  • 1,241
  • 3
  • 16
  • 30

1 Answers1

1

VERBOSE is a regular parameter for model training nowadays, its value tells the function how much information to print while training the model. Usually 0 means no intermediate information, 1 means minimal and 2 means a lot more detail. (check: https://github.com/stanfordnlp/GloVe/blob/master/src/cooccur.c) for more details about what are printed.

MEMORY: I'm not quite sure about this but I think it has to do with the memory usage for the model training. (feel free to correct & update)

WINDOW_SIZE: yes, it's the context size (check: https://github.com/stanfordnlp/GloVe/blob/master/src/cooccur.c)

BINARY: It's a switch option for file output type. 0 for text file, 1 for binary, and 2 for both (check: https://github.com/stanfordnlp/GloVe/blob/master/src/glove.c).

TYZ
  • 8,466
  • 5
  • 29
  • 60