2

In the MALLET documentation, it requires --keep-sequence tag for Topic model training (Detail is at : http://mallet.cs.umass.edu/topics.php)

However, in my knowledge, regular LDA modeling use documents as bag of words, since including bigram will increase the feature space by a lot. I wonder why MALLET requires keep-sequence in LDA training, and how did MALLET actually use that sequential information?

Thank you for reading this post.

JLTChiu
  • 983
  • 3
  • 12
  • 28

1 Answers1

1

It doesn't "need" to keep sequence.

That option is merely so that the words per topic when you do "--output-topic-keys" are in the same sequence as they appear in the notes.

It is also useful when you are looking to find phrases in topic models (http://www.mimno.org/articles/phrases/)

Dhawal Joharapurkar
  • 15
  • 2
  • 8