2

I have a LAMP setup, with the mysql database essentially being a catalog of products. Since the database changes frequently as new products are added, it's cumbersome to manually maintain a list of keywords and popular phrases. The need to keep a keyword/phrase list is twofold: (1) for google adwords and other marketing initiatives, and (2) for link structure on my site.

I've been using the Zend Lucene port as the backbone for all searching on my site. Is it possible to do things like determine keyword density and/or phrase density using Lucene? What about another search engine?

For further clarity of what I'm looking for, let's say I have a catalog of laptops. I might have various models of Dell Inspiron, Dell Latitude, Macbook, Gateway, Lenovo, and Acer laptops. For a keyword density report, I'd like to see that the words "laptop" and "notebook" are popular, as well as perhaps "Dell Inspiron" or "Dell Inspiron laptops" or "Lenovo laptops."

Can anyone recommend something to get started? I'm sorta eying the whole search module world like Lucene, Sphinx, Solr, etc. since it's already indexing data, but I don't know if I'm going down the wrong path.

Thanks!

dustin999
  • 273
  • 4
  • 12

1 Answers1

2

Lucene is capable of giving you a list of (keyword, frequency) pairs. See this question, or this blog post.

Community
  • 1
  • 1
Xodarap
  • 11,581
  • 11
  • 56
  • 94
  • Thanks, I noticed this post is referring to pure Lucene (java), and I'm using the Lucene port bundled with Zend. So hopefully I can do everything natively in php, otherwise I may need to scrub off the java cobwebs. – dustin999 Nov 02 '10 at 00:01
  • Seems like you can do this in PHP: search for termDocs() in this page: http://framework.zend.com/manual/en/zend.search.lucene.best-practice.html – Yuval F Nov 02 '10 at 06:59
  • I ended up writing my own script for determining keyword density, wasn't too hard with python. I'll go ahead and accept this as the right answer... – dustin999 Aug 08 '11 at 18:33