0

I have a project using Lucene3.5 already.

Now i need to provide web search function but i don't want to import the whole Nutch project.

So i wonder , may be i can only use the crawler part of Nutch to crawl websites and index them into Lucene style.

Then search the index files with my existing Lucene searcher.

Is it possible to do this or do you have any suggestion (how about Heritrix)?

Mikayil Abdullayev
  • 12,117
  • 26
  • 122
  • 206
WoooHaaaa
  • 19,732
  • 32
  • 90
  • 138

1 Answers1

0

Yes, it is possible to search the index produced by nutch with your own lucene implementation. I wrote a short description in the wiki of our project, where we use nutch to crawl static content.

You can have a look at it here: http://code.google.com/p/gtxcontentconnector/wiki/HowTo_Nutch

br, Chris

csupnig
  • 3,327
  • 1
  • 24
  • 22
  • Thanks csupnig,but i noticed that Lucene index files seems different with Nutch index files.The Lucene index are "*.fdt"、"*.fdx"、etc. But Nutch comes out "part-0000/data、part-0000/index". – WoooHaaaa Apr 06 '12 at 08:33
  • Once crawling is finished, the index should be in nutch_base_dir/your_crawl_dir/index. As far as I remember, the part-xxxx parts will be combined at the end. – csupnig Apr 06 '12 at 09:17