What is a .lck file and why can't I read it with a buffered reader?

Question

I'm trying to use crawler4j to crawl websites. I was able to follow the instructions on the crawler4j website. When it is done it creates a folder with two different .lck files, one .jdb file and one .info.0 file.

I tried to read in the file using the code that I provided in this answer to read in the file but it keeps failing. I've used the same function to read text files before, so I know the code works.

I also found someone else that asked the same question a few months ago. They never got an answer.

Why can't I use my code to open and read these .lck files to memory?

"it keeps failing" is hopelessly vague. What happens? – Jon Skeet Mar 27 '13 at 13:36 — Jon Skeet, Mar 27 '13 at 13:36

score 1 · Accepted Answer · edited May 23 '17 at 12:21

1

Crawler4j uses BerkeleyDB to store crawl informations. See here in the source.

From the command line you can use DB utils to acces the data. Already covered in SO here.

If you want to access the data in your Java code, you simply import BerkeleyDB library (Maven instruction there) and follow the tutorial on how to open the DB.

edited May 23 '17 at 12:21

Community

1
1

answered Mar 29 '13 at 15:17

Julien

1,302
10
23

Thanks, I was looking around the crawler4j site looking for what to do with those files but I hadn't found anything. – j.jerrod.taylor Mar 29 '13 at 15:25

What is a .lck file and why can't I read it with a buffered reader?

1 Answers1