update thinking sphinx index in ruby code

Question

I have app, which run's on ubuntu 12.04, with nginx+passenger And in my method i try to rebuild sphinx index so:

  def update_sphinx_index
    Rails.application.load_tasks
    Rake::Task['ts:rebuild'].invoke
    redirect_to admin_mainpage_path
  end

also i try:

`rake ts:index`

but nothing happend, sphinx index doesn't rebuild. What i do wrong? Maybe i need to do this with some privilegies, or something else, becouse when i do rake ts:rebuild in command terminal all is fine, and index rebuild.

@Monk_Code what do you mean? code? Rake::Task['ts:rebuild RAILS_ENV=production'].invoke — brabertaser19, Nov 14 '13 at 12:55
I indexation during limited hours following command `bundle exec rake ts:index RAILS_ENV=staging` on staging — Roman Kiselenko, Nov 14 '13 at 12:57
let us [continue this discussion in chat](http://chat.stackoverflow.com/rooms/41186/discussion-between-monk-code-and-brabertaser1992) — Roman Kiselenko, Nov 14 '13 at 13:03
What happens if you run `\`rake ts:index\`` from `rails console`? — jb_314, Dec 09 '13 at 19:21
What is the output of `\`rake ts:index`\` when you run it from within your app? For example, in a view, do `<%=\`rake ts:index\`%>`. — jb_314, Dec 09 '13 at 19:34
@np_ i get http://pastebin.com/gXGDTHVa with =`cd /home/prog/OnlineAuto/Shop rake ts:rebuild` i get empty with rebuild http://pastebin.com/9scaKzgW — brabertaser19, Dec 11 '13 at 18:01
@brabertaser1992 I did not -1 your question. I +1'd because someone else gave you -1 for no good reason. But for that extreme reaction don't expect any help. — Popnoodles, Mar 27 '14 at 20:15

score 4 · Answer 1 · answered Dec 10 '13 at 01:20

First of all, I don't really like the idea of calling sphinx reindex from a controller. The best practice here would be to use deltas for partial indexing (deltas with resque are a great solution for almost real time indexing) and then an occasional reindex once in a while to compact the files.

But if for any reason you really need to run this from the controller, I would say there are two things to consider. One is you are probably not on the right directory, so you can try to issue the system call changing to the directory then executing rake, as in

`cd /path/to/your/app rake ts:index`

Apart from this, if you are following best practices, the user executing your web server will be an underprivileged user, something like a user belonging to the www-data group. It's very likely this user won't have permissions to execute rake or to write the index files, so make sure the user starting your web server has the right permissions.

and how can i change thid permission's? i use nginx + passenger — brabertaser19, Dec 10 '13 at 09:17
first you need to identify which permission issues you have. If your problem is you can't write the files, you can just make the index files available for any user in your system, as they are not really a security risk. If your problem is you can't execute rake, then you should add group permissions with chmod and make sure the user starting your web server is a part of the same group. — Javier Ramirez, Dec 10 '13 at 10:44

score 3 · Answer 2 · answered Nov 16 '13 at 13:08

3

ts:rebuild stops sphinx, rebuilds the index and then restarts, and should only be run if you've changed the structure of your index.

Instead, you should be running ts:index if you're only adding new data.

As for why the rake task is not executing, it may be that your search daemon is still running.

answered Nov 16 '13 at 13:08

Oscar Barrett

3,135
31
36

As for why the rake task is not executing, it may be that your search daemon is still running. how to be than – brabertaser19 Nov 16 '13 at 13:12
You could create another task to kill the searchd process, and run it before calling `ts:rebuild`. [See here](https://github.com/pat/thinking-sphinx/issues/497#issuecomment-17140584) for an example of such a task. – Oscar Barrett Nov 16 '13 at 13:53
how about Rails.application.load_tasks Rake::Task['ts:stop'].invoke Rake::Task['ts:index'].invoke Rake::Task['ts:start'].invoke ? – brabertaser19 Nov 16 '13 at 14:01
maybe there are any ideas? – brabertaser19 Nov 18 '13 at 21:05
Did you try using `ts:index` instead? Or killing the searchd process before running `ts:rebuild`? – Oscar Barrett Nov 19 '13 at 02:33
first yes, killing no – brabertaser19 Nov 19 '13 at 11:11
so first i need to create task with code: task :kill_searchd do run 'ps -ef | grep "searchd.*" | grep -v grep | awk \'{print $2}\' | xargs kill' end and then run it in controller before "thinking_sphinx:rebuild", "kill_searchd" ? – brabertaser19 Nov 19 '13 at 17:24
Yeah something similar to that. – Oscar Barrett Nov 20 '13 at 00:05
i try with killing process, and it didn't help – brabertaser19 Dec 05 '13 at 17:57
what else could you propose? – brabertaser19 Dec 05 '13 at 20:03

update thinking sphinx index in ruby code

2 Answers2