Faster Search Indexing

search
indexing
Tags: #<Tag:0x00007fe3d006a840> #<Tag:0x00007fe3d006a700>

#1

On the search page, there is a note that the indexes are updated every 3 hours. The fastest I’ve been able to re-index has been 6 hours. Does anyone have any hints on how to index faster?

Thanks.

Michael


#2

Using a SSD has reduced the index time on my machine from about 9 hours to 3½ hours.

And maybe you can use the script “updateindex.sh” instead of recreate the full index on every run.


#3

updateindex,sh does not really work

Make sure are allocating sufficient memory when reindexing.


#4

IIRC that’s no longer exactly true: some indexes are updated every hour or two (like artist) and some once or twice a day (like recording).


#5

@InvisibleMan78, I already went down the updateindex.sh route and found that it isn’t supported anymore. SSD isn’t really an option for me, but I’ll look into using RAM disk in some way.

@ijabz, memory doesn’t seem to be a problem. There was no change after doubling the memory available to the indexing Java process.

@reosarevok would it be possible to share the cron jobs/related scripts for indexing? I couldn’t find anything in the chef repo.

Thanks.

Michael


#6

I would recommend updating recording only once a day, then update the rest as fast as you can. That is what we do in production.