I am trying to paging with Elasticsearch, but the following problem occurs.
From and Size cannot exceed max_result_window size.
Problem of slow search due to too many iterations of Scroll Search or Search After
Thanks to everyone who replies.
Asked
Active
Viewed 336 times
0
WooSub Shin
- 27
- 4
-
Show your code first, also describe your problem better. Why do you need to iterate whatever? Just set different from parameter – Morph21 Mar 16 '22 at 11:01
-
When searching all logs of a user named "jobs" in an index named "user log", repeated search is required to search deep data. This is because the user wants to see all logs with one filter called "Jobs". – WooSub Shin Mar 16 '22 at 12:02
-
then just use scroll serach and read about pagination in elasticsearch with scroll (it uses something called scroll_id) Don't fetch 10 items just fetch all 10000 (it's default max you can change it in elastic settings) and after each fetch just use scroll_id to fetch next page – Morph21 Mar 16 '22 at 12:05
-
Why would you need to discard all the data you've retrieved already? Logs in the past don't change, why retrieving them again when going to the previous page, just cache them. It's not an ES problem, it's a UI problem :-) – Val Mar 16 '22 at 12:26