The INSPIRE literature API cannot return more than 10000 results for a single search query (Elasticsearch pagination window). Following links.next does not get past that.
If a harvest has hits.total > 10000 (wide since/until, or since with no until), we stop at 10000 and miss the rest.
Possible solution: split the date range into smaller windows so each query stays under 10000, then harvest each window.
The INSPIRE literature API cannot return more than 10000 results for a single search query (Elasticsearch pagination window). Following
links.nextdoes not get past that.If a harvest has
hits.total> 10000 (widesince/until, orsincewith nountil), we stop at 10000 and miss the rest.Possible solution: split the date range into smaller windows so each query stays under 10000, then harvest each window.