File tree Expand file tree Collapse file tree 2 files changed +16
-6
lines changed Expand file tree Collapse file tree 2 files changed +16
-6
lines changed Original file line number Diff line number Diff line change @@ -2881,8 +2881,8 @@ components:
2881
2881
beforeIndexPublishing :
2882
2882
type : object
2883
2883
description : >-
2884
- Checks triggered after the crawl finishes and before the records are
2885
- added to the Algolia index.
2884
+ These checks are triggered after the crawl finishes but before the
2885
+ records are added to the Algolia index.
2886
2886
properties :
2887
2887
maxLostRecordsPercentage :
2888
2888
type : number
@@ -2900,9 +2900,14 @@ components:
2900
2900
minimum : 1
2901
2901
maximum : 100
2902
2902
default : 10
2903
+ maxFailedUrls :
2904
+ type : number
2905
+ description : |
2906
+ Stops the crawler if a specified number of pages fail to crawl.
2907
+ If undefined, the crawler won't stop if it encounters such errors.
2903
2908
safetyChecks :
2904
2909
type : object
2905
- description : Safety checks for ensuring data integrity between crawls .
2910
+ description : Checks to ensure the crawl was successful .
2906
2911
properties :
2907
2912
beforeIndexPublishing :
2908
2913
$ref : ' #/components/schemas/beforeIndexPublishing'
Original file line number Diff line number Diff line change @@ -2881,8 +2881,8 @@ components:
2881
2881
beforeIndexPublishing :
2882
2882
type : object
2883
2883
description : >-
2884
- Checks triggered after the crawl finishes and before the records are
2885
- added to the Algolia index.
2884
+ These checks are triggered after the crawl finishes but before the
2885
+ records are added to the Algolia index.
2886
2886
properties :
2887
2887
maxLostRecordsPercentage :
2888
2888
type : number
@@ -2900,9 +2900,14 @@ components:
2900
2900
minimum : 1
2901
2901
maximum : 100
2902
2902
default : 10
2903
+ maxFailedUrls :
2904
+ type : number
2905
+ description : |
2906
+ Stops the crawler if a specified number of pages fail to crawl.
2907
+ If undefined, the crawler won't stop if it encounters such errors.
2903
2908
safetyChecks :
2904
2909
type : object
2905
- description : Safety checks for ensuring data integrity between crawls .
2910
+ description : Checks to ensure the crawl was successful .
2906
2911
properties :
2907
2912
beforeIndexPublishing :
2908
2913
$ref : ' #/components/schemas/beforeIndexPublishing'
You can’t perform that action at this time.
0 commit comments