Skip to content

Commit aae4ddb

Browse files
algolia-botgazconroyGary Conroyshortcuts
committed
fix(specs): additional safetyChecks (#4128) (generated) [skip ci]
Co-authored-by: gazconroy <[email protected]> Co-authored-by: Gary Conroy <[email protected]> Co-authored-by: Clément Vannicatte <[email protected]>
1 parent 212cae6 commit aae4ddb

File tree

2 files changed

+16
-6
lines changed

2 files changed

+16
-6
lines changed

specs/bundled/crawler.doc.yml

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2881,8 +2881,8 @@ components:
28812881
beforeIndexPublishing:
28822882
type: object
28832883
description: >-
2884-
Checks triggered after the crawl finishes and before the records are
2885-
added to the Algolia index.
2884+
These checks are triggered after the crawl finishes but before the
2885+
records are added to the Algolia index.
28862886
properties:
28872887
maxLostRecordsPercentage:
28882888
type: number
@@ -2900,9 +2900,14 @@ components:
29002900
minimum: 1
29012901
maximum: 100
29022902
default: 10
2903+
maxFailedUrls:
2904+
type: number
2905+
description: |
2906+
Stops the crawler if a specified number of pages fail to crawl.
2907+
If undefined, the crawler won't stop if it encounters such errors.
29032908
safetyChecks:
29042909
type: object
2905-
description: Safety checks for ensuring data integrity between crawls.
2910+
description: Checks to ensure the crawl was successful.
29062911
properties:
29072912
beforeIndexPublishing:
29082913
$ref: '#/components/schemas/beforeIndexPublishing'

specs/bundled/crawler.yml

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2881,8 +2881,8 @@ components:
28812881
beforeIndexPublishing:
28822882
type: object
28832883
description: >-
2884-
Checks triggered after the crawl finishes and before the records are
2885-
added to the Algolia index.
2884+
These checks are triggered after the crawl finishes but before the
2885+
records are added to the Algolia index.
28862886
properties:
28872887
maxLostRecordsPercentage:
28882888
type: number
@@ -2900,9 +2900,14 @@ components:
29002900
minimum: 1
29012901
maximum: 100
29022902
default: 10
2903+
maxFailedUrls:
2904+
type: number
2905+
description: |
2906+
Stops the crawler if a specified number of pages fail to crawl.
2907+
If undefined, the crawler won't stop if it encounters such errors.
29032908
safetyChecks:
29042909
type: object
2905-
description: Safety checks for ensuring data integrity between crawls.
2910+
description: Checks to ensure the crawl was successful.
29062911
properties:
29072912
beforeIndexPublishing:
29082913
$ref: '#/components/schemas/beforeIndexPublishing'

0 commit comments

Comments
 (0)