You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: tutorials/cp-aibus-ber-custom-data/cp-aibus-ber-custom-data.md
+2Lines changed: 2 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -17,6 +17,8 @@ The core functionality of Business Entity Recognition is to automatically detect
17
17
18
18
In this tutorial, you will learn how to use the service APIs to create a dataset, upload training data, and submit a training job to finally create your own custom machine learning model to classify any given type of named entity, such as mobile number, first name, last name and address, in the texts you will submit to the service in the next tutorial: [Deploy Model and Get Prediction Results](cp-aibus-ber-custom-deploy).
19
19
20
+
Check out the tutorial group [Use Pre-Trained Machine Learning Models to Process Unstructured Text](group.cp-aibus-business-entity-detect) to try out the Business Entity Recognition pre-trained machine learning models.
@@ -19,12 +19,14 @@ The core functionality of Business Entity Recognition is to automatically detect
19
19
20
20
Business Entity Recognition is a customizable machine learning service, but you can also use the following pre-trained machine learning models:
21
21
22
+
-`sap_address_entity`
22
23
-`sap_email_business_entity`
24
+
-`sap_generic_entities`
23
25
-`sap_invoice_header`
24
26
25
-
See [Extracted Entities by Pre-trained Model](https://help.sap.com/viewer/b43f8f61368d455793a241d2b10baeb2/SHIP/en-US/7eb1408001564d679adcd3bc4796800f.html)
27
+
See [Extracted Entities by Pre-trained Model](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/7eb1408001564d679adcd3bc4796800f.html) and [Free Service Plan and Trial Account Technical Constraints](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/c80a45cc7416409eb9bf64667487c375.html).
26
28
27
-
This tutorial gives you an introduction to the service using a trial account and the available pre-trained machine learning models. If you want to try out the Business Entity Recognition training endpoints to create your own model, go to the next tutorial [Detect and Highlight Entities from Unstructured Text with Custom Models](cp-aibus-ber-swagger-ui-custom).
29
+
This tutorial gives you an introduction to the service using a trial account and the available pre-trained machine learning models. If you want to try out the Business Entity Recognition training endpoints to create your own model, check out the tutorial group [Use Custom Machine Learning Models to Process Unstructured Text](group.cp-aibus-business-entity-custom).
28
30
29
31
---
30
32
@@ -40,73 +42,143 @@ In the service key you created for Business Entity Recognition in the previous t
40
42
41
43
2. To be able to use the Swagger UI endpoints, you need to authorize yourself. In the top right corner, click **Authorize**.
42
44
43
-
!
45
+
!
44
46
45
47
3. Get the `access_token` value created in the previous tutorial: [Get OAuth Access Token for Business Entity Recognition Using Any Web Browser](cp-aibus-ber-web-oauth-token), then add **bearer** in front of it, and enter in the **Value** field.
46
48
47
49
```
48
50
bearer <access_token>
49
51
```
50
52
51
-
!
53
+
!
52
54
53
55
4. Click **Authorize** and then click **Close**.
54
56
55
-
!
57
+
!
56
58
57
59
[VALIDATE_1]
58
60
[ACCORDION-END]
59
61
60
62
61
-
[ACCORDION-BEGIN [Step 2: ](Post inference result with sap_email_business_entity)]
63
+
[ACCORDION-BEGIN [Step 2: ](Enter inference text for sap_address_entity)]
62
64
63
65
Use the **POST /inference/jobs** endpoint to submit the text to be extracted and choose the pre-trained machine learning model you want to use to extract entities from the text.
64
66
65
67
1. Click the endpoint name to expand it.
66
68
67
69
2. Click **Try it out**.
68
70
69
-
!
71
+
!
72
+
73
+
3. In **payload**, enter the `text` you want to extract named entities from, `modelName`, and `modelVersion`. In this `sap_address_entity` pre-trained model example, you can use the following:
74
+
75
+
```JSON
76
+
{
77
+
"text":"Warehouse 02 (UK) Ltd c/o Excel Logistics Waindyke Way WF6 1TF. West Yorkshire United Kingdom.",
78
+
"modelName":"sap_address_entity",
79
+
"modelVersion":2
80
+
}
81
+
```
82
+
83
+
4. Click **Execute**.
84
+
85
+
!
86
+
87
+
5. Copy the **`id`** from the **Response body** to see the result of the extraction in the next step.
88
+
89
+
!
90
+
91
+
[DONE]
92
+
[ACCORDION-END]
93
+
94
+
95
+
[ACCORDION-BEGIN [Step 3: ](Get inference response from sap_address_entity)]
96
+
97
+
Use the **GET /inference/jobs/{`jobId`}** endpoint to see the text extraction results and the confidence level of the `sap_address_entity` model.
98
+
99
+
1. Click the endpoint name to expand it.
100
+
101
+
2. Click **Try it out**.
102
+
103
+
!
104
+
105
+
3. Enter the `jobId` obtained in the previous step and click **Execute**.
106
+
107
+
!
108
+
109
+
You should receive a response like the following:
110
+
111
+
!
112
+
113
+
In the response, you will find the prediction for the extracted entities. The prediction is made with a probability indicated by the **confidence** field which represents how certain the model is about the value provided. A confidence of 1 means that the model is 100% sure about its prediction.
114
+
115
+
You have now successfully used the `sap_address_entity` model to get text entity predictions for the unstructured text you submitted to Business Entity Recognition.
116
+
117
+
You can also use the following **payload** example with the `sap_address_entity` model:
To try out the `sap_address_entity` model with your own unstructured text, keep in mind the model scope and supported languages, as detailed in [`sap_address_entity`](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/55ab2ca0f9064aefbc1425246a1b3d1f.html) and [Supported Languages](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/e710add9d4d743958a3d21b82b3f220d.html).
128
+
129
+
[DONE]
130
+
[ACCORDION-END]
131
+
132
+
133
+
[ACCORDION-BEGIN [Step 4: ](Enter inference text for sap_email_business_entity)]
134
+
135
+
Use the **POST /inference/jobs** endpoint to submit the text to be extracted and choose the pre-trained machine learning model you want to use to extract entities from the text.
136
+
137
+
1. Click the endpoint name to expand it.
138
+
139
+
2. Click **Try it out**.
140
+
141
+
!
70
142
71
143
3. In **payload**, enter the `text` you want to extract named entities from, `modelName`, and `modelVersion`. In this `sap_email_business_entity` pre-trained model example, you can use the following:
72
144
73
145
```JSON
74
146
{
75
147
"text":"11577210 - FAGOR EDERLAN MEXICO § Dear colleagues, there any way to identify which procurement division has transmitted 1339846 this payment to ABC Ltd. as there is no identification number. Are you able to help? Thank you: Doe, Jane <[email protected]>: 15 May 2019 15:25 To: Doe, John <[email protected]>Cc: Smith, John <[email protected]>: /432216153 328,439.24 Thanks and best Jane. Doe, Jane. Accountant, Procurement Department, Doe Company, S. L. P.Phone+52 444 880 2300. 1114 Doe Company<doe-company.com>",
76
148
"modelName":"sap_email_business_entity",
77
-
"modelVersion":1
149
+
"modelVersion":2
78
150
}
79
151
```
80
152
81
153
4. Click **Execute**.
82
154
83
-
!
155
+
!
84
156
85
157
5. Copy the **`id`** from the **Response body** to see the result of the extraction in the next step.
86
158
87
-
!
159
+
!
88
160
89
161
[DONE]
90
162
[ACCORDION-END]
91
163
92
164
93
-
[ACCORDION-BEGIN [Step 3: ](Get inference result with sap_email_business_entity)]
165
+
[ACCORDION-BEGIN [Step 5: ](Get inference response from sap_email_business_entity)]
94
166
95
167
Use the **GET /inference/jobs/{`jobId`}** endpoint to see the text extraction results and the confidence level of the `sap_email_business_entity` model.
96
168
97
169
1. Click the endpoint name to expand it.
98
170
99
171
2. Click **Try it out**.
100
172
101
-
!
173
+
!
102
174
103
175
3. Enter the `jobId` obtained in the previous step and click **Execute**.
104
176
105
-
!
177
+
!
106
178
107
179
You should receive a response like the following:
108
180
109
-
!
181
+
!
110
182
111
183
In the response, you will find the prediction for the extracted entities. The prediction is made with a probability indicated by the **confidence** field which represents how certain the model is about the value provided. A confidence of 1 means that the model is 100% sure about its prediction.
112
184
@@ -118,25 +190,95 @@ You can also use the following **payload** example with the `sap_email_business_
118
190
{
119
191
"text":"Von: lena nova <[email protected]> Gesendet: Montag, 21. Januar 2019, 19:13 Uhr An: canu, ana <[email protected]>; [email protected] Betreff: RE: M & B EOOD 2639710315 Sehr geehrter Kunde, ich sende Ihnen Informationen für unsere Zahlung. Proforma 198305906 ist ein Teil der Rechnung 4830476570 / 11.01.2019. Rechnungsdatum Betrag in EUR 4830473772 14.12.2018 9,28 € 4830474632 21.12.2018 29,16 € 4830475244 28.12.2018 46,19 € 4830475919 4.1.2019 9,28 € 198305906 10.1.2019 9,29 € 103,20 € 4830476570 11.1.2019 37,13 198305906 10.1.2019 -9,29 € 27,84 Einen schönen Tag noch! Mit freundlichen Grüßen, lena lena nova Verkaufsleiterin M & B EOOD-Computer Center 11, Angel Kanchev Str; 1000, Sofia, Bulgarien Tel.: + 359 2 981 58 57; Mobil: + 359 889 61 13 21 E-Mail: [email protected] Besuchen Sie uns unter: www.computercenter.bg",
120
192
"modelName":"sap_email_business_entity",
193
+
"modelVersion":2
194
+
}
195
+
```
196
+
197
+
To try out the `sap_email_business_entity` model with your own unstructured text, keep in mind the model scope and supported languages, as detailed in [`sap_email_business_entity`](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/8f940cca185144b8baff1fdf31ce2c82.html) and [Supported Languages](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/e710add9d4d743958a3d21b82b3f220d.html).
198
+
199
+
[DONE]
200
+
[ACCORDION-END]
201
+
202
+
203
+
[ACCORDION-BEGIN [Step 6: ](Enter inference text for sap_generic_entities)]
204
+
205
+
Use the **POST /inference/jobs** endpoint to submit the text to be extracted and choose the pre-trained machine learning model you want to use to extract entities from the text.
206
+
207
+
1. Click the endpoint name to expand it.
208
+
209
+
2. Click **Try it out**.
210
+
211
+
!
212
+
213
+
3. In **payload**, enter the `text` you want to extract named entities from, `modelName`, and `modelVersion`. In this `sap_generic_entities` pre-trained model example, you can use the following:
214
+
215
+
```JSON
216
+
{
217
+
"text":"In 1988, 31.6% of blacks lived in poverty, compared with 10.1% for whites and 26.8% for Hispanics.",
218
+
"modelName":"sap_generic_entities",
219
+
"modelVersion":1
220
+
}
221
+
```
222
+
223
+
4. Click **Execute**.
224
+
225
+
!
226
+
227
+
5. Copy the **`id`** from the **Response body** to see the result of the extraction in the next step.
228
+
229
+
!
230
+
231
+
[DONE]
232
+
[ACCORDION-END]
233
+
234
+
235
+
[ACCORDION-BEGIN [Step 7: ](Get inference response from sap_generic_entities)]
236
+
237
+
Use the **GET /inference/jobs/{`jobId`}** endpoint to see the text extraction results and the confidence level of the `sap_generic_entities` model.
238
+
239
+
1. Click the endpoint name to expand it.
240
+
241
+
2. Click **Try it out**.
242
+
243
+
!
244
+
245
+
3. Enter the `jobId` obtained in the previous step and click **Execute**.
246
+
247
+
!
248
+
249
+
You should receive a response like the following:
250
+
251
+
!
252
+
253
+
In the response, you will find the prediction for the extracted entities. The prediction is made with a probability indicated by the **confidence** field which represents how certain the model is about the value provided. A confidence of 1 means that the model is 100% sure about its prediction.
254
+
255
+
You have now successfully used the `sap_generic_entities` model to get text entity predictions for the unstructured text you submitted to Business Entity Recognition.
256
+
257
+
You can also use the following **payload** example with the `sap_generic_entities` model:
258
+
259
+
```JSON
260
+
{
261
+
"text":"Sie liegt sechs Kilometer nordöstlich des Stadtzentrums von Pardubice und gehört zum Okres Pardubice.",
262
+
"modelName":"sap_generic_entities",
121
263
"modelVersion":1
122
264
}
123
265
```
124
266
125
-
To try out the `sap_email_business_entity` model with your own unstructured text, keep in mind the model scope and supported languages, as detailed in [Extracted Entities by Pre-trained Model](https://help.sap.com/viewer/b43f8f61368d455793a241d2b10baeb2/SHIP/en-US/7eb1408001564d679adcd3bc4796800f.html).
267
+
To try out the `sap_generic_entities` model with your own unstructured text, keep in mind the model scope and supported languages, as detailed in [`sap_generic_entities`](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/d1cc656813fa4737a5df3aa131bed338.html) and [Supported Languages](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/e710add9d4d743958a3d21b82b3f220d.html).
126
268
127
269
[DONE]
128
270
[ACCORDION-END]
129
271
130
272
131
-
[ACCORDION-BEGIN [Step 4: ](Post inference result with sap_invoice_header)]
273
+
[ACCORDION-BEGIN [Step 8: ](Enter inference text for sap_invoice_header)]
132
274
133
275
Use the **POST /inference/jobs** endpoint to submit the text to be extracted and choose the pre-trained machine learning model you want to use to extract entities from the text.
134
276
135
277
1. Click the endpoint name to expand it.
136
278
137
279
2. Click **Try it out**.
138
280
139
-
!
281
+
!
140
282
141
283
3. In **payload**, enter the `text` you want to extract named entities from, `modelName`, and `modelVersion`. In this `sap_invoice_header` pre-trained model example, you can use the following:
142
284
@@ -150,33 +292,33 @@ Use the **POST /inference/jobs** endpoint to submit the text to be extracted and
150
292
151
293
4. Click **Execute**.
152
294
153
-
!
295
+
!
154
296
155
297
5. Copy the **`id`** from the **Response body** to see the result of the extraction in the next step.
156
298
157
-
!
299
+
!
158
300
159
301
[DONE]
160
302
[ACCORDION-END]
161
303
162
304
163
-
[ACCORDION-BEGIN [Step 5: ](Get inference result with sap_invoice_header)]
305
+
[ACCORDION-BEGIN [Step 9: ](Get inference response from sap_invoice_header)]
164
306
165
307
Use the **GET /inference/jobs/{`jobId`}** endpoint to see the text extraction results and the confidence level of the `sap_invoice_header` model.
166
308
167
309
1. Click the endpoint name to expand it.
168
310
169
311
2. Click **Try it out**.
170
312
171
-
!
313
+
!
172
314
173
315
3. Enter the `jobId` obtained in the previous step and click **Execute**.
174
316
175
-
!
317
+
!
176
318
177
319
You should receive a response like the following:
178
320
179
-
!
321
+
!
180
322
181
323
You have now successfully used the `sap_invoice_header` model to get text entity predictions for the unstructured text you submitted to Business Entity Recognition.
182
324
@@ -190,7 +332,7 @@ You can also use the following **payload** example with the `sap_invoice_header`
190
332
}
191
333
```
192
334
193
-
To try out the `sap_invoice_header` model with your own unstructured text, keep in mind the model scope and supported languages, as detailed in [Extracted Entities by Pre-trained Model](https://help.sap.com/viewer/b43f8f61368d455793a241d2b10baeb2/SHIP/en-US/7eb1408001564d679adcd3bc4796800f.html).
335
+
To try out the `sap_invoice_header` model with your own unstructured text, keep in mind the model scope and supported languages, as detailed in [`sap_invoice_header`](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/cb6a6a5b1ad94096a6e1060460d9fcd8.html) and [Supported Languages](https://help.sap.com/docs/Business_Entity_Recognition/b43f8f61368d455793a241d2b10baeb2/e710add9d4d743958a3d21b82b3f220d.html).
194
336
195
337
Congratulations, you have completed this tutorial.
0 commit comments