You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- If you don't have a trial account yet, sign up [here](https://www.sap.com/cmp/td/sap-hana-cloud-trial.html).
15
15
16
16
## You will learn
17
-
- What the components Data Lake, IQ and Data Lake Files are
17
+
- What the components Data Lake, Data Lake Relational Engine and Data Lake Files are
18
18
- How to differentiate between managed and standalone data lakes
19
19
- How to provision a standalone data lake
20
20
- How to change the storage capacity of data lake instances
21
21
---
22
22
23
23
### Introduction to SAP HANA Cloud, data lake
24
24
25
-
SAP HANA Cloud, data lake is one of the components that make up SAP HANA Cloud. It's composed of two different components, the **Data Lake, IQ** and **Data Lake Files**. The Data Lake, IQ enables efficient storage and high-performance analytics of relational data at petabyte scale. It leverages the technology of SAP IQ, which many customers already know from the on-premise world.
25
+
SAP HANA Cloud, data lake is one of the components that make up SAP HANA Cloud. It's composed of two different components, the **Data Lake Relational Engine** and **Data Lake Files**.
26
26
27
27
With SAP HANA Cloud, data lake, you can ingest data from multiple sources, as well as non-SAP cloud storage providers, at high speed. It's an integrated part of SAP HANA Cloud, providing common security mechanisms, tenancy models, and tools operating within SAP HANA Cloud.
28
28
29
29
SAP HANA Cloud, data lake was built to be scalable and accommodate increases in data volume, in user count, and the complexity of workloads. This tutorial will focus on using SAP HANA Cloud, data lake as a standalone component of SAP HANA Cloud.
30
30
31
-
<!-- border -->
31
+

32
32
33
33
34
-
### Data Lake, IQ and Data Lake Files
34
+
### Data Lake, Data Lake Relational Engine and Data Lake Files
35
35
36
36
The two main components of SAP HANA Cloud, data lake are:
37
37
38
38
39
-
1.**Data Lake, IQ**: Data Lake, IQ is an efficient disk-optimized relational store, based on SAP IQ on-premise. It's enabled by default when you provision a data lake instance, whether it's standalone or managed by an SAP HANA database instance within SAP HANA Cloud.
39
+
1.**Data Lake Relational Engine**: Data Lake Relational Engine enables efficient storage of structured data and high-performance analytics of relational data at petabyte scale. It's enabled by default when you provision a data lake instance, whether it's standalone or managed by an SAP HANA database instance within SAP HANA Cloud.
40
40
41
41
2.**Data Lake Files**: Data Lake Files service provides a secure, managed object storage to host structured, semi-structured and unstructured data files. You can query files in a relational format stored in data lake files by using the Data Lake's **SQL on Files** feature. This allows you to analyze the data with a low-cost strategy, given that this data has an unknown value. It is also easy to share this data with other processing tools. It's enabled by default when you provision a data lake instance, whether it's a standalone or managed by an SAP HANA database instance.
42
42
43
43
The Data Lake Files component is currently not available in the free tier model or trial.
44
44
45
45
46
-
47
-
48
46
### How to use a data lake
49
47
50
48
SAP HANA Cloud, data lake can be provisioned and used in two different ways:
51
49
52
50
53
-
-**Managed data lake**: the data lake is provisioned as part of the SAP HANA Cloud, SAP HANA database provisioning. A remote connection between the SAP HANA database and the Data Lake, IQ is then automatically created. The easiest way to access the data in a managed data lake is to use SAP HANA virtual tables using the SAP HANA Database Explorer. You can, however, also access the data lake independently.
51
+
-**Managed data lake**: the data lake is provisioned as part of the SAP HANA Cloud, SAP HANA database provisioning. A remote connection between the SAP HANA database and the data lake Relational Engine is then automatically created. The easiest way to access the data in a managed data lake is to use SAP HANA virtual tables using the SAP HANA Database Explorer. You can, however, also access the data lake independently.
54
52
55
53
-**Standalone data lake**: the data lake is provisioned independently of any other SAP HANA Cloud services, and therefore it is not automatically connected to any other SAP HANA Cloud instances you might have. You can access your data within the data lake with SAP HANA Database Explorer, dbisql, isql, or any of the supported data lake client interfaces.
56
54
@@ -73,15 +71,15 @@ To create a standalone data lake instance in SAP HANA Cloud,
73
71
74
72
4. Click on **Create**, then on **Data Lake**.
75
73
76
-
<!-- border -->
74
+

77
75
78
76
5. A new tab will open after finishing the last step - the **SAP HANA Cloud Central** provisioning wizard.
79
77
80
78
6. Here in **Step 1** you must choose the **Type** of instance to create **SAP HANA Cloud, Data Lake** instance.
81
79
82
80
7. Click on **Next Step**.
83
81
84
-
<!-- border -->
82
+

85
83
86
84
87
85
### Describe the instance
@@ -94,12 +92,13 @@ Here you will be configuring the general preferences.
94
92
95
93
2. You can insert a description of this instance on the **Description** field.
96
94
97
-
<!-- border -->
95
+

98
96
99
97
3. Next, choose which connections are allowed to access your data lake instance. That means choosing if you allow access to your instance from outside of the SAP Business Technology Platform.
100
98
101
99
> You can either limit it to SAP Business Technology Platform by denying all IP addresses, or allow specific applications to access it by inserting one or more specific IP addresses. Finally, you can allow all connections from all IP addresses.
102
100
101
+

103
102
104
103
4. Click on **Next Step** on the left-hand side of the wizard.
105
104
@@ -108,14 +107,14 @@ Here you will be configuring the general preferences.
108
107
### Define storage settings
109
108
110
109
111
-
In this step, you can choose to activate the Data Lake, IQ component. Once you enable the option, you will see more options to customize the data lake.
110
+
In this step, you can choose to enable the data lake Relational Engine component. Once you enable the option, you will see more options to customize the data lake.
112
111
113
112
114
-
1. Click on the toggle button to **Enable** the Data Lake, IQ component.
113
+
1. Click on the toggle button to **Enable** the data lake Relational Engine component.
115
114
116
115
2. Insert a password in the **Administrator Password** field. Please make sure to use a strong password. This password will be associated with the automatically generated HDLADMIN user, which has full powers within your data lake, so make sure not to forget it.
3. Confirm it by typing it again on the **Confirm Administrator Password** field.
121
120
@@ -128,17 +127,17 @@ In this step, you can choose to activate the Data Lake, IQ component. Once you e
128
127
7. Click on **Next Step** to continue.
129
128
130
129
131
-
### Define advanced data lake IQ settings
130
+
### Define advanced data lake Relational Engine settings
132
131
133
132
1. Now you need to choose the initialization mode, which is whether your standalone data lake will be more compatible with SAP HANA or with SAP IQ.
134
133
135
-
<!-- border -->
134
+

136
135
137
136
>
138
137
>The right choice of compatibility depends on how you wish to use your data lake. If most of your use will be associated with SAP HANA, then choose that option. On the other hand, if you wish to move data from SAP IQ, then you should choose that option.
2. If you choose compatibility with SAP IQ, then you can also choose the **Collation**.
144
143
@@ -148,7 +147,7 @@ In this step, you can choose to activate the Data Lake, IQ component. Once you e
148
147
149
148
5. Click on **Review and Create** and you are done! Your first standalone data lake will be created, and you can monitor its status to see when it will be ready to be used. This process usually takes a few minutes.
@@ -161,13 +160,12 @@ To resize your data lake, follow these steps:
161
160
162
161
1. In the SAP HANA Cloud Central, locate your existing data lake.
163
162
164
-
2. Click on the three dots button on the right side of the same line to open the menu.
163
+
2. Click on the three dots button on the right side of the same line to open the menu and then click on **Manage Configuration**.
165
164
166
-
3. Click on **Edit**.
165
+
3. Click on **Edit** in the top right corner.
167
166
168
167
4. The editing wizard will open and show you the options currently available.
169
168
170
-
171
169
By changing storage capacity, the instance will be forced to restart if it was previously running. When changing compute size, single-worker-node systems will require a restart. Multi-worker-node systems will require a restart when the worker-node's size changes, but do not require a restart when the number of workers changes if the size per worker-node is held constant.
172
170
173
171
>**Storage service level and the additional settings found under the initialization section cannot be modified after provisioning and must be configured appropriately at the time when the data lake is created.**
@@ -179,7 +177,4 @@ To resize your data lake, follow these steps:
Copy file name to clipboardExpand all lines: tutorials/hana-cloud-hdl-getting-started-3/hana-cloud-hdl-getting-started-3.md
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -163,7 +163,7 @@ Let's get started. Follow these steps:
163
163
164
164
165
165
166
-
>**Attention**: You should make a slight adjustment in the above query if you have provisioned the Data Lake, IQ instance in maximum compatibility mode with SAP HANA Cloud, SAP HANA database. This mode does not support **CHAR** data type. Instead, you can alter the query by using **VARCHAR** data type.
166
+
>**Attention**: You should make a slight adjustment in the above query if you have provisioned the data lake Relational Engine instance in maximum compatibility mode with SAP HANA Cloud, SAP HANA database. This mode does not support **CHAR** data type. Instead, you can alter the query by using **VARCHAR** data type.
167
167
>
168
168
>For more information on database compatibility modes, please see our [technical documentation](https://help.sap.com/viewer/a896c6a184f21015b5bcf4c7a967df07/LATEST/en-US/82cdda1398644f4a95ec402f3144bcea.html).
169
169
@@ -258,7 +258,7 @@ Let's get started. Follow these steps:
258
258
259
259
```
260
260
261
-
>**Attention**: You should make a slight adjustment in the above query if you have provisioned the Data Lake, IQ instance in maximum compatibility mode with SAP HANA Cloud, SAP HANA database. This mode does not support **CHAR** data type. Instead, you can alter the query by using **VARCHAR** data type.
261
+
>**Attention**: You should make a slight adjustment in the above query if you have provisioned the data lake Relational Engine instance in maximum compatibility mode with SAP HANA Cloud, SAP HANA database. This mode does not support **CHAR** data type. Instead, you can alter the query by using **VARCHAR** data type.
262
262
>
263
263
>For more information on database compatibility modes, please see our [technical documentation](https://help.sap.com/viewer/a896c6a184f21015b5bcf4c7a967df07/LATEST/en-US/82cdda1398644f4a95ec402f3144bcea.html).
Copy file name to clipboardExpand all lines: tutorials/hana-cloud-hdl-getting-started-4/hana-cloud-hdl-getting-started-4.md
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -42,7 +42,7 @@ Let's see in detail the procedures to access different monitoring views.
42
42
43
43
### Explore workload monitoring using SAP HANA Database Explorer
44
44
45
-
Using **SAP HANA Database Explorer** connected to your data lake, you can display a menu with list of all available Data Lake, IQ monitoring views. This can be done by running the command in the SQL Console:
45
+
Using **SAP HANA Database Explorer** connected to your data lake, you can display a menu with a list of all available data lake Relational Engine monitoring views. This can be done by running the command in the SQL Console:
46
46
47
47
```SQL
48
48
SELECT*FROM IQMONVIEWS
@@ -97,7 +97,7 @@ Similarly, you can go to the SAP HANA Cloud Central when the remaining storage s
97
97
98
98
### Differentiate between sp_iqsysmon and monitoring views
99
99
100
-
The monitoring views and **`sp_iqsysmon`** are intended for very different reporting timescales. The **`sp_iqsysmon`** is a system stored procedure that allows you to define the time interval for monitoring using **Start** and **Stop** parameters. Data lake, IQ continuously monitors performance and displays the latest performance data on the monitoring views. Rather than monitoring over a defined period, monitoring views start gathering performance metrics at server startup and reports the current state of the system.
100
+
The monitoring views and **`sp_iqsysmon`** are intended for very different reporting timescales. The **`sp_iqsysmon`** is a system stored procedure that allows you to define the time interval for monitoring using **Start** and **Stop** parameters. Data lake Relational Engine continuously monitors performance and displays the latest performance data on the monitoring views. Rather than monitoring over a defined period, monitoring views start gathering performance metrics at server startup and reports the current state of the system.
101
101
>For example, you can monitor your system at a 30-second time interval for two hours using **`sp_iqsysmon`**. On the other hand, monitoring views provide a current snapshot of system heath and performance metrics.
102
102
103
103
It is beneficial to monitor changes in performance over time and this can be achieved by regularly checking the monitoring views at regular intervals. Any metrics moving out of their normal ranges should be evaluated.
>In this tutorial, you have learned about the backup and recovery process of your database using SAP HANA Cloud, data lake. Make sure to take note of the frequency of the backups, their time of occurrence and the process for recovery.
@@ -93,5 +93,4 @@ For more learning materials on **SAP HANA Cloud**, [click here](https://communit
0 commit comments