June 2015 EnglishEnglish
Stream Intelligence configuration for Web Stream Analysis
(EZ4)
SAP SE
Dietmar-Hopp-Allee 16
69190 Walldorf
Germany / Building Block Configuration Guide
© SAP SE Page 3 of 4
SAP Best Practices Stream Configuration for Web Stream Analysis (EZ4): Configuration Guide
Copyright
© 2015 SAP SE or an SAP affiliate company. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. Please see http://global.sap.com/corporate-en/legal/copyright/index.epx#trademark for additional trademark information and notices.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
Revision / Change Date / Description0 / June 2015 / Initial
Icons
/ Caution
/ Example
/ Note
/ Recommendation
/ Syntax
Typographic Conventions
Type Style / DescriptionExample text / Words or characters that appear on the screen. These include field names, screen titles, pushbuttons as well as menu names, paths and options.
Cross-references to other documentation.
Example text / Emphasized words or phrases in body text, titles of graphics and tables.
EXAMPLE TEXT / Names of elements in the system. These include report names, program names, transaction codes, table names, and individual key words of a programming language, when surrounded by body text, for example, SELECT and INCLUDE.
Example text / Screen output. This includes file and directory names and their paths, messages, source code, names of variables and parameters as well as names of installation, upgrade and database tools.
EXAMPLE TEXT / Keys on the keyboard, for example, function keys (such as F2) or the ENTER key.
Example text / Exact user entry. These are words or characters that you enter in the system exactly as they appear in the documentation.
<Example text> / Variable user entry. Pointed brackets indicate that you replace these words and characters with appropriate entries.
Content
Stream Intelligence Configuration for Web Stream Analysis 7
1 Purpose 7
2 Preparation 7
2.1 Prerequisites 7
2.2 Assumptions 7
3 Configuring Stream Intelligence for Web Stream Analysis 9
3.1 Prepare Prerequisites Tables for SAP HANA content 9
3.1.1 Generate Time Data in SAP HANA 9
3.2 Deploy Stream Intelligence Foundation Delivery Unit - HCO_RDS_BDI_ST_FND 10
3.3 Execute Stream Intelligence Seeding procedure 10
3.4 Deploy the Stream Business Layer Unit - HCO_RDS_BDI_ST 11
3.5 Create Users for Stream Intelligence 11
3.5.1 Creating a Stream Admin User 12
3.5.2 Creating a Stream Viewer User 12
3.6 Import Sample Data Tables via Delivery Unit - HCO_RDS_BDI_ST_SAMPLE 12
3.6.1 Optional Customization of Sample Data: 13
3.6.2 Stream Intelligence Configuration Settings 14
3.7 Configure Master Data Table 17
LKUP_M_DATA_CF 17
3.8 Configure ALERT_TYPE Table - ALERT_TYPE 20
3.9 Optional: Sample SAP ESP Data 20
3.10 Optional: Additional Customization of ESP sample Data 21
4 Hadoop Configuration (Optional) 23
4.1 Generate HIVE database and tables 23
4.2 Smart Data Access Configuration 23
4.2.1 Add a remote source 24
4.2.2 Access the virtual table 24
4.2.3 Replace SAP HANA table with HIVE virtual table 25
5 Manual Data Cleanse (Optional) 26
6 Schedule Data Cleanse Jobs (Optional) 27
6.1 XSJobs 27
6.2 Enable Job-Scheduling in SAP HANA 28
6.3 Customize Scheduling Configuration 28
6.4 Maintain XS Job Details 29
7 Additional SAP HANA Services settings (Optional) 31
7.1.1 Enable e-mail support (optional) 31
7.1.2 Create a trust store (optional, for SSL) 31
7.1.3 Configure the HTTP destination 31
7.1.4 Enable the notification checks 31
8 Appendix 33
8.1 SAP HANA Models in Delivery Unit 33
8.2 Reports 33
8.3 Database Tables 33
8.4 Attribute Views 34
8.5 Analytic Views 34
8.6 Calculation Views 35
8.7 Storage Procedures (.hdbprocedure) 35
8.8 Roles (.hdbrole) 35
8.9 Jobs (.xsjob) 35
8.10 Sample data for Database Tables 36
8.10.1 DIM_HOST_CLIENT 37
8.10.2 DIM_SERVER 37
sap.rds-bdi.stream.model.rep::tables.DIM_SERVER 37
8.10.3 DIM_USER 38
sap.rds-bdi.stream.model.rep::tables.DIM_USER 38
8.10.4 LKUP_DURA_BANDING 39
sap.rds-bdi.stream.model.rep::tables.LKUP_DURA_BANDING 39
8.10.5 LKUP_FILE_TYPE 40
sap.rds-bdi.stream.model.rep::tables.LKUP_FILE_TYPE 40
8.10.6 LKUP_GEO 40
8.10.7 LKUP_STATUS_CODE 40
8.10.8 ALERT_TYPE 41
8.10.9 HIS_DATA_MGMT_CF 41
8.10.10 LKUP_M_DATA_CF 42
sap.rds-bdi.stream.model.rep::tables.LKUP_M_DATA_CF 42
8.10.11 LOG_FILE_INFO 42
9 Appendix: Additional Resources 44
9.1.1 SAP HANA Guides 44
9.1.2 Important SAP HANA Security Notes 44
9.1.3 SAP Event Stream Processor (SAP ESP) 44
© SAP SE Public Page 8 of 44
SAP Best Practices Stream Configuration for Web Stream Analysis (EZ4): Configuration Guide
Stream Intelligence Configuration for Web Stream Analysis
1 Purpose
The purpose of this document is to describe the general configuration steps required to manually set up the Stream intelligence configuration for Web steam analysis. The configuration steps are within the system landscape you have already installed using the corresponding installation or configuration guides for installation.
2 Preparation
2.1 Prerequisites
Before you start installing this scenario, your system landscape must meet the prerequisites for the scope item. For more information about prerequisites, see the SAP Note 1956985 and the Configuration Guide: Getting Started for Stream Intelligence attached to that note.
The SAP Note and the Prerequisite Matrix document are available on the SAP Service Marketplace for rapid-deployment solutions, http://service.sap.com/rds-bdi → SAP HANA Big Data Intelligence rapid-deployment solution → Find Out More → Latest Information
2.2 Assumptions
The following statements are the configuration assumptions for setting up SAP HANA technical components for this solution, the following configuration must be fulfilled for this solution to be implemented.
1) SAP HANA platform (both Server and Studio) has been installed within the system landscape. An installed and configured SAP HANA environment is a prerequisite for this rapid-deployment solution. For more information about the installation and configuration of the SAP HANA platform, see the SAP Help Portal http://help.sap.com/hana_platform
2) SYSTEM access with full system privileges for the SAP HANA environment.
3) SAP HANA related implementation contents for the solution, including Application Function Library (AFL)
4) SAP HANA Predictive Analysis Library (PAL) To confirm that the PAL functions were installed successfully, you can check the following three public views:
•sys.afl_areas
•sys.afl_packages
•sys.afl_functions
These views are granted to the PUBLIC role and can be accessed by anyone.
To check the views, run the SQL statements:
SELECT * FROM "SYS"."AFL_AREAS" WHERE AREA_NAME = 'AFLPAL';
SELECT * FROM "SYS"."AFL_PACKAGES" WHERE AREA_NAME = 'AFLPAL';
SELECT * FROM "SYS"."AFL_FUNCTIONS" WHERE AREA_NAME = 'AFLPAL';
The result indicates whether the PAL functions are successfully installed on your system
In addition, ensure that the following permissions are in place:
_SYS_REPO user has been assigned EXECUTE rights for the following procedures:
· "SYSTEM"."AFL_WRAPPER_GENERATOR"
· "SYSTEM"."AFL_WRAPPER_ERASER"
If those rights have not been applied, then modify _SYS_REPO user to grant those rights.
For more information about SAP HANA Predictive Analysis Library (PAL) functions, see the SAP Help Portal http://help.sap.com/hana_platform → Reference Information → SAP HANA Library References → SAP HANA Predictive Analysis Library
3 Configuring Stream Intelligence for Web Stream Analysis
To implement the Stream Intelligence for Web stream analysis scope item of SAP HANA Big Data Intelligence, you must perform the following steps:
1. Prepare SAP HANA prerequisite tables
2. Deploy the configuration delivery unit
3. Deploy the foundation delivery unit
4. Execute the seeding procedure
5. Deploy the business layer delivery unit
6. Create user accounts
7. Import Sample Data
The following subsections describe detail steps required and performed using SAP HANA studio.
3.1 Prepare Prerequisites Tables for SAP HANA content
3.1.1 Generate Time Data in SAP HANA
When using this option you must replicate the standard tables in SAP HANA, these are T005T, T005U, T009, and T009B. If these standard tables are not available, then you will not be able use the Generate Time Data function.
1. In the SAP HANA studio, logon to your SAP HANA SYSTEM using the SYSTEM account.
2. Select the SAP HANA Modeler perspective
3. Choose Help ® Quick View
4. Select Generate Time Data in the Quick View on the right-hand side
5. Choose the System you want to generate data and Choose Next button
6. In Generate Time Data dialog box, enter the following values:
Field / Value /Calendar Type / Gregorian
From Year / <Start Year> (for example, 1990)
To Year / <End Year> (for example, 2015)
Granularity / Second, Minute, Hour, or Day (depending on your requirements)
7. Choose Generate
8. Verify the generated data in the table “_SYS_BI.M_TIME_DIMENSION”. There should be an entry for every DATE_SAP between <Start Year> and <End Year>
3.2 Deploy Stream Intelligence Foundation Delivery Unit - HCO_RDS_BDI_ST_FND
The following steps are used to load the Stream Intelligence foundation delivery unit HCO_RDS_BDI_ST_FND for the solution.
The Stream Intelligence delivery unit can be imported using either Server or Client as source of delivery unit file location. If an import from the server is required, contact your system administrator for the server path. This step must be executed using SYSTEM account.
1. Ensure the HCO_RDS_BDI_ST_FND delivery unit is downloaded into desired location. If it is not available, contact your system administrator.
Instructions for acquiring the foundation delivery unit are provided in the Configuration Guide: Getting Started for Stream Intelligence, attached to SAP Note 1956985.
2. Select the SAP HANA Modeler perspective
3. Choose the Quick Launch window
4. Select the SAP HANA deployment instance (SYSTEM)
5. Choose Import.
6. In the Select dialog box, choose SAP HANA Content ® Delivery Unit,
7. Choose Next.
8. In the Select File dialog box, choose the import location (Client)
9. Browse to the location of HCO_RDS_BDI_ST_FND.tgz, and select the file.
10. Choose Finish to import the content of the delivery unit.
Result
The Job Log shows the status of the package as it loads. If the load is successful, then the status displays Success. Verify the content objects listed in the Appendix are available and activated after importing delivery unit
3.3 Execute Stream Intelligence Seeding procedure
Use
Following steps must be executed to ensure that the solution is configured to work with the SAP HANA PAL.
Procedure
1. Open SQL console
2. Execute the following SQL statements in sequence
call "_SYS_REPO"."GRANT_SCHEMA_PRIVILEGE_ON_ACTIVATED_CONTENT"('EXECUTE', 'SAP_RDS_BDI_STREAM','SYSTEM');
call "_SYS_REPO"."GRANT_SCHEMA_PRIVILEGE_ON_ACTIVATED_CONTENT"('SELECT', 'SAP_RDS_BDI_STREAM','SYSTEM');
call "SAP_RDS_BDI_STREAM"."sap.rds-bdi.stream.seeders::GENERATE_FORECASTSMOOTH_PROCEDURE";
call "SAP_RDS_BDI_STREAM"."sap.rds-bdi.stream.seeders::GENERATE_ACCURACYMEASURES_PROCEDURE";
Result
The STREAM_TS_PRED_INFO_FORECASTSMOOTHING procedure is created in the SAP_RDS_BDI_STREAM catalog area.
3.4 Deploy the Stream Business Layer Unit - HCO_RDS_BDI_ST
The following steps are used to load the Stream Intelligence business layer delivery unit HCO_RDS_BDI_ST for the solution.
The Stream Intelligence business layer delivery unit can be imported using either Server or Client as source of delivery unit file location. If an import from the server is required, contact your system administrator for the server path. This step must be executed using SYSTEM account.
1. Ensure the HCO_RDS_BDI_ST delivery unit is downloaded into desired location. If it is not available, contact your system administrator.
Instructions for acquiring the business delivery unit are provided in the Configuration Guide: Getting Started for Stream Intelligence, attached to SAP Note 1956985.
2. Select the SAP HANA Modeler perspective
3. Choose the Quick Launch window
4. Select the SAP HANA deployment instance (SYSTEM)
5. Choose Import.
6. In the Select dialog box, choose SAP HANA Content ® Delivery Unit
7. Select Next.
8. In the Select file dialog box, browse to the location of HCO_RDS_BDI_ST.tgz and select the file.
9. Choose Finish to import the content of the delivery unit.
The Job Log shows the status of the package as it loads. If the load is successful, then the status displays Success. Verify that the content objects, listed in Appendix, are available and activated after importing delivery unit
3.5 Create Users for Stream Intelligence
The following steps must be performed with the SQL Editor window opened under SYSTEM account. Ensure that the appropriate Client session is set to the following user accounts you create.
The initial password established for following users has a change password requirement at first logon.
3.5.1 Creating a Stream Admin User
The Stream_ Admin user has permission to manage the SAP_RDS_BDI_STREAM_SOURCE schema and SAP_RDS_BDI_STREAM schema, and can perform all administrative tasks for this solution within SAP HANA.
Run the following SQL statements in the SQL Editor to create the STREAM_ADMIN user:
CREATE USER STREAM_ADMIN PASSWORD your initial password>;
CALL "_SYS_REPO"."GRANT_ACTIVATED_ROLE"
('sap.rds-bdi.stream.roles::RDS_BDI_STREAM_ADMIN','STREAM_ADMIN');
CALL "_SYS_REPO"."GRANT_ACTIVATED_ROLE"