Showing posts with label Data Warehousing Foundation. Show all posts
Showing posts with label Data Warehousing Foundation. Show all posts

Monday, December 31, 2018

Native DataStore object (nDSO)

The nDSO object resides in HANA DB and it was introduced by SAP HANA Data Warehousing Foundation (DWF) to model SAP HANA SQL Data Warehouse systems. It is derived from a BW concept that is now accessible in SQL based warehousing (native DWH). The nDSO object is developed upon the SAP HANA XS advanced application server framework. Similarity to BW means that there are 3 tables generated for the object (active data table, change log or protocol table or delta tablw, new data or inbound queue). The tables are exposed as a CDS (Core Data Services) entities.

The nDSO provides a persistence of data with additional semantics like:

- delta handling (before/after image) to move, aggregate & load delta data containing deleted records
- request management to allow roll-back of data loads
- (selective) deletion of data, single requests or the complete content of a nDSO


There is an integration possible of the nDSO (can be seen as native DWH) and interoperability SAP BW (BW/4HANA). The nDSO can be used as source objects of BW DataSources. Within the HANA the nDSO can be used as the source for a calculation views.

Modeling of the nDSO objects is embedded into SAP Web IDE for SAP HANA using HANA CDS as metadata description language.

More information:
HAN-APP-DWS-DSO (DataStore Object) - SAP support site component

Sunday, December 30, 2018

SAP HANA Data Warehousing Foundation (DWF)

The SAP HANA Data Warehousing Foundation (DWF) is a suite of packaged tools that aims to support large scale SAP HANA use cases like below while leveraging its data management tools:

- HANA Table, Partition and Application Distribution Management in HANA Scale-Out configurations
- Data Temperature Management
- Modeling
- Execute and Monitor

The tools were developed to try to reduce TCO while running HANA. Also to support HANA administrators and data warehouse designers. SAP HANA DW Foundation complements the data warehouse offerings of SAP like BW/4HANA, SAP BW powered by SAP HANA (BoH) and SAP HANA SQL Data Warehouse, HANA Agile Data Mart as well as mixed HANA scenarios.

The DWF product family is shipped within individual Delivery Units. Those delivery units are HCO_HDM (HANA DWF Core), HCO_HDM_DDO (Data Distribution Optimizer), HCO_HDM_DLM (Data Lifecycle Manager) and HDC_HDM (HANA DWF Documentation).

Below are briefly described components of the DWF product suite:


Component                                Description

Native DataStore Object (NDSO)    A semantically rich persistency object within HANA that can be used to manage full and delta data loads. The NDSO has same capabilities as advanced DataStore Object (ADSO) as we know it from BW systems.
Data Warehouse Scheduler (DWS) Allows task chains to be scheduled in HANA developments to define dependency graphs for HANA artifacts. E.g. dependencies between single processes with the focus to provision DWH models.
Data Lifecycle Manager (DLM)        Model aging rules on tables to displace (archive) aged data to HANA extended tables, remote data stores, MultiStore Table, HANA Extension Node, Dynamic Tiering, SAP IQ, Hadoop or SAP Vora in order to optimize the mem­ory footprint of data in HANA.
Data Warehouse Monitor (DWM)     Provides a comprehensive overview about activities going on in DWH such as what is/was scheduled, completed, and failed task chains within a selected HDI con­tainer, data lifecycle manager profiles, as well as an overview over all NDSOs.
Data Distribution Optimizer (DDO)  Is used to plan, adjust and analyze landscape reorganizations for HANA scale-out systems.


More information:
2435452 Release Note SAP HANA Data Warehousing Foundation 2.0
SAP support site components:
          HAN-APP-DWS-DSO (DataStore Object)
HAN-APP-DWS-DWS (Data Warehousing Scheduler)
HAN-APP-DWS-DLM (SAP HANA Data Lifecycle Manager)
          HAN-APP-DWS-DDO (SAP HANA Data Distribution Optimizer)