Operational data store is a part of data warehouse. This is maintained only current transactional data. ODS is subject oriented, integrated, volatile, current data.
Tuesday, 24 June 2014
Difference between OLTP and OLAP?
OLTP : IT is a Online Transaction Processing. This is maintained current transactional data. That means insert, update and delete must be fast.
OLAP(On-line Analytical Processing)): It deals with Historical Data or Archival Data. Historical data are those data that are archived over a long period of time.
Data from OLTP are collected over a period of time and store it in a very large database called Data warehouse.
Monday, 23 June 2014
Type's of ETL's Used to Implementing Data Acquisition ?
There are 2 types of ETL's Used to implement Data Acquisition.
1.Code Base.
2.GUI Based ETL.
1.Code based ETL:
An ETL application can be developed using some programming language such as SQL ,PL/SQL.
Ex:- a.Oracle sql loader
b.Sas based
c.Sas access
d.Tera Data load utilities
BTDQ(batch tera data query)
Fast load
Multi load
Fast export
etc.....
2. GUI Based ETL:(we used such method in informatica)
An ETL Application can be designed using simple graphically use interface ,Point & Technology.
Ex:-a. Informatica(informatica corporation)
b.Data storage(IBM Corp.)
c.Data service(SAP)
d.SSIS(Microsoft)-SQL Server Integration Services (SSIS)
1.Code Base.
2.GUI Based ETL.
1.Code based ETL:
An ETL application can be developed using some programming language such as SQL ,PL/SQL.
Ex:- a.Oracle sql loader
b.Sas based
c.Sas access
d.Tera Data load utilities
BTDQ(batch tera data query)
Fast load
Multi load
Fast export
etc.....
2. GUI Based ETL:(we used such method in informatica)
An ETL Application can be designed using simple graphically use interface ,Point & Technology.
Ex:-a. Informatica(informatica corporation)
b.Data storage(IBM Corp.)
c.Data service(SAP)
d.SSIS(Microsoft)-SQL Server Integration Services (SSIS)
Bill Inmon vs. Ralph Kimball
Kimball -Let everybody build what they want when they want it, we'll integrate it all when and if we need to.(BOTTOM-UP APPROACH).
Pros: fast to build, quick ROI, nimble
Cons: harder to maintain as an enterprise resource, often redundant, often difficult to
integrate data marts.
Inmon - Don't do anything until you've designed everything.(TOP-DOWN APPROACH)
Pros: easy to maitain, tightly integrated
Cons: takes way too long to deliver first projects, rigid
Pros: fast to build, quick ROI, nimble
Cons: harder to maintain as an enterprise resource, often redundant, often difficult to
integrate data marts.
Inmon - Don't do anything until you've designed everything.(TOP-DOWN APPROACH)
Pros: easy to maitain, tightly integrated
Cons: takes way too long to deliver first projects, rigid
There is no right or wrong between these two ideas, as they represent different data warehousing philosophies. In reality, the data warehouse systems in most enterprises are closer to Ralph Kimball's idea. This is because most data warehouses started out as a departmental effort, and hence they originated as a data mart. Only when more data marts are built later do they evolve into a data warehouse.
What is Data mart?
A subset of data warehouse is called Data mart.
Types:
A. Dependent data mart :It gets data from datawarehouse.
B. Independent data mart:it does not get data from datawrehouse.
Difference between data warehouse and an operational database ?
operational database:
1.It is designed to support business transnational processing.
2. Data is volatile .
3.Current Data .
4. Design for Running the business .
5. Normalization .
6. More joins .
Data warehouse :
1.It is designed to support Decision Making process.2. Data is Non-volatile .
3.Historical Data .
4. Design for Analyzing the business .
5. De-Normalization .
6. Few joins .
What is Data warehousing ?
Data warehousing concepts (FAQ’s)
1) What is Data warehouse?
Data warehouse is relational database used for query analysis and reporting. By definition data warehouse is Subject-oriented, Integrated, Non-volatile, Time variant.
Subject oriented : Data warehouse is maintained particular subject.like HR,Sales,Loan ,etc.
Integrated : Data collected from multiple sources integrated into a
user readable unique format.
Non volatile : Maintain Historical date.
Time variant : data display the weekly, monthly, yearly.
1) What is Data warehouse?
Data warehouse is relational database used for query analysis and reporting. By definition data warehouse is Subject-oriented, Integrated, Non-volatile, Time variant.
Subject oriented : Data warehouse is maintained particular subject.like HR,Sales,Loan ,etc.
Integrated : Data collected from multiple sources integrated into a
user readable unique format.
Non volatile : Maintain Historical date.
Time variant : data display the weekly, monthly, yearly.
Subscribe to:
Posts (Atom)