We are happy to start new exciting category of our blog - Business Intelligence articles.
After a list of successfully designed and implemented BI solutions I want to share our experience and note all complex moments and issues that we have been faced.
Business Intelligence (BI) - the set of techniques and tools for data transformation into useful information for business analysis purposes.
In this article I want to share our experience with ETL (Extract, Transform and Load) optimization.
Extract, Transform, Load (ETL) - is the base for a data warehousing, these 3 processes manage any data warehouse. Extract - acquire data from data sources, Transform - change data in the proper format, Load - push data to final target (data mart, data warehouse).
We were designing and implementing BI solution for insurance brokerage company Willis Towers Watson.
It was common BI architecture following all general rules: