We will review BI architecture for more details and keep delving into the details of BI solution with a list of interesting BI architecture designs that we want to share.
In our previous post we have described optimization of the ETL process in one of our BI solutions for leading insurance brokerage company. In that article we have slightly covered a subject of Business Intelligence architecture. So here are more details:
We are implementing big enterprise solution with a large amount of member for one of our customers – currently this is around 400 000 members in the system and it started to grow very fast since we started to upload more and more customers to the system. One of the very next tasks – were to build up to date Reports that will provide different statistics and reports.
For example – Total premium report, Gender report (Count of Males and Females in system), New Employee Additions to the system Report and so on.
Calculate all that numbers and reports in real time once user will go to Report section – will be slow operation and it will use SQL Server very hard. As per specification – no need to calculate it in real time and this is Ok if we will provide a report with system state actual to the previous date. We decided to implement BI reports.
We received very good specification (Reports Specification) and started think how to implement BI architecture in the best way:
We are happy to start new exciting category of our blog - Business Intelligence articles.
After a list of successfully designed and implemented BI solutions I want to share our experience and note all complex moments and issues that we have been faced.
Business Intelligence (BI) - the set of techniques and tools for data transformation into useful information for business analysis purposes.
In this article I want to share our experience with ETL (Extract, Transform and Load) optimization.
Extract, Transform, Load (ETL) - is the base for a data warehousing, these 3 processes manage any data warehouse. Extract - acquire data from data sources, Transform - change data in the proper format, Load - push data to final target (data mart, data warehouse).
We were designing and implementing BI solution for insurance brokerage company Willis Towers Watson.
It was common BI architecture following all general rules: