Home Data Science What is a data infrastructure?

What is a data infrastructure?

by Yasir Aslam
0 comment

“I want to build a data infrastructure, but I don’t know how to do it.” “I want to know about successful cases of introducing a data infrastructure.” Do you have questions like these? In this article, we will explain the basic knowledge and selection points of the data platform for those who are considering building a data platform. In addition, we will introduce Chiyoda Corporation’s introduction case study regarding problem-solving before and after the introduction of the data infrastructure, so please refer to it.

 

 

What is a data infrastructure?

A data platform is a platform for collecting, accumulating, and analyzing data so that the necessary amount of data can be extracted from various types of big data when necessary.

There are three main types of data infrastructure:

  • data lake
  • data warehouse
  • data mart

data lake

A data lake is a state in which data collected from systems and databases are centrally managed in an unprocessed state (raw data).

data warehouse

A data warehouse is a database that collects and accumulates a large amount of data that is not updated in real time, such as past histories that occurred in business, and makes it easier to analyze.

data mart

A data mart is a database that processes and extracts only the “necessary data” for a specific purpose from the data accumulated in the data warehouse.

Advantages of building a data infrastructure

So far, we have introduced data lakes, data warehouses, and data marts, but what are the benefits of building a data infrastructure?

There are three main advantages of building a data infrastructure.

  • Reduce information management costs
  • Information visualization
  • speedy analysis

Reduce information management costs

By building a data infrastructure and integrating data, “reduction of information management costs” can be expected. Data integration not only enables efficient data analysis, but also centralizes information for easier management and lower costs.

Information visualization

“Visualization of information” becomes more important as the amount of data increases. If information can be visualized, it will be easier to use the data, which will lead to time cost reductions and improved work productivity for users (administrators and business personnel).

speedy analysis

The third advantage of building a data infrastructure is that it enables “speedy analysis.” A wide variety of data is accumulated within companies, but by building a data platform, it is possible to capture and reflect data in real time.

Points for selecting a data infrastructure

Consider the following three points when selecting a data infrastructure.

  • Highly scalable
  • Prevention of personalization
  • Cloud infrastructure

By being aware of the above three points, mismatches such as convenience and functionality will be reduced after the introduction of the data infrastructure.

Highly scalable

The amount of data handled during analysis is increasing year by year, and is expected to continue increasing in the future. Since it is difficult to predict in advance how much server resource is required for the amount of data, it is necessary to choose a more scalable data platform.

Prevention of personalization

Since data analysis and operation require specialized knowledge, it tends to be dependent on individual skills. In order to prevent personalization, it is necessary to take measures such as simplifying operations and creating manuals.

Cloud infrastructure

In order to streamline data and promote system integration, building a cloud infrastructure will become essential in the future. Building a cloud platform has many benefits, such as reducing operating costs and initial investment, and making it easy to back up data.

Cognite Data Fusion, the data platform chosen by many companies

“Cognite Data Fusion” provided by Cognite is an AI platform that integrates data across multiple systems to maximize production and support rapid decision-making in the manufacturing industry .

Case study of Chiyoda Corporation using “Cognite Data Fusion”

We will introduce the background and results of Chiyoda Corporation’s introduction of the data infrastructure system “Cognite Data Fusion” as an example.

Task background

  • It has developed its business centered on EPC (Engineering, Procurement, Construction), and while aiming to expand its business domain to include digital O&M services, it has become clear that many customers have issues with digitalization.
  • Systems and data of customer companies are used for a long time, and the data is siloed.

Achievement

  • Approaching energy and science-related companies and getting a positive impression
  • We plan to increase the number of industries to which we make proposals in Japan.

Autodesk Revit

Autodesk Revit is comprehensive BIM software provided by Autodesk that can be easily used by anyone from designers to engineers. It is designed to cover a wide range of fields, from architectural design, structural design, equipment design to construction, so it can be used in any field. The license fee is approximately 380,000 yen per year, and maintenance services are included in the fee. Pay as you go, so you always have access to the latest upgrades.

ArchiCAD

ArchiCAD is a BIM software developed by Graffitisoft in Hungary for engineers and designers. Users appreciate the excellent UI/UX. Because the software retains the concept of layers, practical work is flexible. Since it specializes in design, it can contain a wealth of basic architectural design information, but it is also characterized by the fact that it does not contain any information related to facilities and structures. The license fee is about 840,000 yen, and the maintenance service costs about 120,000 yen per year. Because it is a one-time purchase, even if the latest version is released, it cannot be used after updating.

GLOOBE

GLOOBE is a BIM product made in Japan by Fukui Computer Architect Co., Ltd., and is expanding its share in the domestic construction market. As a Japanese person, it is very easy to use because it has many functions optimized for Japanese design. We match Japanese building materials and finishing methods, and fully comply with domestic regulations such as the Building Standards Act. The license price is about 650,000 yen for a one-time purchase, and the annual maintenance service costs about 140,000 yen. Because it is a one-time purchase, even if the latest version is released, it cannot be used after updating.

summary

In this article, we have explained the basic knowledge and selection points of the data infrastructure. The main points are summarized again below.

  • Data platforms are “data lakes”, “data warehouses” and “data marts”
  • Advantages of building a data infrastructure: “Reduction of information management costs”, “Visualization of information”, and “Speedy analysis”
  • Key points for selecting a data platform: high scalability, prevention of personalization, and cloud platform
  • Chiyoda Corporation has introduced the data infrastructure “Cognite Data Fusion”

By building a data infrastructure, you can make more effective use of your data. Why don’t you consider building a data infrastructure on this occasion?

You may also like

Leave a Comment