Data science, machine learning (ML) and artificial intelligence have triggered a real hype in recent years and received a lot of attention in the industry. Machine learning methods are used to increase either the productivity of the users or the interactivity of the application. Numerous data science teams spend their time training machine learning models. However, we observe two types of … [Read more...]

Normalization of a relational data schema (table structure) is the division of attributes (table columns) into several relations (tables) according to the normalization rules (see below) so that a form is created that no longer contains redundancies. A conceptual schema that contains data redundancies can result in changes to the database; it realizes not to change the multiple data contained … [Read more...]

The snowflake scheme is a continuation of the star scheme used in OLAP and data warehousing. With the star schema, the dimension tables are denormalized, which results in better processing speed at the expense of data integrity and storage space. In contrast, the snowflake scheme refines the individual dimension tables by classifying or normalizing them. This branching of the data model creates … [Read more...]

A star schema is a special form of a data model whose goal is not normalization, but optimization for efficient read operations. The main field of application is a data warehouse and OLAP applications. The term star schema comes from the fact that the tables are arranged in a star shape: at the centre is a fact table around which several dimension tables are grouped. A star scheme is usually … [Read more...]

Object-relational mapping (ORM) is a software development technique that allows an application program written in an object-oriented programming language to store its objects in a relational database. The database then appears to the program as an object-oriented database, which facilitates programming. This technique is usually implemented with class libraries, such as Entity Framework for .NET … [Read more...]

In the digital world, where automation and advanced technologies are the new norms, a lot of data is generated. Internet of Things (IoT) devices and smart machines generate industry-specific and real-time data sets that were untapped a decade ago. Forward-looking organizations and businesses are now leveraging these data sets to derive insights and a new form of knowledge that can aid … [Read more...]

ClickHouse is a free column-oriented database software (DBMS) for online analytical processing (OLAP). ClickHouse was developed by the Russian company Yandex for the web analysis service Yandex. ClickHouse allows the analysis of updated data in real-time. This system is developed for high performance. The project was released as free software under the terms of the Apache License in June 2016. … [Read more...]

Data processing (DV) refers to the organized handling of data volumes with the aim of obtaining information about these data volumes or changing these amounts of data. Data is recorded in data sets, processed by humans or machines according to a given procedure and output as a result. Systematic data processing is the basis for statistics, trade, technology, business, science and … [Read more...]

Batch processing is a term used in data processing and refers to the way computer programs work in which the amount of tasks or data provided as input in one or more data sets is processed completely, automatically and usually sequentially. The complementary form of processing is called "dialogue processing". The program processes exactly one operation (a transaction), which is usually initiated … [Read more...]