Have a personal or library account? Click to login
A Novel Drift Detection Algorithm Based on Features’ Importance Analysis in a Data Streams Environment Cover

A Novel Drift Detection Algorithm Based on Features’ Importance Analysis in a Data Streams Environment

Open Access
|Jun 2020

Abstract

The training set consists of many features that influence the classifier in different degrees. Choosing the most important features and rejecting those that do not carry relevant information is of great importance to the operating of the learned model. In the case of data streams, the importance of the features may additionally change over time. Such changes affect the performance of the classifier but can also be an important indicator of occurring concept-drift. In this work, we propose a new algorithm for data streams classification, called Random Forest with Features Importance (RFFI), which uses the measure of features importance as a drift detector. The RFFT algorithm implements solutions inspired by the Random Forest algorithm to the data stream scenarios. The proposed algorithm combines the ability of ensemble methods for handling slow changes in a data stream with a new method for detecting concept drift occurrence. The work contains an experimental analysis of the proposed algorithm, carried out on synthetic and real data.

Language: English
Page range: 287 - 298
Submitted on: Nov 5, 2019
Accepted on: May 18, 2020
Published on: Jun 15, 2020
Published by: SAN University
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2020 Piotr Duda, Krzysztof Przybyszewski, Lipo Wang, published by SAN University
This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.