Effects of Change Propagation Resulting from Adaptive Preprocessing in Multicomponent Predictive Systems

Authors: Salvador, M.M., Budka, M. and Gabrys, B.

Journal: Procedia Computer Science

Volume: 96

Pages: 713-722

eISSN: 1877-0509

DOI: 10.1016/j.procs.2016.08.255

Abstract:

Predictive modelling is a complex process that requires a number of steps to transform raw data into predictions. Preprocessing of the input data is a key step in such process, and the selection of proper preprocessing methods is often a labour intensive task. Such methods are usually trained offline and their parameters remain fixed during the whole model deployment lifetime. However, preprocessing of non-stationary data streams is more challenging since the lack of adaptation of such preprocessing methods may degrade system performance. In addition, dependencies between different predictive system components make the adaptation process more challenging. In this paper we discuss the effects of change propagation resulting from using adaptive preprocessing in a Multicomponent Predictive System (MCPS). To highlight various issues we present four scenarios with different levels of adaptation. A number of experiments have been performed with a range of datasets to compare the prediction error in all four scenarios. Results show that well managed adaptation considerably improves the prediction performance. However, the model can become inconsistent if adaptation in one component is not correctly propagated throughout the rest of system components. Sometimes, such inconsistency may not cause an obvious deterioration in the system performance, therefore being difficult to detect. In some other cases it may even lead to a system failure as was observed in our experiments.

https://eprints.bournemouth.ac.uk/24111/

Source: Scopus

Effects of change propagation resulting from adaptive preprocessing in multicomponent predictive systems

Authors: Salvador, M.M., Budka, M. and Gabrys, B.

Journal: KNOWLEDGE-BASED AND INTELLIGENT INFORMATION & ENGINEERING SYSTEMS: PROCEEDINGS OF THE 20TH INTERNATIONAL CONFERENCE KES-2016

Volume: 96

Pages: 713-722

ISSN: 1877-0509

DOI: 10.1016/j.procs.2016.08.255

https://eprints.bournemouth.ac.uk/24111/

Source: Web of Science (Lite)

Effects of change propagation resulting from adaptive preprocessing in multicomponent predictive systems

Authors: Salvador, Budka, M. and Gabrys, B.

Abstract:

Predictive modelling is a complex process that requires a number of steps to transform raw data into predictions. Preprocessing of the input data is a key step in such process, and the selection of proper preprocessing methods is often a labour intensive task. Such methods are usually trained offline and their parameters remain fixed during the whole model deployment lifetime. However, preprocessing of non-stationary data streams is more challenging since the lack of adaptation of such preprocessing methods may degrade system performance. In addition, dependencies between different predictive system components make the adaptation process more challenging. In this paper we discuss the effects of change propagation resulting from using adaptive preprocessing in a Multicomponent Predictive System (MCPS). To highlight various issues we present four scenarios with different levels of adaptation. A number of experiments have been performed with a range of datasets to compare the prediction error in all four scenarios. Results show that well managed adaptation considerably improves the prediction performance. However, the model can become inconsistent if adaptation in one component is not correctly propagated throughout the rest of system components. Sometimes, such inconsistency may not cause an obvious deterioration in the system performance, therefore being difficult to detect. In some other cases it may even lead to a system failure as was observed in our experiments.

https://eprints.bournemouth.ac.uk/24111/

Source: Manual

Effects of change propagation resulting from adaptive preprocessing in multicomponent predictive systems

Authors: Salvador, M., Budka, M. and Gabrys, B.

Journal: Procedia Computer Science

Publisher: Elsevier: Creative Commons Attribution Non-Commercial No-Derivatives License

ISSN: 1877-0509

Abstract:

Predictive modelling is a complex process that requires a number of steps to transform raw data into predictions. Preprocessing of the input data is a key step in such process, and the selection of proper preprocessing methods is often a labour intensive task. Such methods are usually trained offline and their parameters remain fixed during the whole model deployment lifetime. However, preprocessing of non-stationary data streams is more challenging since the lack of adaptation of such preprocessing methods may degrade system performance. In addition, dependencies between different predictive system components make the adaptation process more challenging. In this paper we discuss the effects of change propagation resulting from using adaptive preprocessing in a Multicomponent Predictive System (MCPS). To highlight various issues we present four scenarios with different levels of adaptation. A number of experiments have been performed with a range of datasets to compare the prediction error in all four scenarios. Results show that well managed adaptation considerably improves the prediction performance. However, the model can become inconsistent if adaptation in one component is not correctly propagated throughout the rest of system components. Sometimes, such inconsistency may not cause an obvious deterioration in the system performance, therefore being difficult to detect. In some other cases it may even lead to a system failure as was observed in our experiments.

https://eprints.bournemouth.ac.uk/24111/

Source: Manual

Effects of Change Propagation Resulting from Adaptive Preprocessing in Multicomponent Predictive Systems.

Authors: Salvador, M.M., Budka, M. and Gabrys, B.

Editors: Howlett, R.J., Jain, L.C., Toro, C. and Lim, C.P.

Journal: KES

Volume: 96

Pages: 713-722

Publisher: Elsevier

https://eprints.bournemouth.ac.uk/24111/

https://www.sciencedirect.com/science/journal/18770509/96

Source: DBLP

Effects of change propagation resulting from adaptive preprocessing in multicomponent predictive systems

Authors: Salvador, M.M., Budka, M. and Gabrys, B.

Abstract:

Predictive modelling is a complex process that requires a number of steps to transform raw data into predictions. Preprocessing of the input data is a key step in such process, and the selection of proper preprocessing methods is often a labour intensive task. Such methods are usually trained offline and their parameters remain fixed during the whole model deployment lifetime. However, preprocessing of non-stationary data streams is more challenging since the lack of adaptation of such preprocessing methods may degrade system performance. In addition, dependencies between different predictive system components make the adaptation process more challenging. In this paper we discuss the effects of change propagation resulting from using adaptive preprocessing in a Multicomponent Predictive System (MCPS). To highlight various issues we present four scenarios with different levels of adaptation. A number of experiments have been performed with a range of datasets to compare the prediction error in all four scenarios. Results show that well managed adaptation considerably improves the prediction performance. However, the model can become inconsistent if adaptation in one component is not correctly propagated throughout the rest of system components. Sometimes, such inconsistency may not cause an obvious deterioration in the system performance, therefore being difficult to detect. In some other cases it may even lead to a system failure as was observed in our experiments.

https://eprints.bournemouth.ac.uk/24111/

http://kes2016.kesinternational.org/

Source: BURO EPrints