We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Chemical Engineering/Impact of Discretization Noise of the Dependent variable on Machine Learning Classifiers in Software Engineering
PeriodicalsChemical Engineering

Impact of Discretization Noise of the Dependent variable on Machine Learning Classifiers in Software Engineering

arXiv2022

Checking your access to this record.

Abstract & Overview

Researchers usually discretize a continuous dependent variable into two target classes by introducing an artificial discretization threshold (e.g., median). However, such discretization may introduce noise (i.e., discretization noise) due to ambiguous class loyalty of data points that are close to the artificial threshold. Previous studies do not provide a clear directive on the impact of discretization noise on the classifiers and how to handle such noise. In this paper, we propose a framework to help researchers and practitioners systematically estimate the impact of discretization noise on classifiers in terms of its impact on various performance measures and the interpretation of classifiers. Through a case study of 7 software engineering datasets, we find that: 1) discretization noise affects the different performance measures of a classifier differently for different datasets; 2) Though the interpretation of the classifiers are impacted by the discretization noise on the whole, the top 3 most important features are not affected by the discretization noise. Therefore, we suggest that practitioners and researchers use our framework to understand the impact of discretization noise on the performance of their built classifiers and estimate the exact amount of discretization noise to be discarded from the dataset to avoid the negative impact of such noise.

Cite this record

Gopi Krishnan Rajbahadur, Shaowei Wang, Yasutaka Kamei, Ahmed E. Hassan (2022). Impact of Discretization Noise of the Dependent variable on Machine Learning Classifiers in Software Engineering. arXiv. https://library.shubhaarti.com/content/13dee54c-33f5-4509-8c7f-e2887ddb0a54

Copy in another style

Rajbahadur, G. K., Wang, S., Kamei, Y., & Hassan, A. E. (2022). Impact of Discretization Noise of the Dependent variable on Machine Learning Classifiers in Software Engineering. arXiv. https://library.shubhaarti.com/content/13dee54c-33f5-4509-8c7f-e2887ddb0a54
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.