Building semi-supervised decision trees with semi-cart algorithm

Allbwn ymchwil: Cyfraniad at gyfnodolynErthygladolygiad gan gymheiriaid

Fersiynau electronig

Dogfennau

Dangosydd eitem ddigidol (DOI)

Decision trees are a fundamental statistical learning tool for addressing classification and regression problems through a recursive partitioning approach that effectively accommodates numerical and categorical data [1, 2]. The Classification and regression tree (CART) algorithm underlies modern Boosting methodologies such as Gradient boosting machine (GBM), Extreme gradient boosting (XGBoost), and Light gradient boosting machine (LightGBM). However, the standard CART algorithm may require improvement due to its inability to learn from unlabeled data. This study proposes several modifications to incorporate test data into the training phase. Specifically, we introduce a method based on Graph-based semi-supervised learning called “Distance-based Weighting,” which calculates and removes irrelevant records from the training set to accelerate the training process and improve performance. We present Semi-supervised classification and regression tree (Semi-Cart), a new implementation of CART that constructs a decision tree using weighted training data. We evaluated its performance on thirteen datasets from various domains. Our results demonstrate that Semi-Cart outperforms standard CART methods and contributes to statistical learning.
Iaith wreiddiolSaesneg
Tudalennau (o-i)4493-4510
Nifer y tudalennau18
CyfnodolynInternational Journal of Machine Learning and Cybernetics
Cyfrol15
Rhif y cyfnodolyn10
Dyddiad ar-lein cynnar24 Ebr 2024
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 1 Hyd 2024
Gweld graff cysylltiadau