DABaCLT: A Data Augmentation Bias-Aware Contrastive Learning Framework for Time Series Representation
نویسندگان
چکیده
Contrastive learning, as an unsupervised technique, has emerged a prominent method in time series representation learning tasks, serving viable solution to the scarcity of annotated data. However, application data augmentation methods during training can distort distribution raw This discrepancy between representations learned from augmented contrastive and those obtained supervised results incomplete understanding information contained real trained encoder. We refer this bias (DAB), representing disparity two sets representations. To mitigate influence DAB, we propose DAB-aware framework for (DABaCLT). leverages features stream (RFS) extract data, which are then combined with create positive negative pairs learning. Additionally, introduce DAB-minimizing loss function (DABMinLoss) within contrasting module minimize DAB extracted temporal contextual features. Our proposed is evaluated on three classification including sleep staging (SSC) epilepsy seizure prediction (ESP) based EEG human activity recognition (HAR) sensors signals. The experimental demonstrate that our DABaCLT achieves strong performance self-supervised representation, 0.19% 22.95% accuracy improvement SSC, 2.96% 5.05% HAR, 1.00% 2.46% ESP, comparable approach. source code open-source.
منابع مشابه
a time-series analysis of the demand for life insurance in iran
با توجه به تجزیه و تحلیل داده ها ما دریافتیم که سطح درامد و تعداد نمایندگیها باتقاضای بیمه عمر رابطه مستقیم دارند و نرخ بهره و بار تکفل با تقاضای بیمه عمر رابطه عکس دارند
Bounding the Bias of Contrastive Divergence Learning
Optimization based on k-step contrastive divergence (CD) has become a common way to train restricted Boltzmann machines (RBMs). The k-step CD is a biased estimator of the log-likelihood gradient relying on Gibbs sampling. We derive a new upper bound for this bias. Its magnitude depends on k, the number of variables in the RBM, and the maximum change in energy that can be produced by changing a ...
متن کاملMachine learning algorithms for time series in financial markets
This research is related to the usefulness of different machine learning methods in forecasting time series on financial markets. The main issue in this field is that economic managers and scientific society are still longing for more accurate forecasting algorithms. Fulfilling this request leads to an increase in forecasting quality and, therefore, more profitability and efficiency. In this pa...
متن کاملA Software Framework for Musical Data Augmentation
Predictive models for music annotation tasks are practically limited by a paucity of well-annotated training data. In the broader context of large-scale machine learning, the concept of “data augmentation” — supplementing a training set with carefully perturbed samples — has emerged as an important component of robust systems. In this work, we develop a general software framework for augmenting...
متن کاملModeling Time Series Data for Supervised Learning
Temporal data are increasingly prevalent and important in analytics. Time series (TS) data are chronological sequences of observations and an important class of temporal data. Fields such as medicine, finance, learning science and multimedia naturally generate TS data. Each series provide a high-dimensional data vector that challenges the learning of the relevant patterns This dissertation prop...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2023
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app13137908