Skip to Main content Skip to Navigation
Conference papers

Domain Adaptation Transfer Learning by Kernel Representation Adaptation

Abstract : Domain adaptation, where no labeled target data is available, is a challenging task. To solve this problem, we first propose a new SVM based approach with a supplementary MaximumMean Discrepancy (MMD)-like constraint. With this heuristic, source and target data are projected onto a common subspace of a Reproducing Kernel Hilbert Space (RKHS) where both data distributions are expected to become similar. Therefore, a classifier trained on source data might perform well on target data, if the conditional probabilities of labels are similar for source and target data, which is the main assumption of this paper. We demonstrate that adding this constraint does not change the quadratic nature of the optimization problem, so we can use common quadratic optimization tools. Secondly, using the same idea that rendering source and target data similar might ensure efficient transfer learning, and with the same assumption, a Kernel Principal Component Analysis (KPCA) based transfer learning method is proposed. Different from the first heuristic, this second method ensures other higher order moments to be aligned in the RKHS, which leads to better performances. Here again, we select MMD as the similarity measure. Then, a linear transformation is also applied to further improve the alignment between source and target data. We finally compare both methods with other transfer learning methods from the literature to show their efficiency on synthetic and real datasets.
Document type :
Conference papers
Complete list of metadatas

https://hal-utt.archives-ouvertes.fr/hal-02862063
Contributor : Jean-Baptiste Vu Van <>
Submitted on : Tuesday, June 9, 2020 - 12:05:33 PM
Last modification on : Wednesday, June 10, 2020 - 5:35:37 AM

Identifiers

Collections

ROSAS | UTT | CNRS

Citation

Xiaoyi Chen, Régis Lengellé. Domain Adaptation Transfer Learning by Kernel Representation Adaptation. 6th International Pattern Recognition Applications and Methods Conference, ICPRAM 2017, Feb 2017, Porto, Portugal. pp.45-61, ⟨10.1007/978-3-319-93647-5_3⟩. ⟨hal-02862063⟩

Share

Metrics

Record views

13