Domain Adaptation with Adversarial Training on Penultimate Activations
نویسندگان
چکیده
Enhancing model prediction confidence on target data is an important objective in Unsupervised Domain Adaptation (UDA). In this paper, we explore adversarial training penultimate activations, i.e., input features of the final linear classification layer. We show that strategy more efficient and better correlated with boosting than images or intermediate features, as used previous works. Furthermore, activation normalization commonly domain adaptation to reduce gap, derive two variants systematically analyze effects our training. This illustrated both theory through empirical analysis real tasks. Extensive experiments are conducted popular UDA benchmarks under standard setting source-data free setting. The results validate method achieves best scores against arts. Code available at https://github.com/tsun/APA.
منابع مشابه
Multiple Source Domain Adaptation with Adversarial Training of Neural Networks
While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain adaptation problem may lead to suboptimal solutions. As a step toward bridging the gap, we propose a new generalization bound for domain adaptation when there are ...
متن کاملConditional Adversarial Domain Adaptation
Adversarial learning has been successfully embedded into deep networks to learn transferable features for domain adaptation, which reduce distribution discrepancy between the source and target domains and improve generalization performance. Prior domain adversarial adaptation methods could not align complex multimode distributions since the discriminative structures and inter-layer interactions...
متن کاملIncremental Adversarial Domain Adaptation
Continuous appearance shifts such as changes in weather and lighting conditions can impact the performance of deployed machine learning models. Unsupervised domain adaptation aims to address this challenge, though current approaches do not utilise the continuity of the occurring shifts. Many robotic applications exhibit these conditions and thus facilitate the potential to incrementally adapt a...
متن کاملFew-Shot Adversarial Domain Adaptation
This work provides a framework for addressing the problem of supervised domain adaptation with deep models. The main idea is to exploit adversarial learning to learn an embedded subspace that simultaneously maximizes the confusion between two domains while semantically aligning their embedding. The supervised setting becomes attractive especially when there are only a few target data samples th...
متن کاملDomain Adaptation for Relation Extraction with Domain Adversarial Neural Network
Relations are expressed in many domains such as newswire, weblogs and phone conversations. Trained on a source domain, a relation extractor’s performance degrades when applied to target domains other than the source. A common yet labor-intensive method for domain adaptation is to construct a target-domainspecific labeled dataset for adapting the extractor. In response, we present an unsupervise...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i8.26185