Volltext-Downloads (blau) und Frontdoor-Views (grau)

An Empirical Investigation of Model-to-Model Distribution Shifts in Trained Convolutional Filters

  • We present first empirical results from our ongoing investigation of distribution shifts in image data used for various computer vision tasks. Instead of analyzing the original training and test data, we propose to study shifts in the learned weights of trained models. In this work, we focus on the properties of the distributions of dominantly used 3x3 convolution filter kernels. We collected andWe present first empirical results from our ongoing investigation of distribution shifts in image data used for various computer vision tasks. Instead of analyzing the original training and test data, we propose to study shifts in the learned weights of trained models. In this work, we focus on the properties of the distributions of dominantly used 3x3 convolution filter kernels. We collected and publicly provide a data set with over half a billion filters from hundreds of trained CNNs, using a wide range of data sets, architectures, and vision tasks. Our analysis shows interesting distribution shifts (or the lack thereof) between trained filters along different axes of meta-parameters, like data type, task, architecture, or layer depth. We argue, that the observed properties are a valuable source for further investigation into a better understanding of the impact of shifts in the input data to the generalization abilities of CNN models and novel methods for more robust transfer-learning in this domain.show moreshow less

Export metadata

Additional Services

Search Google Scholar

Statistics

frontdoor_oas
Metadaten
Document Type:Conference Proceeding
Conference Type:Konferenzartikel
Zitierlink: https://opus.hs-offenburg.de/5298
Bibliografische Angaben
Title (English):An Empirical Investigation of Model-to-Model Distribution Shifts in Trained Convolutional Filters
Conference:Workshop on Distribution Shifts, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Sydney, Australia
Author:Paul GavrikovStaff MemberORCiDGND, Janis KeuperStaff MemberORCiDGND
Year of Publication:2021
Page Number:11
First Page:1
Last Page:11
Parent Title (English):Workshop on Distribution Shifts: Connecting Methods and Applications
URL:https://openreview.net/pdf?id=2st0AzxC3mh
Language:English
Inhaltliche Informationen
Institutes:Fakultät Elektrotechnik, Medizintechnik und Informatik (EMI) (ab 04/2019)
Forschung / IMLA - Institute for Machine Learning and Analytics
Institutes:Bibliografie
Formale Angaben
Open Access: Open Access 
Licence (German):License LogoUrheberrechtlich geschützt