We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Artificial Intelligence & Machine Learning/Improvements to Context Based Self-Supervised Learning
Conference ProceedingsArtificial Intelligence & Machine Learning

Improvements to Context Based Self-Supervised Learning

Checking your access to this record.

Abstract & Overview

We develop a set of methods to improve on the results of self-supervised learning using context. We start with a baseline of patch based arrangement context learning and go from there. Our methods address some overt problems such as chromatic aberration as well as other potential problems such as spatial skew and mid-level feature neglect. We prevent problems with testing generalization on common self-supervised benchmark tests by using different datasets during our development. The results of our methods combined yield top scores on all standard self-supervised benchmarks, including classification and detection on PASCAL VOC 2007, segmentation on PASCAL VOC 2012, and "linear tests" on the ImageNet and CSAIL Places datasets. We obtain an improvement over our baseline method of between 4.0 to 7.1 percentage points on transfer learning classification tests. We also show results on different standard network architectures to demonstrate generalization as well as portability. All data, models and programs are available at: https://gdo-datasci.llnl.gov/selfsupervised/.

Cite this record

T. Nathan Mundhenk, Daniel Ho, Barry Y. Chen (2018). Improvements to Context Based Self-Supervised Learning. OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information). https://doi.org/10.1109/cvpr.2018.00973

Copy in another style

Mundhenk, T. N., Ho, D., & Chen, B. Y. (2018). Improvements to Context Based Self-Supervised Learning. OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information). https://doi.org/10.1109/cvpr.2018.00973
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.