Upcoming Talks

Ista white

Learning general visual representation with large-scale pre-training

Date
Thursday, July 15, 2021 16:00 - 17:00
Speaker
Alexander Kolesnikov (Google Brain)
Location
Zoom Link: Join Zoom Meeting https://istaustria.zoom.us/j/91703991543?pwd=dTl3VWlWVTl1MGxxRjBKakN0ajRPZz09 Meeting ID: 917 0399 1543 Passcode: 378221
Series
Seminar/Talk
Tags
ELLIS talk
Host
Marco Mondelli
Contact
Ksenja Harpprecht

In this talk I will demonstrate that transfer of visual representations pre-trained on large-scale data can dramatically improve sample efficiency and simplify hyperparameter tuning. In the first part of the talk I will discuss challenges that arise in large-scale pre-training and how to address them. Then I will dive into strategies for adapting pre-trained models for a target task. Finally, I will present extensive empirical evaluation of large-scale visual models and highlight many surprising findings. In particular, it turns out that huge models pre-trained on large data not only achieve state-of-the-art performance on many standard vision benchmarks, but are also very strong few-shot learners and generalize well in out-of-distribution evaluation scenarios.


Qr image
Download ICS Download invitation
Back to eventlist