Paper ID | MLR-APPL-IP-7.11 | ||
Paper Title | USING THE OVERLAPPING SCORE TO IMPROVE CORRUPTION BENCHMARKS | ||
Authors | Alfred Laugros, Alice Caplier, Universite Grenoble Alpes, France; Matthieu Ospici, Atos, France | ||
Session | MLR-APPL-IP-7: Machine learning for image processing 7 | ||
Location | Area E | ||
Session Time: | Wednesday, 22 September, 08:00 - 09:30 | ||
Presentation Time: | Wednesday, 22 September, 08:00 - 09:30 | ||
Presentation | Poster | ||
Topic | Applications of Machine Learning: Machine learning for image processing | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | Neural Networks are sensitive to various corruptions that usually occur in real-world applications such as blurs, noises, low-lighting conditions, etc. To estimate the robustness of neural networks to these common corruptions, we generally use a group of modeled corruptions gathered into a benchmark. Unfortunately, no objective criterion exists to determine whether a benchmark is representative of a large diversity of independent corruptions. In this paper, we propose a metric called corruption overlapping score, which can be used to reveal flaws in corruption benchmarks. Two corruptions overlap when the robustnesses of neural networks to these corruptions are correlated. We argue that taking into account overlappings between corruptions can help to improve existing benchmarks or build better ones. |