Elad Hoffer

A ConvNet for the 2020s

Restormer: Efficient Transformer for High-Resolution Image Restoration

A review of uncertainty quantification in deep learning: Techniques, applications and challenges

Text Data Augmentation for Deep Learning

PVT v2: Improved baselines with pyramid vision transformer

Finite-size effects in the microscopic critical properties of jammed configurations: A comprehensive study of the effects of different types of disorder

Review of deep learning: concepts, CNN architectures, challenges, applications, future directions

Jamming transition as a paradigm to understand the loss landscape of deep neural networks

Scaling description of generalization with number of parameters in deep learning

Critical Temperature Prediction for a Superconductor: A Variational Bayesian Neural Network Approach

Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey

Scaling Up Your Kernels to 31×31: Revisiting Large Kernel Design in CNNs

ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training

Physics-informed machine learning

CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification

Object Detection in 20 Years: A Survey

Deep Learning for Generic Object Detection: A Survey

Attention mechanisms in computer vision: A survey

Switchable Normalization for Learning-to-Normalize Deep Representation

Scalable methods for 8-bit training of neural networks

Norm matters: efficient and accurate normalization schemes in deep networks

Train longer, generalize better: closing the generalization gap in large batch training of neural networks

Augment Your Batch: Improving Generalization Through Instance Repetition