Skip to content

gr3gor1/ResNet_Early_Exit

Repository files navigation

ResNet Early-Exiting Experiment

What is early exiting?

Early exiting lets models stop computation once confident, reducing inference time, scaling effort to input complexity, and avoiding overthinking. While first explored in NLP and vision DNNs, it now shows promise in foundation and reasoning models, including BERT, LLaMA, and ViT.

Results

Exit Distribution

exit_distribution.png

FLOPs per Exit Layer

FLOPs_per_exit_layer.png

Average FLOPs per sample

FLOPs_per_sample.png

Energy Consumption per GPU

energy_consumption_per_gpu.png

Inference Time per GPU

inference_time_per_gpu.png

Emissions per GPU

emissions_per_gpu.png

About

This repository contains some simple experiments revolving around early-exiting

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published