Exponential Moving Average


A method that increases the stability of a model’s convergence and helps it reach a better overall solution by preventing convergence to a local minima. To avoid drastic changes in the model’s weights during training, a copy of the current weights is created before updating the model’s weights. Then the model’s weights are updated to be the weighted average between the current weights and the post-optimization step weights.

Filter terms by

Glossary Alphabetical filter

Related resources

featured image for how to measure inference time
Computer Vision
Add Your Heading Text Here
					from transformers import AutoFeatureExtractor, AutoModelForImageClassification

extractor = AutoFeatureExtractor.from_pretrained("microsoft/resnet-50")

model = AutoModelForImageClassification.from_pretrained("microsoft/resnet-50")