'Outsize' vs. 'Outsized' - Merriam-Webster
网页'Outsize' and 'outsized' are both variants that mean 'unusually large or heavy' and 'exaggerated or extravagant in size or degree.' 'Outsize' is prevalent in British English, while 'outsized' is common in American English, but either is accepted.
网页Outsized Effect on Neural Network Optimization Elan Rosenfeld Carnegie Mellon University elan@cmu.edu Andrej Risteski Carnegie Mellon University aristesk@andrew.cmu.edu Abstract We identify a new phenomenon in neural network optimization which arises from the interaction of depth and a particular heavy-tailed structure in natural data.
Outsized effect of predation: Wolves alter wetland creation and
网页By affecting where and when beavers engineer ecosystems, wolves alter all of the ecological processes (e.g., water storage, nutrient cycling, and forest succession) that occur due to beaver-created impoundments. Our study demonstrates how predators have an outsized effect on ecosystems when they kill ecosystem engineers.
Life may be less chaotic than we thought, say physicists
网页2023年12月15日 · A hallmark of chaotic systems is that a small disturbance can lead to an outsized effect. The famous butterfly effect offers a classic example, where a flap of an insect’s wings is proposed to...
Outliers with Opposing Signals Have an Outsized Effect on Neural ...
网页2023年11月7日 · Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization. We identify a new phenomenon in neural network optimization which arises from the interaction of depth and a particular heavy-tailed structure in natural data.
For stem cells, bigger doesn’t mean better - MIT News
网页2021年11月12日 · Outsized effects. It has been known since the 1960s that human cells grown in a lab dish enlarge as they become senescent — a nondividing cellular state that is associated with aging. Every time a cell divides, it can encounter DNA damage. When this happens, division is halted to repair the damage.
网页points can have an unusually large effect on a network’s optimization trajectory and predictions. Experimentally, we demonstrate the significant influence of paired groups of outliers in the training data with strong opposing signals: consistent, large magnitude features which dominate the network output and occur in both groups
Outliers with Opposing Signals Have an Outsized Effect on Neural ...
网页2024年1月16日 · The phenomenon of opposing signals is plausible and seems to be a fundamental cause of many existing techniques and artifacts about neural nets. The paper presents some heuristics that connect optimization with generalization, which has the potential to inspire new research.
Outliers with Opposing Signals Have an Outsized Effect on Neural ...
网页Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization.
[2311.04163] Outliers with Opposing Signals Have an Outsized Effect …
网页2023年11月7日 · We describe how to identify these groups, explore what sets them apart, and carefully study their effect on the network's optimization and behavior. We complement these experiments with a mechanistic explanation on a toy example of opposing signals and a theoretical analysis of a two-layer linear network on a simple model.