Definition & Meaning | English word SELF-ATTENTION
SELF-ATTENTION
Definitions of SELF-ATTENTION
- (ML) A form of attention (prioritization technique in neural networks) where the data being examined, rather than some additional input, is used to determine what to focus on.
- (psychology) Conscious attention to one's own physiological and emotional state and behavior.
Number of letters
14
Is palindrome
No
Examples of Using SELF-ATTENTION in a Sentence
- In 2016, decomposable attention applied a self-attention mechanism to feedforward networks, which are easy to parallelize, and achieved SOTA result in textual entailment with an order of magnitude less parameters than LSTMs.
- highly parallelizable self-attention introduced in 2016 as decomposable attention and successfully used in transformers a year later,.
Search for SELF-ATTENTION in:
Page preparation took: 187.53 ms.
