Swin Transformer

E435882

Swin Transformer is a hierarchical vision transformer architecture that uses shifted windows for efficient and scalable image recognition and related computer vision tasks.

All labels observed (8)

How this entity was disambiguated

Statements (51)

Predicate Object
instanceOf hierarchical transformer model ⓘ
vision transformer architecture ⓘ
architectureType hierarchical ⓘ
window-based transformer ⓘ
benchmarkPerformance state-of-the-art on ADE20K semantic segmentation at introduction ⓘ
state-of-the-art on COCO object detection at introduction ⓘ
coAuthor Baining Guo ⓘ
Han Hu ⓘ
Stephen Lin ⓘ
Yixuan Wei ⓘ
Yue Cao ⓘ
Yutong Lin ⓘ
Zheng Zhang ⓘ
designedFor dense prediction tasks ⓘ
image recognition ⓘ
instance segmentation ⓘ
object detection ⓘ
semantic segmentation ⓘ
field computer vision ⓘ
deep learning ⓘ
machine learning ⓘ
firstAuthor Ze Liu ⓘ
hasComponent MLP feed-forward network ⓘ
Swin Transformer block ⓘ
patch merging layer ⓘ
patch partition layer ⓘ
window-based multi-head self-attention ⓘ
hasVariant Swin-B ⓘ
linked to: Swin Transformer

Swin-L ⓘ
linked to: Swin Transformer

Swin-S ⓘ
linked to: Swin Transformer

Swin-T ⓘ
linked to: Swin Transformer
influenced Swin Transformer V2 ⓘ
linked to: Swin Transformer

window-based vision transformer architectures ⓘ
inputType image patches ⓘ
inspiredBy Vision Transformer (ViT) ⓘ
linked to: ViT
introducedBy Microsoft Research Asia ⓘ
introducedIn 2021 ⓘ
introducedInPaper Swin Transformer: Hierarchical Vision Transformer using Shifted Windows ⓘ
linked to: Swin Transformer
keyFeature cross-window connection via window shifting ⓘ
hierarchical representation ⓘ
linear computational complexity with image size ⓘ
local self-attention within windows ⓘ
shifted window attention ⓘ
outputType multi-scale feature maps ⓘ
publishedAt ICCV 2021 ⓘ
usedAs backbone for instance segmentation ⓘ
backbone for object detection ⓘ
backbone for semantic segmentation ⓘ
usesMechanism layer normalization ⓘ
multi-head self-attention ⓘ
residual connections ⓘ

How these facts were elicited

Referenced by (9)

Full triples — surface form annotated when it differs from this entity's canonical label.

ViT → hasVariant → Swin Transformer ⓘ
Swin Transformer → introducedInPaper → Swin Transformer: Hierarchical Vision Transformer using Shifted Windows ⓘ
linked to: Swin Transformer
Swin Transformer → hasVariant → Swin-T ⓘ
linked to: Swin Transformer
Swin Transformer → hasVariant → Swin-S ⓘ
linked to: Swin Transformer
Swin Transformer → hasVariant → Swin-B ⓘ
linked to: Swin Transformer
Swin Transformer → hasVariant → Swin-L ⓘ
linked to: Swin Transformer
Swin Transformer → influenced → Swin Transformer V2 ⓘ
linked to: Swin Transformer
VisionEncoderDecoderModel → supportsEncoderModel → SwinModel ⓘ
linked to: Swin Transformer