Pytorch 项目 实战

Explorations into Ring Attention, from Liu et al. at Berkeley AI

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

pytorch-alpine

Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch

Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch

pytorch with useful tools

c 1 × f × f × c 0 c_1\times f\times f\times c_0 c1​×f×f×c0​的卷积核进行处理，得到一个 ( n − f 1 × c 1 ) × ( n − f 1 × c 1 ) (n-f+1\times c_1)\times (n-f+1 \times c