Pytorch 基础

Pytorch with CUDA-aware MPI backend for distributed training

Implementation of Fast Transformer in Pytorch

Implementation of Lumiere, SOTA text-to-video generation from Google Deepmind, in Pytorch

Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch

Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in Pytorch

pytorch docker images

An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up processing, and attention (consensus between columns), for emergent part-whole heirarchies from data

pytorch nightly + xformers + deepspeed

点击上方“小白学视觉”，选择加"星标"或“置顶” 重磅干货，第一时间送达 随着深度学习的发展，深度学习框架开始大量的出现。尤其是近两年，Google、Facebook、Microsoft等巨头都围绕深度学习重点投资了一系列新兴项目，他们也一直在支持一些开源的深度学习框架。目前研究人员正在使用的深度学