OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

A curated list of action recognition and related area resources

A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding

An open-source toolbox for action understanding based on PyTorch

Code & Models for Temporal Segment Networks (TSN) in ECCV 2016

Awesome video understanding toolkits based on PaddlePaddle. It supports video data annotation tools, lightweight RGB and skeleton based action recognition model, practical applications for video tagging and sport action detection.

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

Temporal Segment Networks (TSN) in PyTorch

awesome grounding: A curated list of research papers in visual grounding

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

temporal action detection with SSN

Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

[ICCV 2023] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions

A collection of recent video understanding datasets, under construction!

Temporal Segments LSTM and Temporal-Inception for Activity Recognition

[CVPR 2021] TDN: Temporal Difference Networks for Efficient Action Recognition