TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding

TimeChat is a time-sensitive multimodal large language model specifically designed for long video understanding. It incorporates two key architectural contributions: a timestamp-aware frame encoder that binds visual content with the timestamp of each frame, and a sliding video Q-Former that produces a video token sequence of varying lengths to accommodate videos of various durations.