Audiovisual Analysis of Journal Digital
收藏资源简介:
Automated extraction and analysis of audio-visual co-occurrences in video data using deep learning models. ## Overview This project analyzes temporal co-occurrences of audio and visual features in videos: - Audio extraction : Uses MIT's Audio Spectrogram Transformer (AST) to classify audio content - Visual extraction : Uses Moondream vision model for object detection in frames - Pairing analysis : Identifies audio-visual co-occurrences with temporal alignment - Temporal analysis : Tracks changes in audio-visual patterns across years ## Structure - src.zip : The source code for the library - results.zip : The .csv outputs - moon_results.tar.gz : Results from the Visual extraction pipeline - audio_results.tar.gz : Results forom the Audio extraction pipeline



