MVS-Synth-Absolute-Camera

# MVS-Synth-Absolute-Camera  Per-frame **camera parameter** annotations for the **MVS-Synth** dataset (**120 scenes**; **11,991** valid per-frame annotations), captioned by the [**Puffin-World**](https://github.com/KangLiao929/Puffin) model. The collage above visualizes the camera maps on sample images — each pair shows the **up field** (green arrows: the projected gravity-up direction) and the **latitude field** (colored contours: angle above/below the horizon). ## Format **One `.zip` per scene** — `<scene_id>.zip` (e.g. `0000.zip`). Each zip unpacks to the original per-frame layout: ``` camera/0000.json camera/0001.json ... ``` Each JSON holds the predicted monocular camera parameters: | field | meaning | unit | |-------|---------|------| | `roll` | camera roll | radians | | `pitch` | camera pitch | radians | | `vfov` | vertical field of view | radians | | `k1` | radial distortion coefficient | – | | `parse_ok` | whether the model output parsed within valid ranges | bool | Example: ```json {"roll": 0.0003, "pitch": 0.0641, "vfov": 0.8165, "k1": 0.0, "parse_ok": true} ``` ## Camera Parameter Distributions Histograms of the predicted roll / pitch / vertical-FoV over all frames (proportion of valid samples per 10° bin; `parse_ok=False` samples excluded).  | split | roll μ / med / σ | pitch μ / med / σ | FoV μ / med / σ | |-------|------------------|-------------------|-----------------| | all (12K frames) | 0.0° / 0.0° / 0.4° | 3.3° / 3.7° / 9.7° | 45.8° / 46.8° / 4.1° | **Reading the distributions** - **Roll** is tightly peaked at 0° (σ ≈ 0.4°) — captures are shot close to level. - **Pitch** carries a slight upward bias (median ≈ 3.7°, mean ≈ 3.3°) with σ ≈ 4–10° spread. - **FoV** concentrates around **43–51°** (median ≈ 46.8°). If you'd like a dataset with a more diverse and uniform distribution of camera parameters, please refer to our [Puffin-4M](https://huggingface.co/datasets/KangLiao/Puffin-4M) and [Puffin-16M](https://huggingface.co/datasets/KangLiao/Puffin-16M) datasets. ### Dataset Download You can download the entire dataset using the following command: ```bash hf download KangLiao/MVS-Synth-Absolute-Camera --repo-type dataset ``` ### Caption Pipeline Beyond this captioned dataset, we also release **a complete captioning pipeline** for annotating camera parameters for arbitrary datasets, analyzing camera parameter distributions, and visualizing the corresponding camera maps. The pipeline is available in our [GitHub repository](https://github.com/KangLiao929/Puffin). ### Citation If you find the captioned dataset useful for your research or applications, please cite our paper using the following BibTeX: ```bibtex @article{liao2025puffin, title={Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generation}, author={Liao, Kang and Wu, Size and Wu, Zhonghua and Jin, Linyi and Wang, Chao and Wang, Yikai and Wang, Fei and Li, Wei and Loy, Chen Change}, journal={arXiv preprint arXiv:2510.08673}, year={2025} } ```