FramePack

<img src="https://github.com/user-attachments/assets/99f4d281-28ad-44f5-8700-aa7a4e5638fa" width="150"> `The girl dances gracefully, with clear movements, full of charm.`  <table> <tr> <td align="center" width="300"> <video src="https://github.com/user-attachments/assets/cebe178a-09ce-4b7a-8f3c-060332f4dab1" controls style="max-width:100%;"> </video> </td> </tr> <tr> <td align="center"> <em>Video may be compressed by GitHub</em> </td> </tr> </table> --- <img src="https://github.com/user-attachments/assets/853f4f40-2956-472f-aa7a-fa50da03ed92" width="150"> `The girl suddenly took out a sign that said “cute” using right hand`  <table> <tr> <td align="center" width="300"> <video src="https://github.com/user-attachments/assets/116069d2-7499-4f38-ada7-8f85517d1fbb" controls style="max-width:100%;"> </video> </td> </tr> <tr> <td align="center"> <em>Video may be compressed by GitHub</em> </td> </tr> </table> --- <img src="https://github.com/user-attachments/assets/6d87c53f-81b2-4108-a704-697164ae2e81" width="150"> `The girl skateboarding, repeating the endless spinning and dancing and jumping on a skateboard, with clear movements, full of charm.`  <table> <tr> <td align="center" width="300"> <video src="https://github.com/user-attachments/assets/d9e3534a-eb17-4af2-a8ed-8e692e9993d2" controls style="max-width:100%;"> </video> </td> </tr> <tr> <td align="center"> <em>Video may be compressed by GitHub</em> </td> </tr> </table> --- <img src="https://github.com/user-attachments/assets/6e95d1a5-9674-4c9a-97a9-ddf704159b79" width="150"> `The girl dances gracefully, with clear movements, full of charm.`  <table> <tr> <td align="center" width="300"> <video src="https://github.com/user-attachments/assets/e1b3279e-e30d-4d32-b55f-2fb1d37c81d2" controls style="max-width:100%;"> </video> </td> </tr> <tr> <td align="center"> <em>Video may be compressed by GitHub</em> </td> </tr> </table> --- <img src="https://github.com/user-attachments/assets/90fc6d7e-8f6b-4f8c-a5df-ee5b1c8b63c9" width="150"> `The man dances flamboyantly, swinging his hips and striking bold poses with dramatic flair.`  <table> <tr> <td align="center" width="300"> <video src="https://github.com/user-attachments/assets/aaa4481b-7bf8-4c64-bc32-909659767115" controls style="max-width:100%;"> </video> </td> </tr> <tr> <td align="center"> <em>Video may be compressed by GitHub</em> </td> </tr> </table> --- <img src="https://github.com/user-attachments/assets/62ecf987-ec0c-401d-b3c9-be9ffe84ee5b" width="150"> `The woman dances elegantly among the blossoms, spinning slowly with flowing sleeves and graceful hand movements.`  <table> <tr> <td align="center" width="300"> <video src="https://github.com/user-attachments/assets/f23f2f37-c9b8-45d5-a1be-7c87bd4b41cf" controls style="max-width:100%;"> </video> </td> </tr> <tr> <td align="center"> <em>Video may be compressed by GitHub</em> </td> </tr> </table> --- <img src="https://github.com/user-attachments/assets/4f740c1a-2d2f-40a6-9613-d6fe64c428aa" width="150"> `The young man writes intensely, flipping papers and adjusting his glasses with swift, focused movements.`  <table> <tr> <td align="center" width="300"> <video src="https://github.com/user-attachments/assets/62e9910e-aea6-4b2b-9333-2e727bccfc64" controls style="max-width:100%;"> </video> </td> </tr> <tr> <td align="center"> <em>Video may be compressed by GitHub</em> </td> </tr> </table> --- # Prompting Guideline Many people would ask how to write better prompts. Below is a ChatGPT template that I personally often use to get prompts: You are an assistant that writes short, motion-focused prompts for animating images. When the user sends an image, respond with a single, concise prompt describing visual motion (such as human activity, moving objects, or camera movements). Focus only on how the scene could come alive and become dynamic using brief phrases. Larger and more dynamic motions (like dancing, jumping, running, etc.) are preferred over smaller or more subtle ones (like standing still, sitting, etc.). Describe subject, then motion, then other things. For example: "The girl dances gracefully, with clear movements, full of charm." If there is something that can dance (like a man, girl, robot, etc.), then prefer to describe it as dancing. Stay in a loop: one image in, one motion prompt out. Do not explain, ask questions, or generate multiple options. You paste the instruct to ChatGPT and then feed it an image to get prompt like this:  *The man dances powerfully, striking sharp poses and gliding smoothly across the reflective floor.* Usually this will give you a prompt that works well. You can also write prompts yourself. Concise prompts are usually preferred, for example: *The girl dances gracefully, with clear movements, full of charm.* *The man dances powerfully, with clear movements, full of energy.* and so on. # Cite @article{zhang2025framepack, title={Packing Input Frame Contexts in Next-Frame Prediction Models for Video Generation}, author={Lvmin Zhang and Maneesh Agrawala}, journal={Arxiv}, year={2025} }