[feat]: unified hunyuan hf; add hunyuan lora #120
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This reverts commit 580575c.
rlsu9
changed the title
jzhang38
reviewed
Jan 1, 2025
| @@ -3,6 +3,6 @@ A lone hiker stands atop a towering cliff, silhouetted against the vast horizon. | |||
| A hand with delicate fingers picks up a bright yellow lemon from a wooden bowl filled with lemons and sprigs of mint against a peach-colored background. The hand gently tosses the lemon up and catches it, showcasing its smooth texture. A beige string bag sits beside the bowl, adding a rustic touch to the scene. Additional lemons, one halved, are scattered around the base of the bowl. The even lighting enhances the vibrant colors and creates a fresh, inviting atmosphere. | |||
| A curious raccoon peers through a vibrant field of yellow sunflowers, its eyes wide with interest. The playful yet serene atmosphere is complemented by soft natural light filtering through the petals. Mid-shot, warm and cheerful tones. | |||
| A superintelligent humanoid robot waking up. The robot has a sleek metallic body with futuristic design features. Its glowing red eyes are the focal point, emanating a sharp, intense light as it powers on. The scene is set in a dimly lit, high-tech laboratory filled with glowing control panels, robotic arms, and holographic screens. The setting emphasizes advanced technology and an atmosphere of mystery. The ambiance is eerie and dramatic, highlighting the moment of awakening and the robots immense intelligence. Photorealistic style with a cinematic, dark sci-fi aesthetic. Aspect ratio: 16:9 --v 6.1 | |||
| fox in the forest close-up quickly turned its head to the left | |||
| Man walking his dog in the woods on a hot sunny day | |||
| fox in the forest close-up quickly turned its head to the left. | |||
| @@ -0,0 +1 @@ | |||
| Wukong stands prominently against a clear sky. Wukong's fur is dense and dark, framing an intense expression as they hold a large staff confidently across their shoulders. Elaborate golden armor intricately covers Wukong's torso, adorned with ornate designs and embellishments. With every subtle movement, Wukong exudes a sense of readiness and power, as if preparing for an impending challenge. The crown atop Wukong's head glints majestically in the sunlight, symbolizing leadership and authority. Wukong's fierce eyes remain focused and vigilant, capturing the viewer's attention with an aura of both mystery and strength. | |||
| @@ -0,0 +1,4 @@ | |||
| Will Smith casually eats noodles, his relaxed demeanor contrasting with the energetic background of a bustling street food market. The scene captures a mix of humor and authenticity. Mid-shot framing, vibrant lighting. | |||
| @@ -1,36 +1,37 @@ | |||
| export WANDB_BASE_URL="https://api.wandb.ai" | |||
| export WANDB_MODE=online | |||
|
|
|||
| torchrun --nnodes 1 --nproc_per_node 8 \ | |||
| torchrun --nnodes 1 --nproc_per_node 4 \ | |||
There was a problem hiding this comment.
do not update this. Create new script instead
| @@ -1,17 +1,18 @@ | |||
| export WANDB_BASE_URL="https://api.wandb.ai" | |||
| export WANDB_MODE=online | |||
|
|
|||
| torchrun --nnodes 1 --nproc_per_node 2 \ | |||
| fastvideo/train.py \ | |||
| CUDA_VISIBLE_DEVICES=6 torchrun --nnodes 1 --nproc_per_node 1 --master_port 29403 \ | |||
There was a problem hiding this comment.
do not update this. Create new script instead.
| num_gpus=4 | ||
| export MODEL_BASE=data/FastHunyuan | ||
| torchrun --nnodes=1 --nproc_per_node=$num_gpus --master_port 29503 \ | ||
| num_gpus=1 |
There was a problem hiding this comment.
do not update this. Create new script instead.
| @@ -1,19 +1,32 @@ | |||
| #!/bin/bash | |||
|
|
|||
| num_gpus=4 | |||
|
|
|||
| torchrun --nnodes=1 --nproc_per_node=$num_gpus --master_port 29503 \ | |||
| CUDA_VISIBLE_DEVICES=0,1,2,3 torchrun --nnodes=1 --nproc_per_node=$num_gpus --master_port 29603 \ | |||
| @@ -1,9 +1,9 @@ | |||
| # export WANDB_MODE="offline" | |||
| GPU_NUM=1 # 2,4,8 | |||
| GPU_NUM=1 | |||
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
add hunyuan lora; unified inference code for hunyuan hf; fix some bugs