[feat]: unified hunyuan hf; add hunyuan lora

assets/prompt.txt

@@ -3,6 +3,6 @@ A lone hiker stands atop a towering cliff, silhouetted against the vast horizon.
 A hand with delicate fingers picks up a bright yellow lemon from a wooden bowl filled with lemons and sprigs of mint against a peach-colored background. The hand gently tosses the lemon up and catches it, showcasing its smooth texture. A beige string bag sits beside the bowl, adding a rustic touch to the scene. Additional lemons, one halved, are scattered around the base of the bowl. The even lighting enhances the vibrant colors and creates a fresh, inviting atmosphere.
 A curious raccoon peers through a vibrant field of yellow sunflowers, its eyes wide with interest. The playful yet serene atmosphere is complemented by soft natural light filtering through the petals. Mid-shot, warm and cheerful tones.
 A superintelligent humanoid robot waking up. The robot has a sleek metallic body with futuristic design features. Its glowing red eyes are the focal point, emanating a sharp, intense light as it powers on. The scene is set in a dimly lit, high-tech laboratory filled with glowing control panels, robotic arms, and holographic screens. The setting emphasizes advanced technology and an atmosphere of mystery. The ambiance is eerie and dramatic, highlighting the moment of awakening and the robots immense intelligence. Photorealistic style with a cinematic, dark sci-fi aesthetic. Aspect ratio: 16:9 --v 6.1
-fox in the forest close-up quickly turned its head to the left
-Man walking his dog in the woods on a hot sunny day
+fox in the forest close-up quickly turned its head to the left.
+Man walking his dog in the woods on a hot sunny day.
 A majestic lion strides across the golden savanna, its powerful frame glistening under the warm afternoon sun. The tall grass ripples gently in the breeze, enhancing the lion's commanding presence. The tone is vibrant, embodying the raw energy of the wild. Low angle, steady tracking shot, cinematic.

assets/prompt_test.txt

@@ -0,0 +1 @@
+Wukong stands prominently against a clear sky. Wukong's fur is dense and dark, framing an intense expression as they hold a large staff confidently across their shoulders. Elaborate golden armor intricately covers Wukong's torso, adorned with ornate designs and embellishments. With every subtle movement, Wukong exudes a sense of readiness and power, as if preparing for an impending challenge. The crown atop Wukong's head glints majestically in the sunlight, symbolizing leadership and authority. Wukong's fierce eyes remain focused and vigilant, capturing the viewer's attention with an aura of both mystery and strength.

fastvideo/models/flash_attn_no_pad.py

@@ -14,7 +14,7 @@ def flash_attn_no_pad(
     x_unpad, indices, cu_seqlens, max_s, used_seqlens_in_batch = unpad_input(
         x, key_padding_mask
     )
-
+    
     x_unpad = rearrange(x_unpad, "nnz (three h d) -> nnz three h d", three=3, h=nheads)
     output_unpad = flash_attn_varlen_qkvpacked_func(
         x_unpad,

fastvideo/models/hunyuan/modules/models.py

@@ -20,7 +20,6 @@
 
 from fastvideo.utils.parallel_states import nccl_info
 
-
 class MMDoubleStreamBlock(nn.Module):
     """
     A multimodal dit block with seperate modulation for