Instructions to use Lightricks/LTX-Video with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Lightricks/LTX-Video with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Lightricks/LTX-Video", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Inference
- Notebooks
- Google Colab
- Kaggle
Fine tune and lora
#12
by andreclaudino - opened
It's a great work, but now the model is not able to create uncensored content, that includes creating videos from NSFW images. Making different localizations like adapting backgrounds and police uniforms for different countries would be great.
What is the best approach for that? How to fine tune the model or create a LoRA that allows achieving targets like these? How much video time is needed, what are the hardware requirements?
Thanks.
top tier gooner