|
|
|||
| forums: groups: | |||
|
"AI video is slowly getting better"
Love you, too
I used a platform called Luma at lumalabs.ai to create these two videos I then merged together:
My prompt was: "An attractive young woman in her twenties, falls into a pool filled with slime and whipped cream and is covered head to toe"
It does censor prompts, but not too strictly. I was not able to use the word 'nude' or 'bikini' for example.
https://umd.net/videos/ai-test--green-slime
My prompt was: "An attractive young woman in her twenties, falls into a pool filled with slime and whipped cream and is covered head to toe"
It does censor prompts, but not too strictly. I was not able to use the word 'nude' or 'bikini' for example.
https://umd.net/videos/ai-test--green-slime
I tried the paid version of Luma for a month, it's cool but it has a lot of limitations at the moment:
- you can't do actions other than walking and idle animations. So you can forget about pie throwing or any other behavior (or at least I haven't managed no matter how much I tried);
- If you start from an image with a lot of mess, character recognition will fail. The mess will be treated as some kind of removable mask and you'll end up with a completely different character;
- the system struggles with scenes that have characters in the background, it will often pick a random character;
- image + prompt barely works and the generation will just do whatever it wants;
- since it works frame by frame, once it loses the model on a frame the rest of the video will be a monstrosity beyond human comprehension;
- text prompting is really limited, way worse than Dall-e 3 and closer to SD;
So you're kinda limited to model playing with pies scenarios.
On the bright side the tech is really promising with really impressive consistency on characters, scenes and even photography style. It also has very loose content filtering (for now).
It makes me wonder how cool SORA will be.
- you can't do actions other than walking and idle animations. So you can forget about pie throwing or any other behavior (or at least I haven't managed no matter how much I tried);
- If you start from an image with a lot of mess, character recognition will fail. The mess will be treated as some kind of removable mask and you'll end up with a completely different character;
- the system struggles with scenes that have characters in the background, it will often pick a random character;
- image + prompt barely works and the generation will just do whatever it wants;
- since it works frame by frame, once it loses the model on a frame the rest of the video will be a monstrosity beyond human comprehension;
- text prompting is really limited, way worse than Dall-e 3 and closer to SD;
So you're kinda limited to model playing with pies scenarios.
On the bright side the tech is really promising with really impressive consistency on characters, scenes and even photography style. It also has very loose content filtering (for now).
It makes me wonder how cool SORA will be.
kortanklein said: I tried the paid version of Luma for a month, it's cool but it has a lot of limitations at the moment:
- you can't do actions other than walking and idle animations. So you can forget about pie throwing or any other behavior (or at least I haven't managed no matter how much I tried);
- If you start from an image with a lot of mess, character recognition will fail. The mess will be treated as some kind of removable mask and you'll end up with a completely different character;
- the system struggles with scenes that have characters in the background, it will often pick a random character;
- image + prompt barely works and the generation will just do whatever it wants;
- since it works frame by frame, once it loses the model on a frame the rest of the video will be a monstrosity beyond human comprehension;
- text prompting is really limited, way worse than Dall-e 3 and closer to SD;
So you're kinda limited to model playing with pies scenarios.
On the bright side the tech is really promising with really impressive consistency on characters, scenes and even photography style. It also has very loose content filtering (for now).
It makes me wonder how cool SORA will be.
- you can't do actions other than walking and idle animations. So you can forget about pie throwing or any other behavior (or at least I haven't managed no matter how much I tried);
- If you start from an image with a lot of mess, character recognition will fail. The mess will be treated as some kind of removable mask and you'll end up with a completely different character;
- the system struggles with scenes that have characters in the background, it will often pick a random character;
- image + prompt barely works and the generation will just do whatever it wants;
- since it works frame by frame, once it loses the model on a frame the rest of the video will be a monstrosity beyond human comprehension;
- text prompting is really limited, way worse than Dall-e 3 and closer to SD;
So you're kinda limited to model playing with pies scenarios.
On the bright side the tech is really promising with really impressive consistency on characters, scenes and even photography style. It also has very loose content filtering (for now).
It makes me wonder how cool SORA will be.
This is exactly what I found. An image with slime falling will be translated into a video with a solid column of slime. I had some OK results with gunge dunk pics, but more like the playful pleading before the dunk, rather than the dunk itself.
So I've been playing with it a bit more, once you know what you can and cannot do it's kinda decent. And it seems it's improving rapidly at least from an interface perspective.
If you want to use it, some advice:
- add 'no camera movement' to every image prompt. Camera movement almost never works
- use images that don't have too much mess, ideally liquid mess works better than chunky mess
- POV kinda works as long as you don't expect actions
- the system is trained on Caucasian models, so other phenotypes might turn Caucasian during the video.
Some examples (if MP4 files work):
https://youtu.be/dB8WD8maD3Q?si=jYLrQHcXEVgSMPQB
https://m.youtube.com/shorts/5DNbQ0hRIRs?cbrd=1
https://youtube.com/shorts/jgDYJ1bMxSg?si=egN91zeR34Q2ec3u
All links should work now.
If you want to use it, some advice:
- add 'no camera movement' to every image prompt. Camera movement almost never works
- use images that don't have too much mess, ideally liquid mess works better than chunky mess
- POV kinda works as long as you don't expect actions
- the system is trained on Caucasian models, so other phenotypes might turn Caucasian during the video.
Some examples (if MP4 files work):
https://youtu.be/dB8WD8maD3Q?si=jYLrQHcXEVgSMPQB
https://m.youtube.com/shorts/5DNbQ0hRIRs?cbrd=1
https://youtube.com/shorts/jgDYJ1bMxSg?si=egN91zeR34Q2ec3u
All links should work now.
One thing to say about LumaLabs is that it's quite expensive per generation, works out about 20c per 5 second video clip at the lowest tier of paid membership. I burnt through my 150 prompts quite quickly, my learning from it is similar to kortanklein's.
It seems less is more when it comes to prompts, beyond very basic direction, regardless of what I prompted it felt like basically pot luck, I got the subject moving about in an essentially uncontrollable way. A few times I got mess moving in a plausible manner, rarely did I get mess leaving a mess behind. Most of the time falling mess actually cleaned the subject, she started off messy and ended clean. Sometimes the results were pure horror, with deformed bodies and melted faces. I'll post the best results in a video to my profile when I have time.
It seems less is more when it comes to prompts, beyond very basic direction, regardless of what I prompted it felt like basically pot luck, I got the subject moving about in an essentially uncontrollable way. A few times I got mess moving in a plausible manner, rarely did I get mess leaving a mess behind. Most of the time falling mess actually cleaned the subject, she started off messy and ended clean. Sometimes the results were pure horror, with deformed bodies and melted faces. I'll post the best results in a video to my profile when I have time.
Design & Code ©1998-2025 Loverbuns, LLC 18 U.S.C. 2257 Record-Keeping Requirements Compliance Statement
Epoch Billing Support Log In