Experimental

I animated a simple shot, found an AI workflow template tried by someone else, and I wondered if it could work for a painterly style. My idea was to make some adjustments to the promts to fit according to the results I was looking for.

This video served as the first foundation for my idea. He combined Unreal Engine workflow and AI to achieve a hyper realistic render style. I combined a Maya 3D workflow and AI to achieve a painterly style.

The prompt was part of the template but because it was tailored to hyper realism I needed to make several adjustments to fit the painterly style.

I tested if AI is able to preserve the animation using a prompt and a visual reference, and how well it is able to render and keep accurate locations. I used a playblast as a reference and it took two to three iterations to achieve the criteria I was looking for.

A limitation that I have observed. Although animation stayed very close, upon inspection of individual frames I observed it doesn't do well with fast motions and it tries to simulate a motion blur effect.

Some strengths, it was able to pick up on the basic materials and choose appropriate texture for the prop and cat, and it was able to stay somewhat accurate to the lighting of the playblast.

Overall the workflow did succeed in preserving