NVIDIA artists Ashlee Martino-Tarr and Daniela Flamm Jackson have showcased the extraordinary potential of AI and RTX in bringing static illustrations to life. This week's In the NVIDIA Studio unveils a mesmerizing fusion of artistry and technological innovation that is set to redefine the boundaries of visual storytelling.
The dynamic duo harnessed the power of Adobe Firefly's generative AI features, seamlessly integrated with NVIDIA GPUs in the cloud and accelerated by the Tensor Cores within the GeForce RTX GPUs. The result? A 2D illustration transformed into a captivating animated masterpiece, enriched with special effects that blur the line between imagination and reality.
To achieve this feat, Martino-Tarr and Jackson embarked on a multi-layered journey, beginning by dissecting the 2D image into distinct layers and expanding the canvas. Leveraging Firefly's Generative Expand feature, the added space was effortlessly filled with AI-generated content, setting the stage for an artistic revolution.
The magic continued as the artists selectively separated elements, starting with the characters, utilizing Firefly's AI Object Select to automatically mask each layer. The Generative Fill feature then worked its wonders, creating background content efficiently and saving valuable time in the process.
With all layers in place, the duo seamlessly transitioned to Adobe After Effects, where the local RTX GPUs, powered by the Mercury 3D Engine, accelerated playback. This not only unlocked smoother movement but also facilitated real-time previews and adjustments, including GPU-accelerated enhancements like camera shake and depth of field.
Adding a touch of uniqueness, Firefly's Style Match feature was employed to generate new imagery in the likeness of the existing illustration — a vibrant butterfly with colors and tones echoing the original artwork. Further exploration of colors and themes was made possible through Adobe Illustrator's Generative Recolor feature, granting artists the freedom to experiment without the hassle of manual recoloring.
Martino-Tarr and Jackson then seamlessly integrated their selected assets into Adobe After Effects, leveraging Firefly's potent AI effects to expedite or eliminate tedious tasks such as patching holes, hand-painting set extensions, and caching animation playbacks.
The collaboration between human artists and AI wasn't just about creativity; it was about responsible innovation. Firefly's AI capabilities, developed with a commitment to ethical AI principles, ensure transparency in content and data, delivering morally responsible outputs. NVIDIA's cloud technology continues to be the driving force behind these features, catering to a diverse community of creatives, including photographers, illustrators, designers, video editors, and 3D artists.
For a closer look at the incredible work of Martino-Tarr and Jackson, explore Martino-Tarr’s portfolio on ArtStation.