Michael Qian

Synthetica: Bridging the Real and the Virtual through Digital Resurrection and Identity Exploration

Synthetica Project Illustration

Overview

Synthetica is an immersive art project that delves into the realms of digital resurrection, fictional identities from movies and games, and the fusion of personality digital identities. By blurring the boundaries between reality and the virtual, Synthetica invites introspection on profound themes such as mortality, memory, and the ethics surrounding digital immortality. The project revives iconic characters through lifelike digital renderings, challenging the distinctions between fiction and reality.

Explore the Synthetica project

\n\n\n\n

Conceptual Framework

Synthetica sits at the crossroads of AI, art, and the human form representation, embodying a symbiosis between artificial intelligence and artistic expression to traverse the domain of digital humans. Through advanced algorithms, lifelike rendering, and data analysis, Synthetica not only resurrects individuals digitally but also brings fictional characters to life and melds personality digital identities, thus enriching the AIxArt landscape.

Technical Execution

Image Creation using Midjourney:

Utilizing Midjourney, an AI-driven tool, Synthetica kickstarted the journey by generating visually realistic images of digital humans, setting the stage for the ensuing interactive experience.

ChatGPT Integration:

The integration of ChatGPT by OpenAI enabled interactive dialogues with digital characters, fostering a dynamic user engagement.

Microsoft Azure Text-to-Speech Services:

Incorporating Microsoft Azure’s Text-to-Speech services transformed text outputs into voice, allowing digital characters to articulate responses, thereby elevating the interactive experience.

D-ID for Talking Face Generation:

Employing D-ID technology, Synthetica synthesized talking faces of digital characters, achieving synchronized facial movements and expressions that brought characters to life on-screen.

Web Application:

A dedicated web application was crafted to deliver a continuous and interactive platform, allowing users to engage with digital characters seamlessly, highlighting the convergence of art and technology.

Exhibition Archive and Reflection

The exhibition entailed a gallery space where visitors interacted with the digital characters on display, marveling at the seamless AI integration. Reflecting upon the exhibit, it was evident that while the characters resonated with visitors, there’s potential for enhancing conversational capabilities and emotional resonance through real-time facial animation adjustments.

Future Directions

The roadmap ahead includes refining conversational dynamics, advancing real-time facial animation synchronization, and aligning facial expressions with speech content to enhance emotional resonance. The feedback from the exhibition underscores the need for these enhancements, laying a foundation for the next steps in the Synthetica journey.