The Institute for IDEAS' cutting-edge volumetric capture studio recently played a central role in the development of a groundbreaking documentary research project at the American University of Sharjah. In collaboration with Professor Suheil Dahdal, the Institute produced several holograms for use in the documentary experience/research initiative Emirati Stories AR Documentary.
On the 20th of June, Institute for IDEAS founder Dr. Krzysztof Pietroszek hosted a meeting at the prestigious TAI School of the Arts in Madrid, Spain. This discussion, titled "Narrative Uses Of Volumetric Capture: Storytelling And The Artificial Reality Continuum", explored the potential uses of volumetric capture through cutting edge technology such as the Institute's Tetavi capture studio.
Volumetric capture brings real world performers and objects seamlessly into the virtual space, using photogrammetry. In his talk, Dr. Pietroszek addressed the ramifications of this technology for filmmaking and other arts, as well as the many avenues for expansion within this medium, like haptic sensory experiences. Volumetric capture is an innovation in digital media, and the Institute for IDEAS is honored to collaborate with TAI in pioneering this new field of the arts.
Based out of a high-tech studio space, the Institute is developing immersive volumetric content for VR, AR, and other applications. The core of this initiative is the Institute's volumetric capture system, purchased with a $1 million grant from the National Science Foundation. TDesigned by international tech company Tetavi, the volumetric capture studio smoothly transforms recorded performances into high-quality holograms. Tetavi's groundbreaking algorithmic process delivers a detailed, animated model of the subject for deployment across a number of platforms.
Once a domain of science fiction, holographic filmmaking is becoming the next technological revolution. At the 2021 Cannes Film Festival, Dr. Pietroszek voices the capabilities and complexities of the evolving medium. He shares how storytellers are now using volumetric capture to recreate objects in virtual spaces. Once recorded, these holograms can then be placed in virtual or real environments, creating an experience Dr. Pietroszek compares it to Star Trek’s Holodeck.
Actors, props, sets, and even entire structures can now be captured as photorealistic 3D models, shown as holograms; This process is known as photogrammetry. Photogrammetry allows the extraction of 3D data from photos and drawings. Once captured, audience members can view these elements through head-mounted glasses, known as a cave system. This cave system allows for an immersive experience where one can enter and interact with the virtual world. Some bring audience members into the set, others bring props and set elements into the real world. Like computer coding, the language and grammar of volumetric filmmaking can be very complex.
While the technology is ready for new stories and hniques, our understanding of the language and grammar of this medium is very limited. Through the Cannon keynote, Dr. Pietroszek discusses how filmmakers can learn and use volumetric filmmaking. Using low-cost volumetric capture technologies, Dr.Pietroszek invites filmmakers to experiment with volumetric capture. “Holographic filmmaking is a new and revolutionary form of storytelling that will not replace traditional cinema, but rather, it will become yet another” Dr. Pietroszek.
Dr. Pietroszek presented July 9, 2021
Holographic Filmmaking - Artificial Reality Continuum Revolution in Storytelling
The holographic telehealth project of the Institute for IDEAS (AU) and the School of Medicine (GW) will transform the way medical personnel communicates and collaborates across the distance by allowing for real-time exchange of three-dimensional information that is missing in current videoconferencing telehealth. The project will lead to more equitable access to healthcare and will improved success for medical procedures that require the assistance of a remote expert.
There are a wide variety of artificial intelligence (AI) algorithms designed to make decisions for a number of different real-world problems. The purpose of this project is to systematically understand the difficulty that AI challenge problems pose to standard decision-making algorithms, as well as how robust such conclusions are to variations in problem design, problem size, computational resources, and algorithm configuration.
Undergraduate and graduate students 3D-print and assemble a life-size humanoid robot. The robot will then be trained to talk, recognize faces, act in a theater, and have a sense of humor. Students will be able to embody the robot and control its movement. The project is a collaboration between Dr. Krzysztof Pietroszek of the Institute for IDEAS and Dr. Nathalie Japkowicz, the Chair of the Department of Computer Science.