Page 13 - AC-1-2

Arts & Communication Cinematic experience and emerging technologies of cinema

viewer in the story . AI can also assist with the integration resolution and field of view of the virtual environment .
[74]
[79]
of virtual and physical elements. For instance, AI can use However, the standard dimensions of a movie theater also
sensors and cameras to track the movements of viewers present opportunities for enhancing the MR experience.
in the theater, adjusting the virtual elements to match With the use of AR and VR technologies, additional
the real-world environment . In Addition, AI-powered surfaces and areas in the theater can be utilized to expand
[75]
tools such as generative adversarial networks can create the immersive experience for the audience. By projecting
realistic 3D models of virtual environments that can be virtual environments or objects on the ceiling and walls of
combined with real-world elements to create a seamless the theater, a truly immersive and interactive mixed-reality
[80]
mixed-reality experience . One of the ways AI can experience can be created .
[76]
further enhance mixed-reality cinematic experiences is by In addition, the communal aspect of cinema-going
analyzing viewer reactions in real-time. AI can track facial can be leveraged to enhance the shared psychological
expressions and body language to determine how viewers experience of the audience. AI-powered tools can
are responding to the movie and adjust the experience analyze real-time data on viewer reactions and adjust the
accordingly to enhance engagement and emotional immersive elements of the MR experience to match the
impact . Moreover, site-specific VR is also making its audience’s emotional state. This personalized and engaging
[77]
way into cinema, offering a unique and personalized experience can create a more communal and social aspect
experience for viewers . LBE pioneers such as The VOID of cinema-going, further enhancing the mixed-reality
[78]
(2018), Miniatur Wunderland Hamburg (2019), and experience. Filmmakers must take into account both the
TimeRide (2019) have already created VR experiences that standard dimensions of a movie theater and the potential
allow viewers to explore virtual environments and interact for expanded surfaces to create the optimal mixed-reality
with their surroundings. experience.

3.3.1. MR for filmmaking In light of these emerging technologies and their
potential impact on cinema and movie-going, it is
Incorporating MR into the filmmaking process requires important for filmmakers to consider how they can take
careful consideration of the standard dimensions of a advantage of these technologies to create more immersive
movie theater. The distance between the viewer and the and engaging storytelling experiences. In the following
screen plays a crucial role in determining the level of section, we will provide some recommendations for
immersion and field of view of the MR experience. To filmmakers looking to incorporate MR, haptic feedback,
optimize immersion, filmmakers should aim to match AI, and other technologies into their filmmaking process
the distance between the viewer and the screen to the (Table 2).

Table 2. MR considerations for filmmakers

Audience engagement Filmmakers must consider how the mixed-reality experience will engage the audience. They should focus on how to use
the technology to enhance the story and create a more immersive experience that will captivate viewers.
Visual hierarchy Filmmakers must also consider how the mixed-reality experience will affect the visual hierarchy of the film. In traditional
films, the director has complete control over what the viewer sees and when. In mixed-reality experiences, the viewer has
more control over what they see and when. This can be a challenge for filmmakers, as they must ensure that the important
story elements are still communicated effectively.
Sound design Sound design is an important consideration in mixed-reality experiences. Filmmakers must ensure that the sound design
is appropriate for the mixed-reality experience and that it enhances the overall immersion of the viewer.
Camera movement Camera movement can also affect the mixed-reality experience. Filmmakers must ensure that the camera movements are
smooth and do not cause any discomfort or motion sickness for the viewer.
Lighting Lighting is also an important consideration in mixed-reality experiences. Filmmakers must ensure that the lighting is
appropriate for the mixed-reality experience and that it enhances the overall immersion of the viewer.
Audience comfort Filmmakers must ensure that the mixed-reality experience is comfortable for the audience. They should avoid using
technology that causes discomfort, such as motion sickness or eye strain.
Screen size The size of the screen used in the mixed-reality experience can affect the overall immersion of the viewer. Filmmakers
must ensure that the screen size is appropriate for the mixed-reality experience and that it enhances the overall immersion
of the viewer.
User interface Finally, filmmakers must consider the user interface for the mixed-reality experience. They should ensure that the
interface is intuitive and easy to use so that viewers can fully engage with the experience.
Abbreviation: MR: Mixed reality

Volume 1 Issue 2 (2023) 7 https://doi.org/10.36922/ac.0683