Tag Archives: Between Page and Screen

Digital Literature, A screen and page

Posted on by
2

Between Page and Screen is an incredibly interesting and creative piece of digital literature. The pairing between using a physical book and using a screen to read it relies on two tools, the book and the digital device, instead of only one. When reading the book through the reflection of the webcam a reader can also see themselves, they can see themselves reading and reacting to the story, which is uncommon, unless someone reads in front of a mirror. This aspect, seeing oneself while reading, makes readers more aware of how a work makes them feel, they can see the surprise, sadness, or joy on their own faces.

The appearance of the text relies on both a webcam and the book. Without both the text is unreadable and causes the reader to have to shelve the book or look back at the webcam disappointed. By having to hold up the book to the screen a reader must feel comfortable relying on digital technology, and the technology has to rely on the person. I find it interesting that typically only a person relies on a device, but in this scenario, the device must also rely on the person to be able to have the book to read and take symbols from, that is a unique interaction. I would like to see more pieces of digital literature like this, ones that ask for cooperation between a person and their device, not just usage in one direction, but an actual partnership between the screen.

Between Page and Screen is what I also imagine using AI generators like ChatGPT must be like for those who use it to create images of documents. In generating images from prompts the computer and the person must, “talk,” through the chat box to produce work that is made by the computer by inspired by the words of the person. In Between Page and Screen the reader communicates with the computer while turning the page and presenting the glyphs and the screen speaks back through translating the book’s story.

Week 10: Is All Media Three-Dimensional?

Posted on by
1

Electronic literature scholar N. Katherine Hayles writes in 2007 that contemporary e-lit authors “explor[ed] . . .the Z-axis as an additional dimension for text display, behavior, and manipulation” (“Electronic Literature: What Is It?”). Hayles describes the work of Ted Warnell, whose TLT vs. LL (2006, strobe/flashing warning) “shifts to a dynamic surface in which rising and sinking motions give the effect of three dimensions as the layered letter forms shift, move, and reposition themselves relative to other letters” (Hayles). I am considering this spatial depth alongside our discussions of screen interfaces and my own work with Rufus Butler Seder’s Gallop! (2007), a book which combines leaf layers to produce an animated effect.

In a comment on Micaela’s post last week, Sierra mentioned otome games – a subgenre of visual novels, which themselves emerge from interactive fiction games. It’s made me think about the conventional display interface of visual novels, which generally overlay narrative text and selectable options over illustrations. While considering how Gallop! produces animation and sequence through interactions between bound layers, I’m realizing that I haven’t attended to the “Z-axis” in screen media like 2D visual novels, animation, or even the computer screen interface itself. The backlit LCD display of my computer also produces animation via interactions between layers of light and crystal. This is a 3D process. Because the computer interface produces media through X, Y, and Z axes, even what appears to be 2D screen media is materially 3D.

We therefore don’t look at a screen, but through its layers. Interactions between layers produce optical effects, much like the Scanimation barrier-grid effect produced in Seder’s Gallop!. N. Katherine Hayles has already explored computer backlighting’s “media-specific” influence on e-lit through texts like “Flickering Connectivities in Shelley Jackson’s Patchwork Girl: The Importance of Media-Specific Analysis” (2000), but I’m only now realizing the implications of the Z-axis to electronic literature. How does an e-lit work engage with the 3D spatiality of its medium?

Amaranth Borsuk’s Between Page and Screen (2005) mediates the 3D spatiality of print books by inviting co-reading between human and computer readers. As the human user physically moves the book’s QR-coded pages in view of a computer reader’s camera, the computer retrieves and displays 3D visuals that are mapped onto the visual feedback. As Dr. Pressman argues in “Reorienting Ourselves toward the Material: Between Page and Screen as Case Study” (2018), Borsuk’s augmented reality book shows that “technology is not only part of the work but also part of the text to be read and compared” (323). Borsuk’s “3D concrete poem[s]” (323) reflect the 3D spatiality of “page and screen” interfaces. Following Dr. Pressman’s example of “the piggy poem” in Borsuk’s project as an allusion to the animal skins used in medieval manuscripts (326), we might consider how animal skins themselves form outer layers over complex interior systems, and how the reduction of these systems to a single, ‘2D’ exterior layer reduces the complexity of their multidimensional, mediated bodies.

From now on, I’ll view media objects as assemblages of layers. This is kind of blowing me out of the water in terms of reframing my approach to e-lit and animation studies. Engaging with the materiality of Gallop! in concordance with Hayles, Borsuk, and Dr. Pressman’s e-lit studies reveals the multidimensionality of media and media activation. The medium cannot be flattened. How might e-lit engage with this spatiality, and with the illusion of flatness, as narrative and material conflicts?