5. MUTO-21



A short film we made to demonstrate our speculative design piece centered around vision


2021
In collaboration with Georgios Grigoriadis, Peipei Lin, and David Zhou
Speculative Design; Software Design; Storytelling


MUTO-21 is a speculative design “provocation” that explores the idea of using computer vision to control fruit prices at a dystopian fruit stand in 2051. The system uses facial attributes to adjust a pricing system in favor of the vendor.

Prices are regenerated when scanning a face at the fruit stand

To make our system functional, we explored a variety of facial recognition softwares before choosing DeepFace in conjunction with a Raspberry Pi, webcam, speaker, and laptop. Using python, I built a system architecture that allowed a photo to be captured and processed on a computer, before sending DeepFace results and pricing attributes to the Raspberry Pi via MQTT. I also spearheaded the design of the fruit stand itself, using objects from home to build a dystopian scene. I created media (posters and newspaper articles) for enhanced immersion in our video and critique presentation.

This project led to a range of discussions - from the ethics of computer vision in general, to the use of data to modify prices for maximized profit. While speculative in nature, this project was rooted with real technologies and posed a technical challenge for our entire team.

Team whiteboard sketches from brainstorm of themes, experiences, and scenarios

Experimenting with DeepFace for face detection and analysis; DeepFace returns age, gender, emotion, and race

Rough story board for the user interaction with the technology; customer approaches stand, analysis is run on customer with data presented to vendor, prices adjusted for customer to maximize vendor profit

Wiring pricing displays to RaspberryPi, while maintaining a dystopian, hacked-together look
Building fruit stand and using found objects for both the structure and fruit displays
Newspaper with custom stories from 2051 for our video and immersive world building
Propaganda poster for video and world building, centered around computer vision
Fruit stand with pricing displays in action; filmed in parking structure
Final fruit stand, “Adam’s Fruits”, with fruit and other custom props

Mark