Future Interfaces HMWK #1: 12 ideas > 3 culled


I. An AR interface that allows every given, discrete system a user interacts with to be recognized via computer vision and other sensing systems and cross-referenced in a global library of systems.  The system is then visually outlined and tracked (over the course of the day, or month, or lifetime) as if it were an Information Processing System with INPUT, FUNCTIONS, and OUTPUT.   This could be seen as a societal alternative to the economic (credit, debt, work, worth) tracking systems we have had in place and continue to build. 


An AR or VR interface which allows energy expenditure of the user/experiencer/protagonist to be tracked via  (piezoelectric?) contact with the ground.

Inspiration comes from the idea that certain animals like cats are very sensitive to ground vibrations - and the idea that this is a way a user can understand the surrounding world. 

If a user takes many heavy footsteps - in sand, grass, mud, or on a marble flooring surface - the kinetic energy output will vary and should reflect some level of organismal entropy or energy waste.  Opportunity to examine other cues of contact with the ground - such as resting period, or body surface contact to ground surface area. This kind of 'kinetic metadata' may tell an illuminating story of the user/organism's energy expenditure and struggle with gravity and the stochastic boundaries of its surrounding world.  Also incorporates predictive trajectory but value added is the energy expenditure/footstep (contact instances/frequency with ground replace or help calculate time discretization) I see this as part of a larger 360 VR interface. 


An orb with a windshield-like view which accommodates the human field of vision (200 degrees field-of-view).  The rear 160 degrees of view is a blank 'tallying' interface which allows elements (story characters,  past spacial trajectory, artifacts, documents, to be held for reference.)  The ground area can also carry the kind of trajectory and kinetic expenditure information as touched on in "KINESIS."

This is a tool/interface/HUI for narrative-telling, narrative-absorbing, and narrative interweaving - for entertainment purposes or for work stylings and organization.  


A way to tell stories such as a traditional narrative feature film with temporally concurrent spatial grid of 360 VR cameras.  The user/experiencer can wander through the finite block of time and space at will - following visual and auditory cues to various nodes in the story's space.  The user becomes the editor and there are a many unique 'cuts' as there are frames per second x the number of camera nodes.  Filmic transitions are augmented according to same principles as traditional film editing but they are quite different as space and time are continuous and non-selective.  

An interesting note about this idea is that it is effectively observation-only time travel.  A future effect is that if the writing, or reality of a mystery is deep, tight, and diverse enough one could spend a very long time inside the 'continuum.' Perhaps humanity will find a good one and the human perceptual universe will condense into this small spacetime box.  The ultimate in diversion. 


AR which interfaces with an all-inclusive energy system.  Users plugged into this augmented reality interface are revealed trajectories of 'lowest entropy' on a continuum of time discretization scales.   Perhaps if all users where guided, by visual representations of unified energy flows (kinetic, radiative, social, societal, biospheric, gravitational, solar, nutritive) then this would become every human/user's life work - remaining collectively at the lowest state of entropy. Predictive entropy trajecotories for thoughts and social interactions would be included in concrete energy expenditure terms - NLT and social networking prediction would have to be sufficiently advanced to see into various futures.  As a result, perhaps metabolic processes, as well as interpersonal, societal, and environmental entropy or stress would remain so low that the human life span would increase while harmful forms of energy waste would decrease. An alternative, physical way of achieving "immortality" while exponentially increasing our collective, and individual knowledge base.  This is a hyperbolic post-automation system which supersedes all forms of advertising, PR, data collection/surveillance, economy and governance and seeks to bring the human species back to a pre-language, pre-agricultural communion with nature.  

This is a fictional/exemplary/hypothetical AI-mediated multi-agent VR system I am incorporating in a screenplay about a human-trajectory peer android, as well as in a documentary I am working on with Sabrina Osmany about AI-mediated immersive interfaces.  

The inspiration for this stems from Spring 2015 semester in which I studied Energy (a survey of terms, trends, history, and physics) and the Green Revolution in a class on the Anthropocene.  What is needed is a unified term for thermodynamics, and energy in closed and open systems.  For example, Joules are an appropriate option for a unit which represents a current energy state of any given system or object, however, our linguistic obsession with 'time' obfuscates this and so understanding devolves and compartmentalizes into specialized terms like t.o.e. (tonnes of oil equivalent) which are impossible for any given human organism to understand and make decisions around, collectively or individually. 

This is of course ambitious but indeed cuts right to the heart of what humanity hungers for. 


A way to map different senses and allow the human brain to perceptually explore different kinds of input in tandem or in place of another.  A way to understand energy waves and explore the edges of the nature of reality versus the nature of perception.  See sound, hear color, feel color, see and hear texture, texture informs taste, taste informs texture.  Requires a neurological "jacking" in to a sensory signal mapping processor or information processing system. 


inspired by Rust Cohle's quote about time being "a flat circle" - allows user to see spaces which persistently remain unchanged over 'time.'  Concretely reveals patterns in rate of change.  Like a spatial time lapse. A way to identify spatial connection to things that persist through time.  A kind of time machine hack and an archaeological/forensic tool. 


inspired by the writings of Ernie Davis - he refers to the physics engine in our heads.  An accelerated way to learn about real world physics which would take a lot of time normally to learn through experience.  Augmented reality which temporarily breaks away from the current trajectory into an alternative path (i.e. see what that rock thrown at a window would actually do without having to throw the rock)


A way (using NLT and brain interface) to distribute information processing using human "neural networks" together with an AI mediated distro system.  Perhaps a way to prevent AI from learning too much content or too many weighted connections - an information and learning firewall.  The AI network is geared towards learning how to slowly shift the networking distribution processes to an exclusively human brain comprised deep neural network.  A form of telepathy.  Making AI do interim work to help humans collectively reach an event horizon/singularity. 


An AR interface which selectively allows only human emotion to be perceived, for example.  It prevents us from seeing physical features and only allows us to see Infrared maps of human emotion.  


Using slips/gaps/edges between energy flows. The idea that language separated humans from a pre-language level of fitness/evolutionary success and thus technology became an addictive way to interface with the environment and other individuals in our species and other species. How to move away from technology as a material and separating element. Unification and lowest energy usage. Reference to boomerangs is the elegance but far reach of this technology.  Just a stick shaped the right way.  Intuitive.  Divining rod. What are other examples of "simple" technologies which are yielded from a very high level of understanding.  Echolocation. Polynesian current charts. Quantum vibration-finding. 


preventing the user from hearing/processing language - forces users to communicate differently in a world/interpersonal interface. 


An ontological object oriented programming language for physics simulation/computer graphics based on Kelvins - absolute temperature.  Liquid, gas, solids, things more readily recognized as pure or higher states of energy such as different wavelengths of light or sound.