Realtime interaction technologies for sensors and video tracking

  Lecture in Tampereen yliopisto tietojenkäsittelytieteiden laitos /Tauhchi/UCIT 17.6.03  
Technologies :

Max-Jitter (graphical programming environment, realtime video
processing and OpenGl programming)
http://www.cycling74.com/
http://www.cycling74.com/products/jitter.html
SoftVns (realtime video processing and tracking)
http://homepage.mac.com/davidrokeby/softVNS.html
I-cube (midi-interface for sensors)
http://www.infusionsystems.com/
Basic Stamp (Programmable microcontroller)
http://www.parallax.com

Lecture notes:

  • Background: Philosophy, Theatre, Muu ry, David Rokeby, Ken Gregory, Interactive media art (1996-1999), Teaching 1998-2003, Doctoral studies 1999 ->
  • Mlab: Experimental interactions (1998 Custom interfaces, CIS, Affective interactivities)
  • Philosophy:
  • Kohti performanssin grammatologiaa - ajattelun ergonomia ja kirjoittamisen uudet teknologiat
  • Towards Grammatology of Performance – Ergonomics of Thinking and New Writing Technologies http://ethesis.helsinki.fi/julkaisut/hum/filos/pg/ylitalo/
  • Ergonomics of Thinking: the way we use our body affects the way we think and the process of thinking.
  • Body-mind question
    Exercise and work combined: introducing physical effort into “non-physical” work.
    Ergonomical question as a question of creativity.
  • Theatre and Drama: expressiveness of the body as part of interactive design (ifxs BLT, Floor of confusion)
  • SPR: Sensing-processing-response
  • How and what is “sensed”? how it is processed? What is the response? What is the context of sensing device? (pervasive? Ubiquitous? Sculptural? Architectural?)
  • HCI <-> HSI (Human- sign-interaction)
  • Max as prototyping and experimentation environment: quick to experiment.
  • What is max?
    Originally it was designed for midi controlled sound synthesis programming in IRCAM. 1990 commercial version for electronic musicians (realtime control)
    1998 MSP introduced
    2002 Jitter (matrix and openGl programming)
    SoftVns realtime videoprocessing and analysis
    Previously hardware (1996 I participated to Rokeby’s workshop in Copenhagen)
  • Basic Stamp: programmable microcontroller (sensor digitiser, robotics control)
  • Demo on max programming
  • Demo on connecting sensors to I-cube and Basic Stamp
 
 
kurssit