Amy-Cartwright

View the Project on GitHub amycartwright/Amy-Cartwright

Creative Process

Disclaimer - This piece is a work in progress, here you will find my research, discoveries, experiments and ramblings. This is not finished documentation but will form the basis of that once the piece has reached a conclusion. I will strive to keep it as detailed and current as possible but please forgive any gaps or non-sensical writing!

Concept

My aim is to make a dance piece that continues explorations that I began in my previous piece “Dancers In White, Standing”(DIWS). My research centers around the possibility of giving non-human dancers agency in the performance space. This topic was touched upon in that piece and will be extended here by presenting a different robotic structure in a different performance setting.

In DIWS there were two main elements - Human Dancer and Non-Human Dancer. They related to each other, non-human dancer took movement data from the human dancer and the human dancer responded to the motions of the non-human dancer. A loop was created and both performers where responsible for the gradual real time build of the choreography. For this piece I would like to add an additional element. The non-human dancer will still take movement data from the human dancer but the human dancer will take influence from another source. Rather than creating a feedback loop this piece will operate more like a game of ‘Chinese Whispers’.

The question I face here is what is this ‘other source’ that the human dancer will take influence from? This is something that requires a lot of consideration as ultimately the data taken from this source will drive the choreography of the entire piece. I would like to use archival footage of older dance works, perhaps works that are no longer being performed. The human dancer will respond to the footage and the non-human dancer will, in turn, respond to the human dancer. With each displacement the movement will move further from the original but a new work will be created. The final stepping stone of the chain will produce a piece performed by the non-human dancer which will act almost like a memory of the original footage. Altered and shifted over time but related non the less.

As with DIWS I would like the movement of the human dancer in this piece to be improvised. Improvised movement allows for the unexpected. If the movement is choreographed the robots motion (which is dependent on data from the human dancer) will be the same in each performance. This unexpectedness allows for more agency.

When thinking about the movement capabilities of my robotic performer I am attracted to the motion of linear actuators  , as the motion of extension they have is not something that we see when observing movement in the human body. When we talk about movement and choreography we often refer to expanding the body into the space around us. A linear actuator physically expands into the space. I would like to experiment with this type of movement. Is it too abstract? Is there still allowance for the audience to look at it as a performer or is more familiar and relatable shape essential? Do we need to be able to relate to the motion of the mechanical performer in order for us to view it as a performer. These questions are difficult to answer at this stage but I think are worth further exploration.

The software will make use of computer vision (CV). A camera will capture the human dancers movements which will be translated into location based data. This data will then be manipulated and set to the non-human dancer. Why is it so important to me to use computer vision? Explore the gap between using something like a potentiometer and computer vision. There is a difference. What is it? How can you show this? How can you demonstrate this? Open the crack wider. Using CV gives the non-human dancer a sense. They are able to see the human - dancer (in the same way that I can see a another dancer on the stage with me) they can collect data and interpret it into information that is useful for them. Exploring agency, when I use cv there is another person in the room with me. I can experiment and find out what works what doesn’t, what is surprising. the agency coming from the physical can be faked. Fine line - sit just below it. The software can fill any gaps in agency - So how the robot respond to the human.

Does a non-human dancer need to be limited to the senses of a human dancer? Whoa big question!

How can I explore code each day while still allowing myself to explore movement?

(Insert render of imagined set up)


Early Experiments

Build

Cardboard prototype of a very simple Electromechanical Actuator  

Next steps for this prototype will include constructing a more solid physical form using plastic tubing and 3D printing. I will then work on the software. Introducing CV and running a series of tests to see how the movement of the human can effect the movement of this very simple ‘part’. And even more important what the effect is on the onlooker when watching this ‘part’ moving alongside a human body in a shared space.

First Prototype of Electromechanical Actuator using Computer Vision.

This video shows a quick motion test using color tracking. The movement of the part is mapped to the movement of the hand along the x axis. When my hand extends through the space the piston physically extends into the space.

Following on from this initial build I felt that the range of motion of the part could be increased with some minor adaptations to the physical structure. Instead of connecting the moving lever to the outermost edge of the tube that moves I have connected it to the bottom edge. This allows th tube to extend much further into space. Problems with this build include an increased sense of instability as the tubes disconnect much easier. I think to solve this problem the tubes need to be longer.

Notes Notes Notes

I would also like to work on the aesthetic. Rather than a solid tube I would like to try 3D printing a mesh tubing design. The design shown below has been created using a Voronoi diagram. I like the delicacy of this design which is influenced by the design of some modern day prosthetics.

Notes

Software Options

Color Tracking I have used this technique before. It will allow me to track motion of one/several specific points on the body. Issues with this are that I do not want the tracking to be obvious. I don’t want to pull the audience out of the state of watching the performance by highlighting how the robots are working. I feel very strongly that this will minimise overall perceptive agency. There are also issues with setup, when using color tracking the environment need to be very carefully setup with appropriate lighting. This is suitable if the piece will always be performed in a controlled environment but not ideal for the longevity of the piece.

Kinect As I am working with abstract robotic forms I don’t think using the Kinect skeleton tracking is necessary. There is no need to track the motion of the specific points of the human body. The Kinect has a lot of wiring which can be tricky and it has a very specific presence in the space. I would like to avoid the look of interactivity that comes with having a Kinect in the space.

Optical flow Will allow the robot to look at the movement almost as if looking with blurry gaze. Able to see the directions of motion without looking at one specific body part. Given that the range of motion that the robot has is significantly reduced from that of the human dancer I think this is a good approach. It allows for a visual connection between the two without being to exact.

Machine Learning ????

Later Experiments

I needed to start finalising the physical structure and so asked Daniele Mancini to come on board and help with the design and build. In our first meeting he was able to articulate my conceptual thoughts visually in Fusion.

Notes

This new structure is intended to be the bottom half only and demonstrates it’s’ movement capabilities. The addition of movement originating from the base of the structure creates a more visually pleasing type of motion. Before the non-human dancer would be supported by a static ‘stand’. Now the stand become part of the non-human dancers body. The motion from this axis point would be subtle almost like it is swaying in the wind. Most of the motion would come from the ‘crown’ which would be positioned on top.

Notes

On thinking more about this new structure I realised that I was not so interested in the motion of the ‘crown’. I felt that it was overly complex and potentially distracting. I decided to focus on the motion of the ‘stand’. Creating a tall structure that sways with the motion of the dancer. I think that by simplifying the range and style of motion there is an opportunity to look into the detail of the motion and choose appropriate rules for motion for the non-human dancer.

Notes

The one with 3 legs may be too unstable. So I pursued the flat table option. Rather than using a square I have been advised to use a triangle with 3 servo motors, one at each point. Each of these will have a cam attached which will work by translating the rotational motion to linear motion allowing the triangle plane to tilt. See sketch below:

Notes

This sketch also shows an additional iteration which uses pneumonic controlled by syringes. This would solve the problem of the jittery motion that comes from using servo motors. The servo motors would be replaced by stepper motors, like the ones in floppy disk/CD drives. These motors would be used to push syringes which it will push liquid up towards a second syringe which would then tilt the flat plane.

A first small scale prototype of the final design. This one currently uses servo motors. I would like to complete a working version of this before moving to the syringe. It may not be entirely necessary depending on how jittery the motors are.

Notes Notes Notes Notes

Proof of structure concept

Data input

Trisha Brown - Watermotor

Trisha Brown - Accumulation

Yvonne Rainer

Trisha Brown - Floor of the Forest

Yvonne Rainer - Room Service

Rite of Spring 1

Rite of Spring 2

Rite of Spring 3


Reading

Movement Matters: How a Robot Becomes Body

Capturing and Documenting Creative Processes in Contemporary Dance

The Delay Mirror: a Technical Innovation Specific to the Dance Studio

Sentimental Soft Robotics as Companion Artifacts

Kinetic predictors of spectators’ segmentation of a live dance performance

Algorithmic Reflections of Choreography

Leveraging morphological computation for expressive movement generation in a soft robotic artwork


Resources

Erwin Wurm

Cyrus Kabiru

Oscar Schlemmers Ballet of Geometry

Open Ended Group - work with choreography and code

[Marc Downie Thesis - Choreographing the Extended Agent: performance graphics for dance theater] (http://openendedgroup.com/writings/downieThesis.html)

And all the question marks started to sing

What its like to be a robot - Ted Talk + Written speech

Caroline Liebl

Goodbye Uncanny Valley - Alan Warburton

Undercurrents - Albert Omass

Design Kit - Useful for ideation and planning of a project

Gibson and Martelli latest research proposal

Zach Liberman talks about his artistic practice

Neural Magazine

Eric Min Hcuong Castaing

Motion House Charge

Merging Dance, Robotics and AI

Pinoke

Robot made using linear actuators

How to stick form lab prints together

Formlab tech specs

Making 3D Voronoi Model in Meshmixer;

Useful blog on using Osc in processing

Design inspo

Video Documentation, Kasseler Kunstverein, 2016 Rechnender Raum Installation views, 2007-2016 RECHNENDER RAUM

Micro Linear Servo

Tilt Mechanism

507 Mechanical motions

cam

hydraulic robotic arm

CD Rom Stepper Motor with Arduino

Robotic Tentacle

Stepper Motor research

video - 3 stepper motors each with its own driver

Adafruit documentation

Video - 3 steppers with 2 stacked shields

Blog - 2 adafruit shields 4 motors, includes code

Video - controlling multiple stepper motors with Arduino

Easy Driver Specs

How do I run 3 stepper motor on one arduino? - some useful answers

Controlling 3 stepper motors simultaneously - code

Easy Driver Page - very useful - circuit diagrams, and code for multiple uses

AcellStepper library - allows use of multiple motors

Sparkfun easy driver setup

Wire research

Piano Wire

Fishing Wire

Flower wire

Spring research

The springs I need!

Wireless serial connection

XBee

Extra TXBRCHARIsANLixNyzazsyioO1k1aq7U8_GET6chl2uAQVx7vNyPh5TKSgLasZT63hwVEaAtNDEALw_wcB

Braided Sleeving


Notes (Dumping Ground)

Feedback sessions

10/01/18 First session rough notes following discussion with tutor and peers

Notes Notes

17/01/18 Preliminary thoughts - notes in image below taken by tutor

Notes

24/02/18 How to use blogging and writing to accompany your artistic practice

Writing Task

07/02/18 Brief notes detailing discussions

Notes

21/02/18 Specific details - notes in image below taken by tutor

Notes

Thoughts about the title of the piece: Audrey

Audrey works as both the name of the non-human dancer and the name of the piece as a whole. It is inspired by:

‘Audrey Munson’ - who was the model for a huge amount of the statues in NYC. She is the face that gives agency to so many fictuous, religious and historical figures. “Audrey Munson, whose likeness can be found throughout Manhattan publicly representing consummate concepts like freedom, purity, peace and truth, ranked among the most sought-after muses for painters and sculptors for the first quarter of the twentieth century.” “Wiki

‘Queen of the artists studios’ - Andrea Geyer

Vocabulary: Robot, Non-Human dancer, Non-human performer,

CCL / Sensorium 2018

Anthromorphism when working with non-human forms - Mapping between two extremely different bodies. Remove politics and preconception by making robots non-human looking.

Machine Learning

Toby K

Machine Learning does not require language –> we let the machine figure out the steps needed to solve the task.

Different types of machine learning algorithms

Machine learning is not inherently connected to AI

Be careful of language used. Machine learning does not mean machine understanding. i.e. Just because a machine responds to emotion does not mean it understands that emotion.

Maria Judova

Website

How do we capture a moving body? Communication between dancer and non-dancer.

Impact can be created with simplicity –> too much input can be overkill

Dance will always have noise. We need to filer this noise when working with computational elements but bow can it be filtered without loosing meaning?

Mental image of movement is different from an actual movement.

Boundaries between real and virtual.

Generative footage vs found footage

‘Dust’ - Not only VR as the user us able to see themselves in the surroundings they are currently in. The real world existing in the virtual that can be manipulated.

Alphabet Box/Cube - Trisha Brown.

Mio Sinclair

Waltz Binaire

Kandinsky - Point –> Line –> Plane. Can this be used as a way to communicate dance?

What do you do when it stops working is there a contract for this?

Most important WHY –> Why does the tech exist in the piece? –> Why am I making this work?

How do we perceive dance?

Actors moved to TV, musicians moved to Radio, Dance refused to fit through a cable. –> This is the beauty of dance. Is it the intention of the dancer that doesn’t fit through the cable?

Modern Dance is a technology a technology that Pina Bauch used to make ‘The Rite of Spring’ which is the grounding of dance. It pulled dance back into the earth and completed the story of modern dance. Any modern dance made after this piece is seen as cheesy because it has already been peaked.

Old German Law –> Humans are defined as creatures that see themselves.

Ka Fai Choi

Website

Muscle stimulation using electricity

Alan Lomax Film - Dance and Human History

What are the choreographic minds of future dancers?

What do we think about when we think about dance?

Using renders to show a hypothetical work –> this allows the art work to exist even before it can exist in real life. Allows the artist to work with technologies that are not yet invented or not advanced enough for purpose. Allows the artist to explore avenues that seem unobtainable in reality .

Joshua Nobel

Designing less real

Design is an anti discipline –> there are no values

Elliot Montgomery –> unreserved mapping of speculative design

Anthropology not fiction

Minimum Viable Reality

Free yourself from what you can build –> you can make more real things with less real things.

The tool is just the tool,not the artwork or the design. It is a step towards giving understanding to the art/design.

Jessica In

Stuart Brand - Pace Layering

Lucinda Childs - choreographic notation

How can you visualize things that are not seen?

Anthropmorphising geometric shapes Norman McLaren

Alexander Scholz

Website

Holo Magazine

READ - System Aesthetics other info

Artists in this field often have difficulties identifying what we do.

Parachute somewhere –> Explore the possibilities –> Go beyond the horizon.

Things that are not computable cant exist. Things that are not computable are becoming strange and are ceasing to exist,

Florian Kramer - Transmediale Publication

Andrej Boleslavski

Website Physicality to Virtual Media

Choreographic objects. Objects that guide movement through the space.

All digital art is performance. They have the same problem of limited life space as live performance as the tech used becomes obsolete very fast.

Github id144

Joachim Sauter

Website

The infusion of physical into digital world

Poetry of motion

Phygital Postvirtual Neophysical Postdigital

artcom.de

Extra notes

Caroline Liebl

Jeanne - All technology has agency when put on a stage. How do we deal with this?

People to talk to