Navigation

Dr Marco Gillies

Staff details

PositionSenior Lecturer and Deputy Head of Department
Department Computing
Email m.gillies (@gold.ac.uk)
Phone+44 (0)20 7717 3378
Dr Marco Gillies

Marco Gillies is a senior lecturer in Computing and Deputy Head of Computing and a pioneer of interdisciplinary computing at Goldsmiths. He was one of the founders of the creative computing degree and has since been instrumental in developing several other interdisciplinary degrees including Digital Arts Computing and Games Programming. He is a co-founder of the Embodied Audio-Visual Interaction (EAVI) group and a co-director of the centre for Creative And Social Technology (CAST). 

Marco’s research centres on how we can create technologies that work with embodied, tacit human knowledge. He has many years experience of research into how to generate non-verbal communication for animated virtual character, particularly for social interaction in virtual reality. His approach focuses on the role actors and performers can play in creating autonomous characters. 

He has also worked on other forms of immersive experience and embodied interaction, particularly applied to immersive theatre and performance. His recent research has been on human-centred machine learning in which humans guide machine learning algorithms interactively as a way of making use of tacit human knowledge in artificial intelligence systems. 

Marco also has a keen interest in pedagogy and how technology can support teaching and learning, particular for creative learning. He has taught on two global Massively Open Online Courses (MOOCs) and was a Co-Investigator in the PRAISE project which created an online platform to support creative feedback for music learners. He also uses online technology innovatively in the courses he teaches. 

He has had a number of funded research projects from funders including the EPSRC, NESTA and the European Commision.  He is co-chair of the 2016 ACM SIGCHI Workshop on Human-Centred Machine Learning and co-chair of the 2017 Workshop on Movement Computing. 

Academic Qualifications 

  • PhD in Computer Science, University of Cambridge (2001)
  • BA in Computer Science, University of Cambridge (1997)

Teaching

Marco currently teaches programming. He teaches first year Introduction to Programming using Processing and C++ using Openframeworks in second year as part of Principles and Applications of Programming. His approach treats programming as a creative discipline and encourages students to follow their own creative interests in the projects they do. He is also interested in the social aspects of programming and learning and how to use technology to enhance social learning. 

In the past he has taught a number of modules on BSc Creative Computing (of which he was co-convenor for many years), a third year module on Advanced Graphics and Animation as well as modules on the MA/MFA Computational arts and the MSc Computer Games and Entertainment. 

He was one of the course leaders on Creative Programming for Digital Media and Mobile Apps one of the first English Massively Open Online Courses (MOOC) on the Coursera platform. The first run of the course had over 100 000 enrolled student. More recently he has taught on a MOOC specialization called Responsive Web Development and Design.

Area of Supervision: 

  • Animated Virtual Characters
  • Virtual reality
  • Full body and embodied interaction
  • Human-machine learning
  • Creative applications of machine learning
  • Technologies for immersive theatre and performance
  • Socially meaningful and alternative gaming

Featured Work

Research Interests

Computer animation, interactive virtual characters, non-verbal expression, motion capture

Publications

Book Section

Non-representational Interaction Design
Gillies, Marco and Kleinsmith, Andrea. 2014. Non-representational Interaction Design. In: Mark (J. M.) Bishop and Andrew Martin, eds. Contemporary Sensorimotor Theory. 15 Switzerland: Springer International Publishing, pp. 201-208. ISBN 978-3-319-05106-2

Mediating Performance Through Virtual Agents
Giannachi, Gabriella; Gillies, Marco; Kaye, Nick and Swapp, David. 2009. Mediating Performance Through Virtual Agents. In: Zsófia Ruttkay; Michael Kipp; Anton Nijholt and Hannes Högni Vilhjálmsson, eds. Intelligent Virtual Agents 2009. Amsterdam: Springer, pp. 439-445. ISBN 978-3-642-04379-6

Semi-Autonomous Avatars: A New Direction for Expressive User Embodiment
Gillies, Marco; Ballin, Daniel; Pan, Xueni and Dodgson, Neil. 2008. Semi-Autonomous Avatars: A New Direction for Expressive User Embodiment. In: Lola Cañamero and Ruth Aylett, eds. Animating Expressive Characters for Social Interaction. John Benjamins Publishing Company, pp. 235-255. ISBN 9789027252104

Affect Detection and an Automated Improvisational AI Actor in E-drama.
Zhang, Li; Gillies, Marco; Barnden, J A; Hendley, R J; Lee, M G and Wallington, A W. 2007. Affect Detection and an Automated Improvisational AI Actor in E-drama. In: , ed. Special Issue on Artificial Intelligence for Human Computing. Lecture Notes in Artificial Intelligence. (4451) Berlin/Heidelberg: Springer, pp. 339-358.

Semi-Autonomous Avatars and Characters
Gillies, Marco; Ballin, Daniel and Dodgson, Neil. 2003. Semi-Autonomous Avatars and Characters. In: Ruth Aylett and Lola Canamero, eds. Animating Expressive Characters for Social Interactions. John Benjamins.

Article

Virtual character personality influences participant attitudes and behavior – an interview with a virtual human character about her social anxiety
Pan, Xueni; Gillies, Marco and Slater, Mel. 2015. Virtual character personality influences participant attitudes and behavior – an interview with a virtual human character about her social anxiety. Frontiers in Robotics and AI, 2(1),

Fluid gesture interaction design: applications of continuous recognition for the design of modern gestural interfaces
Zamborlin, Bruno; Bevilacqua, Frédéric; Gillies, Marco and d'Inverno, Mark. 2014. Fluid gesture interaction design: applications of continuous recognition for the design of modern gestural interfaces. ACM Transactions on Interactive Intelligent Systems, 3(4), pp. 30-45. ISSN 2160-6455

Customizing by Doing for Responsive Video Game Characters
Kleinsmith, Andrea and Gillies, Marco. 2013. Customizing by Doing for Responsive Video Game Characters. International Journal of Human-Computer Studies, 71(7-8), pp. 775-784. ISSN 1071-5819

Socially Anxious and Confident Men Interact with a Forward Virtual Woman: An Experimental Study
Pan, Xueni; Gillies, Marco; Barker, Chris; Clark, David M. and Slater, Mel. 2012. Socially Anxious and Confident Men Interact with a Forward Virtual Woman: An Experimental Study. PLoS ONE, 7(4), e32931.

Comparing and Evaluating Real Time Character Engines for Virtual Environments
Gillies, Marco and Spanlang, Bernhard. 2010. Comparing and Evaluating Real Time Character Engines for Virtual Environments. Presence: Teleoperators and Virtual Environments, 19(2), pp. 95-117. ISSN 1054-7460

Piavca: a framework for heterogeneous interactions with virtual characters
Gillies, Marco; Pan, Xueni and Slater, Mel. 2010. Piavca: a framework for heterogeneous interactions with virtual characters. Virtual Reality, 14(4), pp. 221-228. ISSN 1359-4338

E-Drama: Facilitating Online Role-play using an AI Actor and Emotionally Expressive Characters.
Zhang, Li; Gillies, Marco; Dhaliwal, Kulwant; Gower, Amanda; Robertson, Dale and Crabtree, Barry. 2009. E-Drama: Facilitating Online Role-play using an AI Actor and Emotionally Expressive Characters. International Journal of Artificial Intelligence in Education, 19(1), pp. 5-38. ISSN 1560-4292

Learning Finite State Machine Controllers from Motion Capture Data
Gillies, Marco. 2009. Learning Finite State Machine Controllers from Motion Capture Data. IEEE Transactions on Computational Intelligence and AI in Games, 1(1), pp. 63-72. ISSN 1943-068X

Responsive Listening Behavior
Gillies, Marco; Pan, Xueni; Slater, Mel and Shawe-Taylor, John. 2008. Responsive Listening Behavior. Computer Animation and Virtual Worlds, 19(5), pp. 579-589. ISSN 1546-4261

Customisation and Context for Expressive Behaviour in the Broadband World
Gillies, Marco; Crabtree, I. Barry and Ballin, Daniel. 2004. Customisation and Context for Expressive Behaviour in the Broadband World. BT Technology Journal, 22(2), pp. 7-17. ISSN 1358-3948

Behaviourally rich actions for user-controlled characters
Gillies, Marco and Dodgson, N.. 2004. Behaviourally rich actions for user-controlled characters. Computers & Graphics, 28(6), pp. 945-954.

Eye Movements and Attention for Behavioural Animation
Gillies, Marco and Dodgson, N.. 2002. Eye Movements and Attention for Behavioural Animation. Journal of Visualization and Computer Animation, 13(5), pp. 287-300. ISSN 1049-8907

Conference or Workshop Item

Human-Centered Machine Learning
Gillies, Marco; Fiebrink, Rebecca; Tanaka, Atau; Garcia, Jérémie; Amershi, Saleema; Lee, Bongshin; Bevilacqua, Frédéric; Heloir, Alexis; Nunnari, Fabrizio; Mackay, Wendy; Kulesza, Todd and Caramiaux, Baptiste. 2016. 'Human-Centered Machine Learning'. In: CHI '16 Extended Abstracts on Human Factors in Computing Systems. San Jose, United States 26 April - 01 May.

Novel Dramatic and Ludic Tensions Arising from Mixed Reality Performance as Exemplified in Better Than Life
Donald, Nicky and Gillies, Marco. 2015. 'Novel Dramatic and Ludic Tensions Arising from Mixed Reality Performance as Exemplified in Better Than Life'. In: International Conference on Interactive Digital Storytelling. Copenhagen, Denmark.

Emotional and Functional Challenge in Core and Avant-garde Games
Cole, Tom; Cairns, Paul and Gillies, Marco. 2015. 'Emotional and Functional Challenge in Core and Avant-garde Games'. In: CHI Play 2015. London, United Kingdom.

Sketches vs Skeletons: Video Annotation Can Capture What Motion Capture Cannot
Gillies, Marco; Brenton, Harry; Yee-King, Matthew; Grimalt-Reynes, Andreu and d'Inverno, Mark. 2015. 'Sketches vs Skeletons: Video Annotation Can Capture What Motion Capture Cannot'. In: Proceedings of the 2Nd International Workshop on Movement and Computing. Vancouver, Canada.

Embodied Design of Full Bodied Interaction with virtual humans
Gillies, Marco; Brenton, Harry and Kleinsmith, Andrea. 2015. 'Embodied Design of Full Bodied Interaction with virtual humans'. In: 2nd International Conference on Movement and Computing. Vancouver, Canada.

Applying the CASSM Framework to Improving End User Debugging of Interactive Machine Learning
Gillies, Marco; Kleinsmith, Andrea and Brenton, Harry. 2015. 'Applying the CASSM Framework to Improving End User Debugging of Interactive Machine Learning'. In: ACM Intelligent User Interfaces (IUI). Atlanta, United States.

Embodied Design of Dance Visualisations
Brenton, Harry; Kleinsmith, Andrea and Gillies, Marco. 2014. 'Embodied Design of Dance Visualisations'. In: International Workshop on Movement and Computing. paris, France.

How I Animate: A Hand Gesture-Centric Technique
Mohd Mokhtar, Ezwan and Gillies, Marco. 2013. 'How I Animate: A Hand Gesture-Centric Technique'. In: EVA London 2013: Electronic Visualisation and the Arts. London, United Kingdom.

Suzie’s Dance: reliving dance through motion capture animation of photographs
Gillies, Marco; Zapata Gomez, Shakti and Zimmer, Sebastian. 2013. 'Suzie’s Dance: reliving dance through motion capture animation of photographs'. In: Electronic Visualisation and the Arts. London, United Kingdom.

Exploring Choreographers’ Conceptions of Motion Capture for Full Body Interaction
Gillies, Marco; Worgan, Max; Peppe, Hestia; Robinson, Will and Kov, Nina. 2011. 'Exploring Choreographers’ Conceptions of Motion Capture for Full Body Interaction'. In: The BCS Conference on Human Computer Interaction. Newcastle, United Kingdom.

Bodily Non-verbal Interaction with Virtual Characters
Gillies, Marco. 2010. 'Bodily Non-verbal Interaction with Virtual Characters'. In: Kansei Engineering and Emotion Research. Paris, France.

EMMA: an Automated Intelligent Actor in E-drama
Gillies, Marco; Zhang, Li and Barnden, J A. 2008. 'EMMA: an Automated Intelligent Actor in E-drama'. In: Proceedings of International Conference on Intelligent User Interfaces. Canary Islands, Spain 13th - 16th Jan 2008.

Male Bodily Responses during an Interaction with a Virtual Woman
Pan, Xueni; Gillies, Marco and Slater, Mel. 2008. 'Male Bodily Responses during an Interaction with a Virtual Woman'. In: Intelligent Virtual Agents. Tokyo, Japan 2008.

An Improvisational AI Agent and Emotionally Expressive Characters
Zhang, Li; Gillies, Marco; Barnden, J A and Hendley, R J. 2007. 'An Improvisational AI Agent and Emotionally Expressive Characters'. In: Workshop on Narrative Learning Environments, Supplementary Proceedings of the 13th International Conference of Artificial Intelligence in Education. Los Angeles, United States July 9-13, 2007.

Emotionally Expressive Characters in E-drama
Zhang, Li; Gillies, Marco; Roberson, D.; Oldroyd, Amanda and Barnden, J A. 2007. 'Emotionally Expressive Characters in E-drama'. In: In Proceedings of International Conference of Internet Technology and Secured Transactions. London, United Kingdom.

eDrama: Facilitating online role-play using emotionally expressive avatars.
Dhaliwal, Kulwant; Gillies, Marco; O’Connor, John; Oldroyd, Amanda; Robertson, Dale and Zhang, Li. 2007. 'eDrama: Facilitating online role-play using emotionally expressive avatars.'. In: The AISB Workshop on Language, Speech and Gesture for Expressive Characters. UNDEFINED 2007.

Expressing Complex Mental States Through Facial Expressions
Pan, Xueni; Gillies, Marco; Sezgin, T M and Loscos, C. 2007. 'Expressing Complex Mental States Through Facial Expressions'. In: Second International Conference on Affective Computing and Intelligent Interaction. Lisbon, Portugal.

Applying direct manipulation interfaces to customizing player character behaviour.
Gillies, Marco. 2006. 'Applying direct manipulation interfaces to customizing player character behaviour.'. In: International Conference on Entertainment Computing. UNDEFINED 2006.

Building Expression into Virtual Characters
Vinayagamoorthy, Vinoba; Gillies, Marco; Steed, A.; Tanguy, E.; Pan, Xueni; Loscos, C. and Slater, M.. 2006. 'Building Expression into Virtual Characters'. In: Eurographics Conference State of the Art Reports. Vienna, Austria 4-8 September, 2006.

Individuality and Contextual Variation of Character Behaviour for Interactive Narrative.
Gillies, Marco; Crabtree, I. Barry and Ballin, Daniel. 2006. 'Individuality and Contextual Variation of Character Behaviour for Interactive Narrative.'. In: AISB Workshop on Narrative AI and Games. UNDEFINED 2006.

Teaching Characters How to Use Body Language
Friedman, Doron and Gillies, Marco. 2005. 'Teaching Characters How to Use Body Language'. In: Intelligent Virtual Agents. Kos, Greece 12-14 September, 2005.

Affective Interactions Between Expressive Characters
Gillies, Marco and Ballin, Daniel. 2004. 'Affective Interactions Between Expressive Characters'. In: Proceedings of the IEEE conference on Systems, Man and Cybernetics. The Hague, Netherlands.

Integrating autonomous behavior and user control for believable agents
Gillies, Marco and Ballin, Daniel. 2004. 'Integrating autonomous behavior and user control for believable agents'. In: Third international joint conference on Autonomous Agents and Multi-Agent Systems. Columbia University, New York 2004.

Expressive characters and a text chat interface
Gillies, Marco; Crabtree, Barry and Ballin, Daniel. 2004. 'Expressive characters and a text chat interface'. In: AISB workshop on Language, Speech and Gesture for Expressive Characters. University of Leeds, UK March, 2004.

A Framework For Interpersonal Attitude And Non-Verbal Communication In Improvisational Visual Media Production
Ballin, Daniel; Gillies, Marco and Crabtree, Barry. 2004. 'A Framework For Interpersonal Attitude And Non-Verbal Communication In Improvisational Visual Media Production'. In: 1st European Conference on Visual Media Production (CVMP). IEE, London, UK 15-16 March 2004.

Efficient Clothing Fitting from Data.
Gillies, Marco; Ballin, Daniel and Csáji, Balázs Csanád. 2004. 'Efficient Clothing Fitting from Data.'. In: 12th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision (WSCG). Plzen, Czech Republic 2-6 February 2004.

A Model of Interpersonal Attitude and Posture Generation
Gillies, Marco and Ballin, Daniel. 2003. 'A Model of Interpersonal Attitude and Posture Generation'. In: Workshop on Intelligent Virtual Agents. UNDEFINED.

Integrating Internal Behavioural Models with External Expression
Gillies, Marco; Ballin, Daniel and Dodgson, Neil. 2002. 'Integrating Internal Behavioural Models with External Expression'. In: PRICAI '02 International workshop on Lifelike Animated Agents: Tools, Affective Functions and Applications. Tokyo, Japan 2002.

Autonomous Secondary Gaze Behaviours
Gillies, Marco; Dodgson, Neil and Ballin, Daniel. 2002. 'Autonomous Secondary Gaze Behaviours'. In: AISB workshop on Animating Expressive Characters for Social Interactions. Imperial College, London 2002.

Invariants and Affordances for Walking in a Cluttered Environment
Gillies, Marco and Dodgson, Neil. 1999. 'Invariants and Affordances for Walking in a Cluttered Environment'. In: Second Workshop on Intelligent Virtual Agents. University of Salford 1999.

Ball Catching: an example of psychologically-based behavioural animation
Gillies, Marco and Dodgson, Neil. 1999. 'Ball Catching: an example of psychologically-based behavioural animation'. In: Eurographics UK 17th annual conference. UK 1999.

Psychologically-based Walking in a Cluttered Environment
Gillies, Marco and Dodgson, Neil. 1999. 'Psychologically-based Walking in a Cluttered Environment'. In: Eurographics `99 Short Papers and Demos. Milan, Italy 1999.

Report

Coney: Better Than Life
Mees, Annettte; Wright, Tim; Donald, Nicky; Gillies, Marco; Milne, Austen and Prime, Sian. 2015. Coney: Better Than Life. Project Report. NESTA, LONDON.

Practical behavioural animation based on vision and attention
Gillies, Marco. 2001. Practical behavioural animation based on vision and attention. Technical Report. UCCL, Cambridge.

Software

Gestyour
Gillies, Marco. 2014. Gestyour.

Other

CO3355 Advanced graphics and animation subject guide
Devlin, Kate and Gillies, Marco. 2014. CO3355 Advanced graphics and animation subject guide. UCL, Goldsmtihs, University of London International Programme.