Main menu
Staff & students

Professor Marco Gillies

Staff details

Professor Marco Gillies

Position

Professor / Academic Director of TaLIC

Department

Computing

Email

m.gillies (@gold.ac.uk)

Goldsmiths Research Centres/Groups

Professor of Computing. Co-director SEEVR lab and MA/MSc V&AR

Marco is co-director (with Xueni 'Sylvia' Pan) of both the Masters in Virtual and Augmented Reality and the Social, Empathic and Embodied Virtual Reality Lab. He has been researching Virtual Reality and Artificial Intelligence since the late 1990s and has particularly worked on virtual humans and movement based interaction with VR.

In the past he has also been Academic Director: Distance Learning and Academic Director of Goldsmiths' Teaching and Learning Innovation Centre. He co-founded the BSc Creative Computing degree at Goldsmiths, which was a key part of establishing Goldsmiths Computing as a key centre for applying computing to the arts and creative sectors. He co-created the first MOOC from an English University and was instrumental in developing Goldsmiths' large scale online degrees: BSc Computer Science and MSc Data Science.

Academic qualifications

  • PhD in Computer Science, University of Cambridge 2001
  • BA in Computer Science, University of Cambridge 1997

Teaching and supervision

Marco Co-directs and teaches on the Masters in Virtual and Augmented Reality.

He supervises Masters and PhD projects in many areas relating to Virtual Reality and Immersive media, particularly the interface of VR and AI/Machine Learning, Movement-based and Embodied forms of interaction and social interaction in VR and AR.

Research interests

Marco's research covers a wide range of areas of virtual reality and immersive media, particularly in three major areas:

  • The application of AI and Machine Learning to VR
  • The use of full body movement for interaction with immersive media
  • Social interaction in VR, AR and MR

These three strands are tightly intertwined. Machine learning is a key technology for recognising and designing movement based interaction; body movement and body language are a vital part of what makes VR a powerful medium for social interaction, and social interaction can be with AI characters as well as real people.

Marco is also interested in human-centred approaches to AI and machine learning that use HCI methods and epistemologies to enable machine learning as a creative tool.

His work is highly interdisciplinary and includes applications and collaboration with fields such as dance and performance, medicine, education, games development, critical disability studies, developmental psychology and social neuroscience.

Publications and research outputs

Article

Dewe, Hayley; Gottwald, Janna; Bird, Laura-Ashleigh; Brenton, Harry; Gillies, Marco and Cowie, Dorothy. 2022. My virtual self: the role of movement in children's sense of embodiment. IEEE Transactions on Visualization & Computer Graphics, 28(12), pp. 4061-4072. ISSN 1077-2626

Dobre, Georgiana Cristina; Gillies, Marco and Pan, Xueni. 2022. Immersive Machine Learning for Social Attitude Detection in Virtual Reality Narrative Games. Virtual Reality, 26(4), pp. 1519-1538. ISSN 1359-4338

Slyman, Souad; Gillies, Marco and Lytra, Vally. 2022. Developing an Evaluation Framework for Analysing Educational Simulation Games. Proceedings of the 16th European Conference on Games Based Learning, 16(1), pp. 526-534. ISSN 2049-0992

Conference or Workshop Item

Fiorucci, Andrea; Yee-King, Matthew and Gillies, Marco. 2023. 'Beyond Motivation and Engagement: Students’ Voices on the Use of Game-Based Learning in a Bachelor Computer Science Online Degree'. In: 2023 ACM Conference on Information Technology for Social Good (GoodIT ’23). Lisbon, Portugal 6 - 8 September 2023.

Park, Seonjeong; Carlisle, Damaris; Gillies, Marco and Pan, Xueni. 2023. 'Reducing Foreign Language Anxiety with Virtual Reality'. In: 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). Shanghai, China 25-29 March 2023.

Jamalian, Nima; Gillies, Marco; Leymarie, Frederic Fol and Pan, Xueni. 2022. 'The Effects of Hand Tracking on User Performance: an experimental study of an object selection based memory game'. In: 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). Singapore, Singapore 17-21 October 2022.

Book Section

Havemann, Leo; Katan, Simon; Anstead, Edward; Gillies, Marco; Stroud, Joanna and Sherman, Sarah. 2023. Digitally supported assessment. In: Linda Amrane-Cooper; David Baume; Stephen Brown; Stylianos Hatzipanagos; Phillip Powell; Sarah Sherman and Alan Tait, eds. Online and Distance Education for a Connected World. London: UCL Press, pp. 195-210. ISBN 9781800084810

Gillies, Marco and Kleinsmith, Andrea. 2014. Non-representational Interaction Design. In: Mark (J. M.) Bishop and Andrew Martin, eds. Contemporary Sensorimotor Theory. 15 Switzerland: Springer International Publishing, pp. 201-208. ISBN 978-3-319-05106-2

Giannachi, Gabriella; Gillies, Marco; Kaye, Nick and Swapp, David. 2009. Mediating Performance Through Virtual Agents. In: Zsófia Ruttkay; Michael Kipp; Anton Nijholt and Hannes Högni Vilhjálmsson, eds. Intelligent Virtual Agents 2009. Amsterdam: Springer, pp. 439-445. ISBN 978-3-642-04379-6

Report

Mees, Annettte; Wright, Tim; Donald, Nicky; Gillies, Marco; Milne, Austin and Prime, Sian. 2015. Coney: Better Than Life. Project Report. NESTA, LONDON.

Gillies, Marco. 2001. Practical behavioural animation based on vision and attention. Technical Report. UCCL, Cambridge.

Software

Gillies, Marco. 2014. Gestyour.

Other

Devlin, Kate and Gillies, Marco. 2014. CO3355 Advanced graphics and animation subject guide. UCL, Goldsmtihs, University of London International Programme.

Research projects

2022: The plasticity of the bodily self: how function and age shape the acceptance of virtual bodies.
A ESRC funded collaboration with Dorothy Cowie at the University of Durham that investigates how adults and children can adapt to virtual bodies with different appearances and functions

Immersive, Innovative, and Interactive Experience (IIIE): A Technology Driven London-Shanghai Partnership in Mixed Realities and Performing Arts
Led by Xueni 'Sylvia' Pan, this AHRC funded project aims to foster collaboration between the creative sectors in the UK and China around immersive media and performance

2019-2021: 4i: Immersive Interaction Design of Indie Developers using Interactive Machine Learning
An EPSRC funded collaboration with University of Coventry CDARE, UAL CCI and Gibson/Martelli, looking at using machine learning to enable dancers and artists to design movement interaction for VR

2018-2019: AI-Driven Characters for Immersive Narrative Games
An InnovateUK funded collaboration with game studios Maze Theory and Dream Reality Interactive that applied machine learning to social interaction with immersive game characters for Peaky Blinders

2017-2020: Understanding and generating real-time face-to-face social interactions
A Leverhulme funded project led by Antonia Hamilton of the UCL Institute of Cognitive Neuroscience using motion capture and machine learning to understand non-verbal social interaction.