Dr Kia Ng
Senior Lecturer in Computing & Music
Office hours: Wednesday 12.00-1.00pm
BSc(Hons), PhD, MIEEE, MBCS, FIoD, FRSA, FVRS, CITP, CEng, CSci
Kia is a senior research lecturer at the University of Leeds where he is co-founder and director of the Interdisciplinary Centre for Scientific Research in Music (ICSRiM). Kia’s research links together work in the School of Computing and the School of Music on Multimedia, Computer Vision, Computer Music and digital media.
Kia is involved in several research domains relating to 2D and 3D imaging, multimodal analysis, gestural interfaces, interactive multimedia, digital preservation, computer vision and computer music, in collaboration with many European and international organisations and individuals in the field. Large-scale projects include i-Maestro on technology-enhanced learning (Coordinator), CASPAR on digital preservation and AXMEDIS on cross-media (Principle Investigator) with over 20M Euro research funding.
He has also worked on automated recognition and restoration of printed and handwritten music manuscripts, paper texture and watermark analysis. His Music via Motion (MvM) system allows users real-time control of musical sound using their physical movement.
Kia has more than 150 publications and presented talks in over 30 countries including keynotes and invited lectures in Canada, China, France, Germany, Japan, UK, and USA. He has appeared on television and radio interviews such as BBC, Sky, and has been featured in the New York Times, Guardian, Financial Times, Sound on Sound, Photonics Spectra and others.
Kia has also organised over 15 international events including conferences, exhibitions and a convention.
Interdisciplinary projects include:
- Ruskin Rocks, www.leeds.ac.uk/ruskinrocks/, www.ruskinrocks.org.uk, supported by Natural England, in collaboration with Dame Evelyn Glennie, Brantwood, the School of Earth and Environment, and others.
- I-MAESTRO: Interactive Multimedia Environment for Technology Enhanced Music Education and Creative Collaborative Composition and Performance, www.i-maestro.org, supported by EC IST FP6 (as Project Coordinator)
- AXMEDIS: Automating Production of Cross Media Content for Multi-channel Distribution, www.axmedis.org, supported by EC IST FP6 (principle investigator)
- CASPAR: Cultural, Artistic and Scientific knowledge for Preservation, Access and Retrieval, www.casparpreserves.eu, supported by EC IST FP6 (principle investigator)
- Interactive Multimedia MUSICNETWORK, www.interactivemusicnetwork.org, supported by EC IST FP5 (principle investigator)
- COST287-ConGAS: Gesture Controlled Audio Systems, supported by the European Science Foundation (as UK representative)
- Music via Motion, supported by the Arts Council England (principle investigator)
- Yorkshire Quarry Arts, supported by the MIST (The Mineral Industry Sustainable Technology programme)
- co-programme-director, BSc/BA (Hons) Music Multimedia and Electronics (MME)
- module leader, MSc Perceptual Systems (PSS, COMP5141M)
- module leader, MSc Future Directions (FUT, COMP5180M)
- MSc research project tutor
- Computing tutor for the Joint Honours in Science
(2008) Proceedings of the Fourth International Conference on Automated Solutions for Cross Media Content and Multi-channel Distribution (AXMEDIS 2008). Los Alamitos, California, Washington, Tokyo: IEEE Computer Society.
(2008) Interactive multimedia music technologies. Information Science Publishing.
(2008) Interactive Multimedia Music Technologies. IGI Global, Information Science Reference.
(2008) Proceedings of the 4th i-Maestro Workshop on Technology-Enhanced Music Education. University of Leeds.
(2007) Proceedings of the 3rd International Conference on Automating Production of Cross Media Content for Multi-channel Distribution Conference. IEEE Computer Society Press.
(2006) Proceedings of the COST287-ConGAS 2nd International Symposium on Gesture Interface for Multimedia Systems (GIMS2006).
(2006) Proceedings of the 2nd International Conference on Automating Production of Cross Media Content for Multi-channel Distribution Conference. IEEE Computer Society Press.
(2013) “Automated ground-plane estimation for trajectory rectification”, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 8048 LNCS.PART 2: 378-385.
(2013) “Augmented opera performance”, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 7990 LNCS: 276-287.
(2013) “Feature matching of simultaneous signals for multimodal synchronization”, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 7990 LNCS: 266-275.
(2012) “Guest editors' introduction”, International Journal of Software Engineering and Knowledge Engineering. 22.8: 1005-1006.
(2010) “DMS2010 Foreword”, DMS 2010 - Proceedings of the 16th International Conference on Distributed Multimedia Systems.
(2009) “An ontology based framework for the preservation of interactive multimedia performances”, e-Science 2009 - 5th IEEE International Conference on e-Science. : 40-44.
(2009) “Interactive multimedia interface and multimodal analysis for technology-enhanced learning and performance preservation”, NCM 2009 - 5th International Joint Conference on INC, IMS, and IDC. : 1401-1405.
(2008) “Technology-enhanced learning for music theory and performance”, MCCSIS'08 - IADIS Multi Conference on Computer Science and Information Systems; Proceedings of e-Learning 2008. 2: 66-70.
(2008) “Preservation of interactive multimedia performances”, International Journal of Metadata, Semantics and Ontologies. 3.3: 183-196.
(2007) “A System for Segmenting and Extracting Paper-based Watermark Designs”, International Journal on Digital Libraries. 6.4: 351-361.
(2005) “Segmentation Approach for Paper-based Watermark Extraction”, IADAT Journal of Advanced Technology on Imaging and Graphics. 1.2: 62-65.
(2005) “Special issue: Multimedia music and the World Wide Web - Introduction”, JOURNAL OF NEW MUSIC RESEARCH. 34.2: 137-138.
(2005) “Journal of New Music Research: Introduction”, Journal of New Music Research. 34.2: 137-138.
(2004) “Music via Motion (MvM): Transdomain Mapping of Motion and Sound for Interactive Performances”, Proceedings of the IEEE. 92.4: 645-655.
(1999) “Automated reconstruction of 3D models from real environments”, ISPRS Journal of Photogrammetry and Remote Sensing. 54.1: 1-22.
(1996) “A monophonic pitch-tracking algorithm based on waveform periodicity determinations using landmark points”, COMPUTER MUSIC JOURNAL. 20.3: 70-78.
(1996) “Recognition and reconstruction of primitives in music scores”, Image and Vision Computing. 14: 39-46.
(1995) “Low- and high-level approaches to optical music score recognition”, IEE Colloquium (Digest). 191
(2011) “Interactive Multimedia for Technology-Enhanced Learning with Multimodal Feedback”, In: Musical Robots and Interactive Multimodal Systems. Springer Tracts in Advanced Robotics. Berlin Heidelberg: Springer-Verlag. 105-126
(2008) “Optical Music Imaging: Music Document Digitisation, Recognition, Evaluation, and Restoration”, In: Interactive Multimedia Music Technologies. IGI Global. 50-79
(2008) “Interactive Multimedia MUSICNETWORK”, In: Syed MR (eds.) Multimedia Technologies: Concepts, Methodologies, Tools, and Applications. IGI Global, Information Science Reference.
(2005) “Optical Music Analysis for Printed Music Score and Music Handwritten Manuscript”, In: George SE (eds.) Visual Perception of Music Notation: On-line and Off-line Recognition. IRM Press, Idea Group Inc. 108-127
(2002) “Playing on a Holo-stage: Towards the interaction between real and virtual performers”, In: Beardon C; Malmborg L (eds.) Digital Creativity: A Reader. Swets & Zeitlinger. 241-249
(2014) Improving OMR for digital music libraries with multiple recognisers and multiple sources. DLfM 2014: 1st International Workshop on Digital Libraries for Musicology Proceedings: Proceedings of DLfM 2014 ACM International Conference Proceedings Series, ACM Press.: 49-56.
DOI: 10.1145/2660168.2660175, Repository URL: http://eprints.whiterose.ac.uk/81918/
(2014) Tactile composition: Configurations and communications for a musical haptic chair. Proceedings: Proceedings - 40th International Computer Music Conference, ICMC 2014 and 11th Sound and Music Computing Conference, SMC 2014 - Music Technology Meets Philosophy: From Digital Echos to Virtual Ethos : 547-552.
(2012) Mconduct: Transcending domains and distributed performance. Proceedings: ICMC 2012: Non-Cochlear Sound - Proceedings of the International Computer Music Conference 2012 : 204-211.
(2010) iRock Interactive Multimedia System. 16th International Conference on Distributed Multimedia Systems (DMS2010) Knowledge Systems Institute.: 137-142.
(2010) MiMic: a motion control interface for music. Electronic Visualisation and the Arts (EVA 2010) Proceedings: Proceedings of EVA London, Electronic Workshops in Computing (eWiC) London, UK: British Computer Society.
(2010) Eye. Breathe. Music. International Computer Music Conference
(2010) Eye. Breathe. Music: creating music through minimal movement. Electronic Visualisation and the Arts (EVA 2010) Proceedings: Proceedings of EVA London, Electronic Workshops in Computing (eWiC) London, UK: British Computer Society.
(2010) Interactive Multimedia Rocks for Geology. Electronic Visualisation and the Arts (EVA 2010) Proceedings: Proceedings of EVA London, Electronic Workshops in Computing (eWiC) London, UK: British Computer Society.: 224-231.
(2009) Ontology for Preservation of Interactive Multimedia Performances. Proceedings: METADATA AND SEMANTICS : 35-44.
(2009) 3D Motion Data Analysis and Visualisation for Technology-Enhanced Learning and Heritage Preservation. Proceedings: PROCEEDINGS OF THE 8TH WSEAS INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, KNOWLEDGE ENGINEERING AND DATA BASES : 384-389.
(2008) Distributed Interactive Multimedia for Technology-enhanced Learning and Automated Content Production and Distribution.. Proceedings: DMS Knowledge Systems Institute.: 51-54.
(2008) Hearing Images: Interactive Sonification Interface for Images. Proceedings: Fourth International Conference on Automated Solutions for Cross Media Content and Multi-Channel Distribution, Proceedings : 25-31.
(2008) Tracking Conductors Hand Movements Using Multiple Wiimotes. Proceedings: Fourth International Conference on Automated Solutions for Cross Media Content and Multi-Channel Distribution, Proceedings : 93-99.
(2008) i-Maestro Framework and Interactive Multimedia Tools for Technology-Enhanced Learning and Teaching for Music. Proceedings: Fourth International Conference on Automated Solutions for Cross Media Content and Multi-Channel Distribution, Proceedings : 266-269.
(2008) AXMEDIS Programme and Publication Tools for Cross Media Content Multichannel Distribution. Proceedings: Fourth International Conference on Automated Solutions for Cross Media Content and Multi-Channel Distribution, Proceedings : 261-265.
(2008) Interactive Feedbacks with Visualisation and Sonification for Technology-Enhanced Learning for Music Performance. Proceedings: SIGDOC'08: PROCEEDINGS OF THE 26TH ACM INTERNATIONAL CONFERENCE ON DESIGN OF COMMUNICATION : 281-282.
(2008) Technology-Enhanced Learning for Music with i-Maestro Framework and Tools. Proceedings of EVA London 2008: the International Conference of Electronic Visualisation and the Arts British Computer Society.: 177-187.
(2008) A comparative study on using Zernike velocity moments and hidden Markov models for hand gesture recognition. Conference on Articulated Motion and Deformable Objects (AMDO 2008) Proceedings: Articulated Motion and Deformable Objects, AMDO 2008, 5th International Conference Springer.: 319-327.
DOI: 10.1007/978-3-540-70517-8_31, Repository URL: http://eprints.whiterose.ac.uk/75557/
(2008) Interactive Multimedia Technology-Enhanced Learning for Music with i-Maestro. ED-MEDIA 2008 World Conference on Education Multimedia, Hypermedia & Telecommunications
(2008) Practicing Ontology Modelling for Preservation of Interactive Multimedia Performances. Proceedings: FOURTH INTERNATIONAL CONFERENCE ON AUTOMATED SOLUTIONS FOR CROSS MEDIA CONTENT AND MULTI-CHANNEL DISTRIBUTION, PROCEEDINGS : 276-281.
(2008) Interactive Feedbacks with Visualisation and Sonification for Technology-Enhanced Learning for Music Performance. 26th ACM International Conference on Design of Communication
(2008) Ontology-Based Temporal Modelling of Provenance Information. Proceedings: 2008 IEEE MEDITERRANEAN ELECTROTECHNICAL CONFERENCE, VOLS 1 AND 2 : 170-175.
(2008) Sonification of Bowing Features for String Instrument Training. 14th International Conference on Auditory Display (iCAD 08)
(2007) Preservation of Interactive Multimedia Performances: Ontologies and OAIS. Proceedings: Workshop: Methods and Techniques for Intangible Heritage Preservation Workshop: Methods and Techniques for Intangible Heritage Preservation.
(2007) AXMEDIS programme and publication tools: a case study with satellite distribution. Proceedings: AXMEDIS 2007: THIRD INTERNATIONAL CONFERENCE ON AUTOMATED PRODUCTION OF CROSS MEDIA CONTENT FOR MULTI-CHANNEL DISTRIBUTION, PROCEEDINGS : 219-224.
(2007) Non-linear Circles and the Triple Harp: Creating a Microtonal Harp. First International Conference of the Society for Mathematics and Computation on Music
(2007) 3D Augmented Mirror: A Multimodal Interface for String Instrument Learning and Teaching with Gesture Support. Proceedings: ICMI'07: PROCEEDINGS OF THE NINTH INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES : 339-345.
(2007) 3D Augmented Mirror: A Multimodal Interface for String Instrument Learning and Teaching with Gesture Support. 9th international conference on Multimodal interfaces ACM.
(2007) Digital Preservation of Interactive Multimedia Performances. International Computer Music Conference I: 279-282.
(2007) A Systemic Approach to Music Performance Learning with Multimodal Technology Support. E-Learn 2007, World Conference on E-Learning in Corporate, Government, Healthcare, & Higher Education
(2007) Technology-enhanced Music Learning and Teaching: i-Maestro Framework and Gesture Support for the Violin Family. ATMI's 2007 conference
(2007) Metadata editing and mapping within the AXMEDIS framework. 3rd International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution : 11-14.
(2006) A Novel Data Representation Method for 3D Model-Based Gesture Tracking. International Conference on Information & Communication Technologies: from Theory to Applications (ICTTA'06) IP02: 3D - Imaging, Vol. 1: 1085-1090.
(2006) AXNIEDIS programme and publication tools integration with workflow-enabled communication and process control. Proceedings: AXMEDIS 2006: Second International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution, Proceedings : 110-117.
(2006) Automated paper-based watermark extraction and processing. Proceedings: AXMEDIS 2006: Second International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution, Proceedings : 291-298.
(2005) Interactive Multimedia Technologies for Music. Proceedings: EVA (Electronic Imaging, the Visual Arts & Beyond) Conferences International (EVA 2005, London), EVA Conferences International (ECI).: 1-10.
(2005) Optical imaging for watermark: digitisation, segmentation, and vectorisation. Proceedings: International Conference on Multimedia, Image Processing and Vision (IADAT-micV2005) International Conference on Multimedia, Image Processing and Vision (IADAT-micV2005).
(2005) AXMEDIS framework for programme and publication and on-demand production. Proceedings: First International Conference on Automated Production of Cross Media Content for Multi-channel Distribution, Proceedings : 247-250.
(2005) Watermark: From paper texture to digital media. Proceedings: First International Conference on Automated Production of Cross Media Content for Multi-channel Distribution, Proceedings : 261-264.
(2004) Developing a virtual ballet dancer to visualise choreography. Proceedings: Proceedings of the AISB 2004 Symposium on Language, Speech and Gesture for Expressive Characters Society for Artificial Intelligence and Simulation of Behaviour.: 86-97.
(2003) Design and development of a radio frequency linked drum-bush. Proceedings: MAXIS II 2003 : Proceedings of the Second International Festival & Symposium of Sound and Experimental Music Sheffield Hallam University Press.: 117-120.
(2003) Machine-representation and visualisation of a dance notation. Proceedings: Proceedings of Electronic Imaging and the Visual Arts London 2003 University College London.
(2003) Studying the fidelity requirements for a virtual ballet dancer. Proceedings: Proceedings of Vision, Video, and Graphics (VVG'03) Eurographics Association.: 181-188.
(2002) Interactive and augmented system for multimedia performance.
(2002) Document imaging for music manuscript. XVIII: 546-549.
(2002) Music via motion (MvM): virtual and augmented performances. : 1-9.
(2002) Interactive gesture music performance interface. Proceedings: International Conference on New Interfaces for Musical Expression (NIME 2002) International Conference on New Interfaces for Musical Expression (NIME 2002).
(2002) A distributed real-time system for interactive music mapping with multiple inputs. Proceedings: Proceedings of the International Computer Music Conference (ICMC2002) Nordahl, M.: 534-537.
(2002) Music manuscript tracing. Proceedings: GRAPHICS RECOGNITION: ALGORITHMS AND APPLICATIONS 2390: 330-342.
(2002) Optical music analysis: a reverse engineering approach. : 287-292.
(2002) Notation and 3D animation of dance movement. Proceedings: Proceedings of the International Computer Music Conference (ICMC2002) Proceedings of the International Computer Music Conference (ICMC2002).: 459-462.
(2002) Music manuscript tracing. Proceedings: Lecture Notes in Computer Science Springer-Verlag.: 322-334.
(2002) Music via motion: an interactive multimedia installation with video and sensor. Proceedings: Music + Alternative + X-disciplinary approaches In Sound; MAXIS proceedings innovative, alternative and cross-disciplinary approaches in sound people, process, product, place - Sheffield, April 2000 Sheffield Hallam University.: 76-79.
(2002) Multimedia imaging.
(2002) Music via motion : interactive performance technology.
(2001) Music via motion: trans-domain mapping of motion and sound.
(2001) Music via motion: interactive multimedia performances.
(2001) Augmented stages for installation-arts and performance.
(2001) Optical music recognition: stroke tracing and reconstruction of handwritten manuscripts.
(2001) Towards an integrated handwritten music manuscript analysis and recognition system. Proceedings: Proceedings of the Conference for Content Integrated Research in Creative User Systems (CIRCUS 2001) Proceedings of the Conference for Content Integrated Research in Creative User Systems (CIRCUS 2001).
(2001) Music manuscript tracing. : 470-481.
(2000) Interactive Composition: Sharing the Creative Process on the Internet. Proceedings: International Computer Music Conference International Computer Music Conference.
(1998) Studio Report of the Leeds University Electronic Studio. Proceedings: Computer Music Conference (ICMC’98) Computer Music Conference (ICMC’98).
(1998) An autonomous sensor for 3D reconstruction. Proceedings: MULTIMEDIA APPLICATIONS, SERVICES AND TECHNIQUES - ECMAST'98 1425: 13-25.
(1998) 3D Textured Models of Indoor Scenes from Composite Range and Video Images.. Proceedings: Three-Dimensional Image Capture and Applications SPIE. 3313: 46-59.
The Coat of Invisible Notes. 00//2/01/0
Music Via Motion Demonstration. 00//2/01/0
(2010) “Digital Preservation of Interactive Multimedia Performances”, European Research Consortium for Informatics and Mathematics (ERCIM News). ERCIM 80 Special theme on Digital Preservation. ERCIM EEIG.80: 32-33.
(2008) The Leeds Arabic texts project. University of Leeds:
- Coordinator of the International Computer Music Association Working Group on Interactive Systems and Instrument Design in Music [icmc array]
- Co-owner of the London Virtual Reality Special Interest Group (LVRG) mailing list
- Scientific Director of the Leeds University Centre for English Music (LUCEM)
- Editorial Consultant of the Computer Music Journal, MIT Press
- Director of the Applied Modelling Technology Ltd.
- Chairman of the Music Imaging Ltd.
PhD & Postdoctoral Supervision
- Hazem Hiary (PhD, Computing)
- Eleri Pound (PhD, Music)
- Garry Quested (PhD, Computing)
- Moaath Al-Rajab (PhD, Computing)
- Richard Sage (MA, Music)
- David Bradshaw (MA, Music)
- Charles O’Neill (MA, Music)
- Royce Neagle (PhD, Computing)