A system for semantic information extraction from mixed soundtracks deploying MARSYAS framework

Mohammed, DY, Duncan, PJ, Al-Maathidi, MM and Li, FF ORCID: https://orcid.org/0000-0001-9053-963X 2015, 'A system for semantic information extraction from mixed soundtracks deploying MARSYAS framework' , in: 2015 IEEE 13th International Conference on Industrial Informatics (INDIN) , IEEE, pp. 1084-1089.

PDF - Published Version Restricted to Repository staff only Download (545kB) | Request a copy

Abstract

Ever increasing volumes of media content and the desire to extract information from media archives motivate the studies into semantic audio information mining. Much research in this filed concerns development of bespoke systems, in which sound tracks are exclusively classified and segmented, and a specific type of sound is recognized and analyzed. This approach however is detrimental to the complete extraction of all relevant semantic information and audio scene analysis. The current study addresses the issues of sound tracks with overlapped music, speech and ambient sounds, and explores how MARSYAS (Music Analysis, Retrieval and Synthesis for Audio Signals) can be extended to mixed and overlapped soundtrack applications. The MARSYAS has been adapted to this application by means of adopting additional speech cleaning algorithms. The proposed new system can analyze arbitrary sound tracks and timestamp the occurrence of music and speech, allowing overlaps, in the form of a “sound score” for further recognition methods to extract music score and text information. Validation tests have shown that the new system handles overlapping cases and is therefore capable of extracting more information than other existing methods.

Item Type:	Book Section
Schools:	Schools > School of Computing, Science and Engineering > Salford Innovation Research Centre
Publisher:	IEEE
ISBN:	9781479966493
ISSN:	1935-4576
Funders:	University of Salford
Depositing User:	Dr Francis F. Li
Date Deposited:	09 May 2016 08:16
Last Modified:	15 Feb 2022 20:41
URI:	https://usir.salford.ac.uk/id/eprint/38900

Actions (login required)

Edit record (repository staff only)