Audiovisual Analysis of Music Performances: Overview of an Emerging Field

Zhiyao Duan; Slim Essid; Cynthia C.S. Liem; Gael Richard

doi:10.1109/MSP.2018.2875511

Audiovisual Analysis of Music Performances: Overview of an Emerging Field

Zhiyao Duan, Slim Essid, Cynthia C.S. Liem, Gael Richard

Multimedia Computing

Research output: Contribution to journal › Article › Scientific › peer-review

12 Citations (Scopus)

90 Downloads (Pure)

Abstract

In the physical sciences and engineering domains, music has traditionally been considered an acoustic phenomenon. From a perceptual viewpoint, music is naturally associated with hearing, i.e., the audio modality. Moreover, for a long time, the majority of music recordings were distributed through audio-only media, such as vinyl records, cassettes, compact discs, and mp3 files. As a consequence, existing automated music analysis approaches predominantly focus on audio signals that represent information from the acoustic rendering of music.

Original language	English
Article number	8588405
Pages (from-to)	63-73
Number of pages	11
Journal	IEEE Signal Processing Magazine
Volume	36
Issue number	1
DOIs	https://doi.org/10.1109/MSP.2018.2875511
Publication status	Published - 2019

Bibliographical note

Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Keywords

Music
Visualization
Task analysis
Instruments
Multiple signal classification
Signal aprocessing
Cameras
Acoustics

Access to Document

10.1109/MSP.2018.2875511

08588405Final published version, 1.84 MB

Cite this

@article{f7eb6deb9c224355b3f07ebc373a9e81,

title = "Audiovisual Analysis of Music Performances: Overview of an Emerging Field",

abstract = "In the physical sciences and engineering domains, music has traditionally been considered an acoustic phenomenon. From a perceptual viewpoint, music is naturally associated with hearing, i.e., the audio modality. Moreover, for a long time, the majority of music recordings were distributed through audio-only media, such as vinyl records, cassettes, compact discs, and mp3 files. As a consequence, existing automated music analysis approaches predominantly focus on audio signals that represent information from the acoustic rendering of music.",

keywords = "Music, Visualization, Task analysis, Instruments, Multiple signal classification, Signal aprocessing, Cameras, Acoustics",

author = "Zhiyao Duan and Slim Essid and Liem, {Cynthia C.S.} and Gael Richard",

note = "Green Open Access added to TU Delft Institutional Repository {\textquoteleft}You share, we take care!{\textquoteright} – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.",

year = "2019",

doi = "10.1109/MSP.2018.2875511",

language = "English",

volume = "36",

pages = "63--73",

journal = "IEEE Signal Processing Magazine",

issn = "1053-5888",

publisher = "Institute of Electrical and Electronics Engineers (IEEE)",

number = "1",

}

TY - JOUR

T1 - Audiovisual Analysis of Music Performances

T2 - Overview of an Emerging Field

AU - Duan, Zhiyao

AU - Essid, Slim

AU - Liem, Cynthia C.S.

AU - Richard, Gael

N1 - Green Open Access added to TU Delft Institutional Repository ‘You share, we take care!’ – Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

PY - 2019

Y1 - 2019

N2 - In the physical sciences and engineering domains, music has traditionally been considered an acoustic phenomenon. From a perceptual viewpoint, music is naturally associated with hearing, i.e., the audio modality. Moreover, for a long time, the majority of music recordings were distributed through audio-only media, such as vinyl records, cassettes, compact discs, and mp3 files. As a consequence, existing automated music analysis approaches predominantly focus on audio signals that represent information from the acoustic rendering of music.

AB - In the physical sciences and engineering domains, music has traditionally been considered an acoustic phenomenon. From a perceptual viewpoint, music is naturally associated with hearing, i.e., the audio modality. Moreover, for a long time, the majority of music recordings were distributed through audio-only media, such as vinyl records, cassettes, compact discs, and mp3 files. As a consequence, existing automated music analysis approaches predominantly focus on audio signals that represent information from the acoustic rendering of music.

KW - Music

KW - Visualization

KW - Task analysis

KW - Instruments

KW - Multiple signal classification

KW - Signal aprocessing

KW - Cameras

KW - Acoustics

UR - http://www.scopus.com/inward/record.url?scp=85059760158&partnerID=8YFLogxK

U2 - 10.1109/MSP.2018.2875511

DO - 10.1109/MSP.2018.2875511

M3 - Article

SN - 1053-5888

VL - 36

SP - 63

EP - 73

JO - IEEE Signal Processing Magazine

JF - IEEE Signal Processing Magazine

IS - 1

M1 - 8588405

ER -

Audiovisual Analysis of Music Performances: Overview of an Emerging Field

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this