Multiresolution alignment for multiple unsynchronized audio sequences using Sequential Monte Carlo samplers

With proliferation of smart devices such as smart phones, it is common that an event is recorded by multiple individuals creating several audio and video perspectives. Such user generated content is mostly unorganized (not synchronized). In this work, we consider the problem of aligning of multiple...

Full description

Bibliographic Details
Main Authors: Dogac Basaran, Ali Taylan Cemgil, Emin Anarim
Format: Article
Language:English
Published: Elsevier 2018-07-01
Series:SoftwareX
Online Access:http://www.sciencedirect.com/science/article/pii/S235271101730064X
Description
Summary:With proliferation of smart devices such as smart phones, it is common that an event is recorded by multiple individuals creating several audio and video perspectives. Such user generated content is mostly unorganized (not synchronized). In this work, we consider the problem of aligning of multiple unsynchronized audio sequences and propose a multiresolution alignment algorithm using Sequential Monte Carlo samplers in a course to fine structure. The proposed method is evaluated with a real-life dataset from Jiku Mobile Video Datasets and has proven to be competitive with the baseline fingerprinting based alignment methods, with the proper choice of parameters. Keywords: Multiple audio alignment, Multiresolution alignment, Audio fingerprint, Bayesian inference, Sequential Monte Carlo samplers, Sequential alignment
ISSN:2352-7110