On Musical Information Geometry with Applications to Sonified Image Analysis

<!DOCTYPE html> <html lang="en" dir="ltr"> <head>  <script async src="https://www.googletagmanager.com/gtag/js?id=G-P63WKM1TM1"></script> <script> window.dataLayer = window.dataLayer || []; function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-P63WKM1TM1'); </script>  <script type="text/javascript" > (function(m,e,t,r,i,k,a){m[i]=m[i]||function(){(m[i].a=m[i].a||[]).push(arguments)}; m[i].l=1*new Date(); for (var j = 0; j < document.scripts.length; j++) {if (document.scripts[j].src === r) { return; }} k=e.createElement(t),a=e.getElementsByTagName(t)[0],k.async=1,k.src=r,a.parentNode.insertBefore(k,a)}) (window, document, "script", "https://mc.yandex.ru/metrika/tag.js", "ym"); ym(55165297, "init", { clickmap:false, trackLinks:true, accurateTrackBounce:true, webvisor:false }); </script> <noscript><div><img src="https://mc.yandex.ru/watch/55165297" style="position:absolute; left:-9999px;" alt="" /></div></noscript>    <title>On Musical Information Geometry with Applications to Sonified Image Analysis</title> <meta name="description" content="On Musical Information Geometry with Applications to Sonified Image Analysis"> <meta name="keywords" content="Sonification, musical information geometry, image content extraction, automated quantification, audio segmentation, pattern recognition."> <meta name="viewport" content="width=device-width, initial-scale=1, minimum-scale=1, maximum-scale=1, user-scalable=no"> <meta charset="utf-8"> <meta name="citation_title" content="On Musical Information Geometry with Applications to Sonified Image Analysis"> <meta name="citation_author" content="Shannon Steinmetz"> <meta name="citation_author" content="Ellen Gethner"> <meta name="citation_publication_date" content="2022/12/27"> <meta name="citation_journal_title" content="International Journal of Computer and Information Engineering"> <meta name="citation_volume" content="16"> <meta name="citation_issue" content="12"> <meta name="citation_firstpage" content="639"> <meta name="citation_lastpage" content="646"> <meta name="citation_pdf_url" content="https://publications.waset.org/10012863/pdf"> <link href="https://cdn.waset.org/favicon.ico" type="image/x-icon" rel="shortcut icon"> <link href="https://cdn.waset.org/static/plugins/bootstrap-4.2.1/css/bootstrap.min.css" rel="stylesheet"> <link href="https://cdn.waset.org/static/plugins/fontawesome/css/all.min.css" rel="stylesheet"> <link href="https://cdn.waset.org/static/css/site.css?v=150220211555" rel="stylesheet"> </head> <body> <header> <div class="container"> <nav class="navbar navbar-expand-lg navbar-light"> <a class="navbar-brand" href="https://waset.org"> <img src="https://cdn.waset.org/static/images/wasetc.png" alt="Open Science Research Excellence" title="Open Science Research Excellence" /> </a> <button class="d-block d-lg-none navbar-toggler ml-auto" type="button" data-toggle="collapse" data-target="#navbarMenu" aria-controls="navbarMenu" aria-expanded="false" aria-label="Toggle navigation"> <span class="navbar-toggler-icon"></span> </button> <div class="w-100"> <div class="d-none d-lg-flex flex-row-reverse"> <form method="get" action="https://waset.org/search" class="form-inline my-2 my-lg-0"> <input class="form-control mr-sm-2" type="search" placeholder="Search Conferences" value="" name="q" aria-label="Search"> <button class="btn btn-light my-2 my-sm-0" type="submit"><i class="fas fa-search"></i></button> </form> </div> <div class="collapse navbar-collapse mt-1" id="navbarMenu"> <ul class="navbar-nav ml-auto align-items-center" id="mainNavMenu"> <li class="nav-item"> <a class="nav-link" href="https://waset.org/conferences" title="Conferences in 2024/2025/2026">Conferences</a> </li> <li class="nav-item"> <a class="nav-link" href="https://waset.org/disciplines" title="Disciplines">Disciplines</a> </li> <li class="nav-item"> <a class="nav-link" href="https://waset.org/committees" rel="nofollow">Committees</a> </li> <li class="nav-item dropdown"> <a class="nav-link dropdown-toggle" href="#" id="navbarDropdownPublications" role="button" data-toggle="dropdown" aria-haspopup="true" aria-expanded="false"> Publications </a> <div class="dropdown-menu" aria-labelledby="navbarDropdownPublications"> <a class="dropdown-item" href="https://publications.waset.org/abstracts">Abstracts</a> <a class="dropdown-item" href="https://publications.waset.org">Periodicals</a> <a class="dropdown-item" href="https://publications.waset.org/archive">Archive</a> </div> </li> <li class="nav-item"> <a class="nav-link" href="https://waset.org/page/support" title="Support">Support</a> </li> </ul> </div> </div> </nav> </div> </header> <main> <div class="container mt-4"> <div class="row"> <div class="col-md-9 mx-auto"> <form method="get" action="https://publications.waset.org/search"> <div id="custom-search-input"> <div class="input-group"> <i class="fas fa-search"></i> <input type="text" class="search-query" name="q" placeholder="Author, Title, Abstract, Keywords" value=""> <input type="submit" class="btn_search" value="Search"> </div> </div> </form> </div> </div> <div class="row mt-3"> <div class="col-sm-3"> <div class="card"> <div class="card-body"><strong>Commenced</strong> in January 2007</div> </div> </div> <div class="col-sm-3"> <div class="card"> <div class="card-body"><strong>Frequency:</strong> Monthly</div> </div> </div> <div class="col-sm-3"> <div class="card"> <div class="card-body"><strong>Edition:</strong> International</div> </div> </div> <div class="col-sm-3"> <div class="card"> <div class="card-body"><strong>Paper Count:</strong> 33093</div> </div> </div> </div> <div class="card publication-listing mt-3 mb-3"> <h5 class="card-header" style="font-size:.9rem">On Musical Information Geometry with Applications to Sonified Image Analysis</h5> <div class="card-body"> <p class="card-text"><strong>Authors:</strong> <a href="https://publications.waset.org/search?q=Shannon%20Steinmetz">Shannon Steinmetz</a>, <a href="https://publications.waset.org/search?q=Ellen%20Gethner"> Ellen Gethner</a> </p> <p class="card-text"><strong>Abstract:</strong></p> <p>In this paper a theoretical foundation is developed to segment, analyze and associate patterns within audio. We explore this on imagery via sonified audio applied to our segmentation framework. The approach involves a geodesic estimator within the statistical manifold, parameterized by musical centricity. We demonstrate viability by processing a database of random imagery to produce statistically significant clusters of similar imagery content.</p> <iframe src="https://publications.waset.org/10012863.pdf" style="width:100%; height:400px;" frameborder="0"></iframe> <p class="card-text"><strong>Keywords:</strong> <a href="https://publications.waset.org/search?q=Sonification" title="Sonification">Sonification</a>, <a href="https://publications.waset.org/search?q=musical%20information%20geometry" title=" musical information geometry"> musical information geometry</a>, <a href="https://publications.waset.org/search?q=image%0D%0Acontent%20extraction" title=" image content extraction"> image content extraction</a>, <a href="https://publications.waset.org/search?q=automated%20quantification" title=" automated quantification"> automated quantification</a>, <a href="https://publications.waset.org/search?q=audio%20segmentation" title=" audio segmentation"> audio segmentation</a>, <a href="https://publications.waset.org/search?q=pattern%20recognition." title=" pattern recognition."> pattern recognition.</a> </p> <a href="https://publications.waset.org/10012863/on-musical-information-geometry-with-applications-to-sonified-image-analysis" class="btn btn-primary btn-sm">Procedia</a> <a href="https://publications.waset.org/10012863/apa" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">APA</a> <a href="https://publications.waset.org/10012863/bibtex" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">BibTeX</a> <a href="https://publications.waset.org/10012863/chicago" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">Chicago</a> <a href="https://publications.waset.org/10012863/endnote" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">EndNote</a> <a href="https://publications.waset.org/10012863/harvard" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">Harvard</a> <a href="https://publications.waset.org/10012863/json" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">JSON</a> <a href="https://publications.waset.org/10012863/mla" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">MLA</a> <a href="https://publications.waset.org/10012863/ris" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">RIS</a> <a href="https://publications.waset.org/10012863/xml" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">XML</a> <a href="https://publications.waset.org/10012863/iso690" target="_blank" rel="nofollow" class="btn btn-primary btn-sm">ISO 690</a> <a href="https://publications.waset.org/10012863.pdf" target="_blank" class="btn btn-primary btn-sm">PDF</a> <span class="bg-info text-light px-1 py-1 float-right rounded"> Downloads <span class="badge badge-light">426</span> </span> <p class="card-text"><strong>References:</strong></p> <br>[1] Nassar H Abdel-All and EI Abdel-Galil. Numerical treatment of geodesic differential. In International Mathematical Forum, volume 8, pages 15–29, 2013. <br>[2] Md Akhtaruzzaman and Amir A Shafie. Geometrical substantiation of phi, the golden ratio and the baroque of nature, architecture, design and engineering. International Journal of Arts, 1(1):1–22, 2011. <br>[3] S-I Amari. Information geometry on hierarchy of probability distributions. IEEE transactions on information theory, 47(5):1701–1711, 2001. <br>[4] Shun-ichi Amari. Differential geometry of a parametric family of invertible linear systems-riemannian metric, dual affine connections, and divergence. Mathematical systems theory, 20(1):53–82, 1987. <br>[5] Shun-Ichi Amari. Information geometry and its applications: Convex function and dually flat manifold. In LIX Fall Colloquium on Emerging Trends in Visual Computing, pages 75–102. Springer, 2008. <br>[6] Shun-ichi Amari and Hiroshi Nagaoka. Methods of information geometry, volume 191. American Mathematical Soc., 2007. <br>[7] Ariel Caticha. The basics of information geometry. In AIP Conference Proceedings, volume 1641, pages 15–26. American Institute of Physics, 2015. <br>[8] William WS Chen and Samuel Kotz. The riemannian structure of the three-parameter gamma distribution. 2013. <br>[9] Arshia Cont, Shlomo Dubnov, and G´erard Assayag. On the information geometry of audio streams with applications to similarity computing. IEEE Transactions on Audio, Speech, and Language Processing, 19(4):837–846, 2010. <br>[10] Arnaud Dessein and Arshia Cont. An information-geometric approach to real-time audio segmentation. IEEE Signal Processing Letters, 20(4):331–334, 2013. <br>[11] Jonathan T Foote and Matthew L Cooper. Media segmentation using self-similarity decomposition. In Storage and Retrieval for Media Databases 2003, volume 5021, pages 167–175. International Society for Optics and Photonics, 2003. <br>[12] Siddharth Gururani, Cameron Summers, and Alexander Lerch. Instrument activity detection in polyphonic music using deep neural networks. In ISMIR, pages 569–576, 2018. <br>[13] Thomas Hermann, Andy Hunt, and John G Neuhoff. The sonification handbook. Logos Verlag Berlin, 2011. <br>[14] Joachim Kopp, Ranjan Laha, Toby Opferkuch, and William Shepherd. Cuckoo’s eggs in neutron stars: can ligo hear chirps from the dark sector? Journal of High Energy Physics, 2018(11):96, 2018. <br>[15] Luis Fernando Abanto Le´on, Guillermo Kemper V´asquez, and Joel Telles. A novel fuzzy logic-based metric for audio quality assessment: Objective audio quality assessment. In CONATEL 2011, pages 1–10. IEEE, 2011. <br>[16] Tao Li and Mitsunori Ogihara. Toward intelligent music information retrieval. IEEE Transactions on Multimedia, 8(3):564–574, 2006. <br>[17] Frank Nielsen. An elementary introduction to information geometry. arXiv preprint arXiv:1808.08271, 2018. <br>[18] Konstantina Orlandatou. Sound characteristics which affect attributes of the synaesthetic visual experience. Musicae Scientiae, Vol. 19(4), pages 389–401, 2015. <br>[19] Renato Panda, Ricardo Manuel Malheiro, and Rui Pedro Paiva. Audio features for music emotion recognition: a survey. IEEE Transactions on Affective Computing, 2020. <br>[20] Tae Hong Park and Sumanth Srinivasan. The sound analysis toolbox (SATB). Ann Arbor, MI: Michigan Publishing, University of Michigan Library, 2016. <br>[21] CR Rao. Information and accuracy attainable in the estimation of statistical parameters. kotz s & johnson nl (eds.), breakthroughs in statistics volume i: Foundations and basic theory, 235–248, 1945. <br>[22] Markus Schedl, Emilia G´omez Guti´errez, and Juli´an Urbano. Music information retrieval: Recent developments and applications. Foundations and Trends in Information Retrieval. 2014 Sept 12; 8 (2-3): 127-261., 2014. <br>[23] Chetan Pratap Singh and T Kishore Kumar. Efficient pitch detection algorithms for pitched musical instrument sounds: A comparative performance evaluation. In 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pages 1876–1880. IEEE, 2014. <br>[24] Shannon Steinmetz. Sonic imagery: A view of music via mathematical computer science and signal processing, pages 12–15. University of Colorado at Denver, 2016. <br>[25] Shannon Steinmetz. Sonic imagery: A view of music via mathematical computer science and signal processing. University of Colorado at Denver, 2016. <br>[26] Ke Sun and St´ephane Marchand-Maillet. An information geometry of statistical manifold learning. In International Conference on Machine Learning, pages 1–9, 2014. <br>[27] Dmitri Tymoczko. A geometry of music. Oxford University Press, 1 edition, 2011. <br>[28] Robert van Gend. The fibonacci sequence and the golden ratio in music. Notes on Number Theory and Discrete Mathematics, 20(1):72–77, 2014. <br>[29] Robert S Wolff. Sounding out images. Computers in Physics, 6(3):287–289, 1992. </div> </div> </div> </main> <footer> <div id="infolinks" class="pt-3 pb-2"> <div class="container"> <div style="background-color:#f5f5f5;" class="p-3"> <div class="row"> <div class="col-md-2"> <ul class="list-unstyled"> About <li><a href="https://waset.org/page/support">About Us</a></li> <li><a href="https://waset.org/page/support#legal-information">Legal</a></li> <li><a target="_blank" rel="nofollow" href="https://publications.waset.org/static/files/WASET-16th-foundational-anniversary.pdf">WASET celebrates its 16th foundational anniversary</a></li> </ul> </div> <div class="col-md-2"> <ul class="list-unstyled"> Account <li><a href="https://waset.org/profile">My Account</a></li> </ul> </div> <div class="col-md-2"> <ul class="list-unstyled"> Explore <li><a href="https://waset.org/disciplines">Disciplines</a></li> <li><a href="https://waset.org/conferences">Conferences</a></li> <li><a href="https://waset.org/conference-programs">Conference Program</a></li> <li><a href="https://waset.org/committees">Committees</a></li> <li><a href="https://publications.waset.org">Publications</a></li> </ul> </div> <div class="col-md-2"> <ul class="list-unstyled"> Research <li><a href="https://publications.waset.org/abstracts">Abstracts</a></li> <li><a href="https://publications.waset.org">Periodicals</a></li> <li><a href="https://publications.waset.org/archive">Archive</a></li> </ul> </div> <div class="col-md-2"> <ul class="list-unstyled"> Open Science <li><a target="_blank" rel="nofollow" href="https://publications.waset.org/static/files/Open-Science-Philosophy.pdf">Open Science Philosophy</a></li> <li><a target="_blank" rel="nofollow" href="https://publications.waset.org/static/files/Open-Science-Award.pdf">Open Science Award</a></li> <li><a target="_blank" rel="nofollow" href="https://publications.waset.org/static/files/Open-Society-Open-Science-and-Open-Innovation.pdf">Open Innovation</a></li> <li><a target="_blank" rel="nofollow" href="https://publications.waset.org/static/files/Postdoctoral-Fellowship-Award.pdf">Postdoctoral Fellowship Award</a></li> <li><a target="_blank" rel="nofollow" href="https://publications.waset.org/static/files/Scholarly-Research-Review.pdf">Scholarly Research Review</a></li> </ul> </div> <div class="col-md-2"> <ul class="list-unstyled"> Support <li><a href="https://waset.org/page/support">Support</a></li> <li><a href="https://waset.org/profile/messages/create">Contact Us</a></li> <li><a href="https://waset.org/profile/messages/create">Report Abuse</a></li> </ul> </div> </div> </div> </div> </div> <div class="container text-center"> <hr style="margin-top:0;margin-bottom:.3rem;"> <a href="https://creativecommons.org/licenses/by/4.0/" target="_blank" class="text-muted small">Creative Commons Attribution 4.0 International License</a> <div id="copy" class="mt-2">© 2024 World Academy of Science, Engineering and Technology</div> </div> </footer> <a href="javascript:" id="return-to-top"><i class="fas fa-arrow-up"></i></a> <div class="modal" id="modal-template"> <div class="modal-dialog"> <div class="modal-content"> <div class="row m-0 mt-1"> <div class="col-md-12"> <button type="button" class="close" data-dismiss="modal" aria-label="Close"><span aria-hidden="true">×</span></button> </div> </div> <div class="modal-body"></div> </div> </div> </div> <script src="https://cdn.waset.org/static/plugins/jquery-3.3.1.min.js"></script> <script src="https://cdn.waset.org/static/plugins/bootstrap-4.2.1/js/bootstrap.bundle.min.js"></script> <script src="https://cdn.waset.org/static/js/site.js?v=150220211556"></script> <script> jQuery(document).ready(function() { /*jQuery.get("https://publications.waset.org/xhr/user-menu", function (response) { jQuery('#mainNavMenu').append(response); });*/ jQuery.get({ url: "https://publications.waset.org/xhr/user-menu", cache: false }).then(function(response){ jQuery('#mainNavMenu').append(response); }); }); </script> </body> </html>

CINXE.COM

On Musical Information Geometry with Applications to Sonified Image Analysis