Open Source Column

  • ESSENTIA: an open source library for audio analysis

    ESSENTIA: an open source library for audio analysis

    Over the last decade, audio analysis has become a field of active research in academic and engineering worlds. It refers to the extraction of information and meaning from audio signals for analysis, classification, storage, retrieval, and synthesis, among other tasks. Related research topics challange understanding and modeling of sound and music, and develop methods and ...

  • VIREO-VH: Libraries and Tools for Threading and Visualizing a Large Video Collection

    VIREO-VH: Libraries and Tools for Threading and Visualizing a Large Video Collection

    Introduction “Video Hyperlinking” refers to the creation of links connecting videos that share near-duplicate segments. Like hyperlinks in HTML documents, the video links help user navigating videos of similar content, and facilitate the mining of iconic clips (or visual memes) spread among videos. Figure 1 shows some example of iconic clips, which can be leveraged for ...

  • Opencast Matterhorn – Open source lecture capture and video management

    Opencast Matterhorn - Open source lecture capture and video management

    Since its formation in 2007, Opencast has become a global community around academic video and its related domains. It is a valid source of inspiring ideas and a huge living community for educational multimedia content creation and usage. Matterhorn is a community-driven collaborative project to develop an end-to-end, open source solution that supports the scheduling, ...

  • MediaEval Multimedia Benchmark: Highlights from the Ongoing 2013 Season

    MediaEval Multimedia Benchmark: Highlights from the Ongoing 2013 Season

    MediaEval is an international multimedia benchmarking initiative that offers tasks to the multimedia community that are related to the human and social aspects of multimedia. The focus is on addressing new challenges in the area of multimedia search and indexing that allow researchers to make full use of multimedia techniques that simultaneously exploit multiple modalities. ...

  • Open Source Column: OpenIMAJ – Intelligent Multimedia Analysis in Java

    Open Source Column: OpenIMAJ - Intelligent Multimedia Analysis in Java

    Introduction Multimedia analysis is an exciting and fast-moving research area. Unfortunately, historically there has been a lack of software solutions in a common programming language for performing scalable integrated analysis of all modalities of media (images, videos, audio, text, web-pages, etc). For example, in the image analysis world, OpenCV and Matlab are commonly used by researchers, ...

  • Open Source Column: Dynamic Adaptive Streaming over HTTP Toolset

    Open Source Column: Dynamic Adaptive Streaming over HTTP Toolset

    Introduction Multimedia content is nowadays omnipresent thanks to technological advancements in the last decades. A major driver of today’s networks are content providers like Netflix and YouTube, which do not deploy their own streaming architecture but provide their service over-the-top (OTT). Interestingly, this streaming approach performs well and adopts the Hypertext Transfer Protocol (HTTP), which has ...

  • ACM MM Open Source

    The ACM Multimedia Open-Source Software Competition celebrates the invaluable contribution of researchers and software developers who advance the field by providing the community with implementations of codecs, middleware, frameworks, toolkits, libraries, applications, and other multimedia software. This year will be the sixth year in running the competition as part of the ACM Multimedia program. To ...

  • Open Source Column: GPAC

    Open Source Column: GPAC

    GPAC, Toolbox for Interactive Multimedia Packaging, Delivery and Playback Introduction GPAC was born 10 years ago from the need of a lighter and more robust implementation of the MPEG-4 Systems standard , compared to the official reference software. It has since then evolved into a much wider project, covering many tools required when exploring new research topics ...

  • Ambulant – a multimedia playback platform

    Ambulant - a multimedia playback platform

    Distributed multimedia is a field that depends on many technologies, including networking, coding and decoding, scheduling, rendering and user interaction. Often, this leads to multimedia researchers in one of those fields expending a lot of implementation effort to build a complete media environment when they actually only want to demonstrate an advance within their own ...

  • Open Source Column: Tribler: P2P Search, Share and Stream

    Open Source Column: Tribler: P2P Search, Share and Stream

    Six years ago, we created a new open source P2P file sharing program called Tribler. During this time over one million users have used it, and three generations of Ph.D. students tested their algorithms in the real world. Tribler is built around BitTorrent. Introduced in 2001, BitTorrent revolutionized the P2P world because of its unprecedented ...

  • Open Source Column: Mozilla Popcorn

    Open Source Column: Mozilla Popcorn

    Mozilla Popcorn: Web Video Interaction Using Client-Side Javascript Context and history Popcorn is an HTML5 media project from Mozilla, the non-profit organization that makes the Firefox web browser. It makes media-oriented web development easy through shared development, open source libraries and tools. Popcorn.js: a Javascript library for interactions between video and the web Popcorn.js makes web media more ...

  • QUASI database for the evaluation of music source separation

    This database is composed of 11 multitrack songs, each mixed in several ways by a professional sound engineer. Both the mixes and the original sources are provided under Creative Commons licences. These data have been used for the “Professionally produced music recordings” task of the SiSEC 2010 and 2011 evaluations.

  • ENST-Drums (Videos + Audios)

    The ENST-Drums database (only audio was previously distributed) is a varied research database for automatic drum transcription and processing: Three professional drummers specialized in different music genres were recorded. Total duration of audio material recorded per drummer is around 75 minutes. Each drummer played his own drum kit. Each sequence used either sticks, rods, brushes or mallets to increase ...

  • Utrecht Multi-Person Motion (UMPM) benchmark

    At Utrecht University, we have created the Utrecht Multi-Person Motion (UMPM) benchmark to evaluate human motion capturing algorithms for multiple subjects in a similar way as HumanEva does for a single subject. It includes 10 different multi-person scenarios including interaction, each with 1-4 persons. Per scenario, we provide four synchronized color video sequences of 30-60 ...

  • Huawei/3DLife Dataset for ACM Multimedia 2011 Grand Challenge

    Huawai/3DLife have just released an exciting data set to the community as part of our coordination the ACM MM Grand Challenge entitled “Realistic Interaction in Online Virtual Environments”. The dataset consists of groundtruths/recordings of multiple Salsa dancers from a variety of modalities, which include microphones, cameras, inertial and depth sensors.

  • Measurement and Analysis of Large DIstributed Virtual EnvironmentS

    Previous research in NVE mainly based their design on assumptions on how avatars behave, and use randomly generated movements to evaluate their design. We believe that there is a gap between these assumptions/randomly generated movements and how real avatar behave. To bridge the gap, we collected mobility traces of 84,208 avatars spanning 22 regions over ...

  • openFrameworks

    Openframeworks is a C++ library designed to assist the creative process by providing a simple and intuitive framework for experimentation. The library is designed to work as a general purpose glue, and wraps together several commonly used libraries under a tidy interface: openGL for graphics, rtAudio for audio input and output, freeType for fonts,freeImage for image ...

  • vvvv: a multipurpose toolkit

    vvvv is a toolkit for real time video synthesis. It is designed to facilitate the handling of large media environments with physical interfaces, real-time motion graphics, audio and video that can interact with many users simultaneously. vvvv uses a visual programming interface. Therefore it provides a graphical programming language for easy prototyping and development. vvvv is real ...

  • Open Source code of an SVC decoder

    Scalable Video Coding (SVC) is the name given to an extension of the H.264/MPEG-4 AVC video compression standard. H.264/MPEG-4 AVC was developed jointly by ITU-T and ISO/IEC JTC 1. These two groups created the Joint Video Team (JVT) to develop the H.264/MPEG-4 AVC standard. The objective of the SVC standardization has been to extend the ...

  • New release of H.264/AVC reference software JM 16.2

    H.264/AVC is a standard developed jointly by the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG), in the Joint Video Team (JVT). A reference software for H.264/AVC is freely available for download to demonstrate the standard and that its features can be implemented. This is its main purpose; it ...

Comments are closed.