Open Source Column

  • OpenVSLAM: A Versatile Visual SLAM Framework

    OpenVSLAM: A Versatile Visual SLAM Framework

    Visual simultaneous localization and mapping (VSLAM) systems are essential for augmented reality devices, autonomous control of robots and drones, etc. However, conventional open-source visual SLAM frameworks are not designed to be called as libraries from third-party programs. To overcome this situation, we have developed OpenVSLAM , a novel visual SLAM framework, and released it as ...

  • Configurable image annotation on the Web

    Configurable image annotation on the Web

    Image annotations are required in a wide range of applications including image classification (which requires textual labels), object detection (bounding boxes), or image segmentation (pixel-wise classification). The application we show here was presented in the ACM Multimedia 2018 Open Source Software Competition track, and provides a number of configurable manual image annotation tools for detection and segmentation. It is available online, but in ...

  • Deep Learning in the Browser: TensorFlow JS

    Having already discussed MatConvNet and Keras, let us continue with an open source framework for deep learning, which takes a new and interesting approach. TensorFlow.js is not only providing deep learning for JavaScript developers, but it’s also making applications of deep learning available in the WebGL enabled web browsers, or more specifically, Chrome, Chromium-based browsers, ...

  • Deep learning with Keras

    Deep learning with Keras

    Following the last column on MatConvNet, let us continue to look at open source frameworks for deep learning. In this column we are going to check Keras, a Python API that allows to use several different backends like Tensorflow and CNTK. Actually, it also supports Theano, although the development of this framework has been halted by the ...

  • Simulating Adaptive Video Streaming Using Sabre

    Simulating Adaptive Video Streaming Using Sabre

    Sabre . Sabre is ...

  • MatConvNet: CNNs are also for MATLAB users

    MatConvNet: CNNs are also for MATLAB users

    MatConvNet is an open source MATLAB toolbox implementing Convolutional Neural Networks (CNNs) for computer vision and multimedia applications, developed by the same authors of the famed VLFeat library. Both libraries have associated papers that have been presented within the Open Source Software Competition track of ACM Multimedia: “MatConvNet: Convolutional Neural Networks for MATLAB” and “Vlfeat: ...

  • Content-based Multimedia Retrieval using vitrivr

    Content-based Multimedia Retrieval using vitrivr

    vitrivr is an open source retrieval system capable of processing multimedia documents such as images, videos, music, and 3D-models. It supports a wealth of content based features for multiple modalities and comes with a ready-to-use Docker image and user interface. We focus on the vitrivr stack in its second version, comprised of ADAMPro  2.0.0, Cineast ...

  • UDLF: Unsupervised Distance Learning Framework for Multimedia Retrieval

    UDLF: Unsupervised Distance Learning Framework for Multimedia Retrieval

    The Unsupervised Distance Learning Framework (UDLF) is a software developed to facilitate the general use and evaluation of novel unsupervised learning methods. These methods aim at post-processing the ranking information for different tasks, being especially useful for multimedia retrieval. The major advantage of UDLF is that it provides a unified and extensive model for ...

  • Open Source Column – Introduction

    Open Source Column - Introduction

    “Open source software is software that can be freely accessed, used, changed, and shared (in modified or unmodified form) by anyone” (cp. https://opensource.org/osd). So open source software (OSS) is actually something that one or more people can work on, improve it, refine it, change it, adapt it and share or use it. Why would anyone ...

  • Open Dataset and Software Track @ ACM MMSys 2017

    The ACM Multimedia Systems Conference (MMSys) provides a forum for researchers to present and share their latest research findings in multimedia systems. While research about specific aspects of multimedia systems are regularly published in the various proceedings and transactions of the networking, operating system, realtime system, and database communities, MMSys aims to cut across these ...

  • MediaEval 2016 multimedia benchmark: Registration open—first data releases starting soon

    MediaEval offers shared-tasks in multimedia retrieval and analysis. Successful approaches make use of multiple modalities and go beyond visual content to also exploit audio, text, and other contextual information. For each task, participants receive a task definition, task data, and accompanying resources (dependent on task) such as keyframes, visual features, and social metadata. Register through ...

  • The Menpo Project

    The Menpo Project

    Overview The Menpo Project is a BSD-licensed set of tools and software designed to provide an end-to-end pipeline for collection and annotation of image and 3D mesh data. In particular, the Menpo Project provides tools for annotating images and meshes with a sparse set of fiducial markers that we refer to as landmarks. For example, ...

  • SIVA Suite: An Open-Source Framework for Hypervideos

    SIVA Suite: An Open-Source Framework for Hypervideos

    Overview The SIVA Suite is an open source framework for the creation, playback, and administration of hypervideos. Allowing the definition of complex navigational structures, our hypervideos are well suited for different scenarios. Compared to traditional linear videos, they especially excel in e-learning and training situations (see ), where fitting the teaching material to the ...

  • Open Source @ ACM MM 2016

    The Open Source Software Competition is an important part of the ACM Multimedia program. The competition, that has reached the eleventh edition, is intended to celebrate, encourage and promote the contribution of researchers, software developers and educators to advance the field by providing the community with implementations of codecs, middleware, frameworks, toolkits, libraries, multimedia players, ...

  • A quick interview with Open Source Software Competition’s organizers

    The program of ACM Multimedia is very diverse: apart from oral and poster presentations, panels and keynotes there are challenges and competitions. One that is particularly interesting is the Open Source Software Competition, which is pretty much specific for this conference and was started in ACM Multimedia 2004. The full list of participants and winners ...

  • Image indexing and retrieval with Yael

    Image indexing and retrieval with Yael

    Introduction Yael is a library implementing computationally intensive functions used in large scale image retrieval, such as neighbor search, clustering and inverted files. The library offers interfaces for C, Python and Matlab. The motivation of Yael is twofold. We aim at providing:  core and optimized instructions and methods commonly used for large-scale multimedia retrieval systems  more sophisticated functions associated ...

  • GamingAnywhere: An Open-Source Cloud Gaming Platform

    GamingAnywhere: An Open-Source Cloud Gaming Platform

    Overview GamingAnywhere is an open-source clouding gaming platform. In addition to its openness, we design GamingAnywhere for high extensibility, portability, and reconfigurability. GamingAnywhere currently supports Windows and Linux, and can be ported to other OS’s including OS X and Android. Our performance study demonstrates that GamingAnywhere achieves high responsiveness and video quality yet imposes low network ...

  • openSMILE:) The Munich Open-Source Large-scale Multimedia Feature Extractor

    openSMILE:) The Munich Open-Source Large-scale Multimedia Feature Extractor

    A tutorial for version 2.1 Introduction The openSMILE feature extraction and audio analysis tool enables you to extract large audio (and recently also video) feature spaces incrementally and fast, and apply machine learning methods to classify and analyze your data in real-time. It combines acoustic features from Music Information Retrieval and Speech Processing, as well as basic ...

  • SSI: An Open Source Platform for Social Signal Interpretation

    SSI: An Open Source Platform for Social Signal Interpretation

    Introduction Automatic detection and interpretation of social signals carried by voice, gestures, mimics, etc. will play a key-role for next-generation interfaces as it paves the way towards more intuitive and natural human-computer interaction. In this article we introduce Social Signal Interpretation (SSI), a framework for real-time recognition of social signals. SSI supports a large range of ...

  • ImproveMyCity – An open source platform for direct citizen-government communication

    ImproveMyCity - An open source platform for direct citizen-government communication

    Motivation & Overview In modern societies there is a growing requirement for public administrations to directly communicate with their citizens, view the existing problems from their perspective and re-act to their needs. In meeting this requirement, modern technologies have become a particularly valuable instrument that, apart from being a rich source of information, is also an ...

Comments are closed.