Open Science

Standardization, open source software and datasets

Jump to Introduction, Reports from Standardization, Open Source, Datasets, Quality-of-Experience

Introduction

Standards Column: JPEG and MPEG

Standards Column: JPEG and MPEG

Introduction ISO/IEC JTC 1/SC 29 area of work comprises the standardization of coded representation of audio, picture, multimedia and hypermedia information and sets of compression and control functions for use with such information. SC29 basically hosts two working groups responsible for the development of international standards for the compression, decompression, processing, and coded representation of media content, ...


Reports from Standardization

  • Standards Column: VQEG

    Standards Column: VQEG

    Welcome to the first column on the ACM SIGMM Records from the Video Quality Experts Group (VQEG). VQEG is an international and independent organisation of technical experts in perceptual video quality assessment from industry, academia, and government organisations. This column briefly introduces the mission and main activities of VQEG, establishing a starting ...

  • JPEG Column: 87th JPEG Meeting

    JPEG Column: 87th JPEG Meeting

    The 87th JPEG meeting initially planned to be held in Erlangen, Germany, was held online from 25-30, April 2020 because of the Covid-19 outbreak. JPEG experts participated in a number of online meetings attempting to make them as effective as possible while considering participation from different time zones, ranging from Australia to California, U.S.A. ...

  • MPEG Column: 130th MPEG Meeting (virtual/online)

    MPEG Column: 130th MPEG Meeting (virtual/online)

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The 130th MPEG meeting concluded on April 24, 2020, in Alpbach, Austria … well, not exactly, unfortunately. The 130th MPEG meeting concluded on April 24, 2020, but not in Alpbach, Austria. I attended the 130th MPEG ...

  • MPEG Column: 129th MPEG Meeting in Brussels, Belgium

    MPEG Column: 129th MPEG Meeting in Brussels, Belgium

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The 129th MPEG meeting concluded on January 17, 2020 in Brussels, Belgium with the following topics: Coded representation of immersive media – WG11 promotes Network-Based Media Processing (NBMP) to the final stage Coded representation of immersive media – Publication of the Technical ...

  • JPEG Column: 86th JPEG Meeting in Sydney, Australia

    JPEG Column: 86th JPEG Meeting in Sydney, Australia

    The 86th JPEG meeting was held in Sydney, Australia. Among the different activities that took place, the JPEG Committee issued a Call for Evidence on learning-based image coding solutions. This call results from the success of the  explorations studies recently carried out by the JPEG Committee, and honours the pioneering work of JPEG issuing the first ...

  • MPEG Column: 128th MPEG Meeting in Geneva, Switzerland

    MPEG Column: 128th MPEG Meeting in Geneva, Switzerland

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The 128th MPEG meeting concluded on October 11, 2019 in Geneva, Switzerland with the following topics: Low Complexity Enhancement Video Coding (LCEVC) Promoted to Committee Draft 2nd Edition of Omnidirectional Media Format (OMAF) has reached the first ...

  • JPEG Column: 85th JPEG Meeting in San Jose, California, U.S.A.

    JPEG Column: 85th JPEG Meeting in San Jose, California, U.S.A.

    The 85th JPEG meeting was held in San Jose, CA, USA. The meeting was distinguished by the Prime Time Engineering Emmy Award from the Academy of Television Arts & Sciences (ATAS) for the longevity of the first JPEG standard. Furthermore, a very successful workshop on JPEG emerging technologies was held at Microsoft premises in Silicon Valley ...

  • JPEG Column: 84th JPEG Meeting in Brussels, Belgium

    JPEG Column: 84th JPEG Meeting in Brussels, Belgium

    The 84th JPEG meeting was held in Brussels, Belgium. This meeting was characterised by significant progress in most of JPEG projects and also exploratory studies. JPEG XL, the new image coding system, has issued the Committee Draft, giving shape to this new effective solution for the future of image coding. JPEG Pleno, the standard for new imaging technologies, Part 1 ...

  • MPEG Column: 127th MPEG Meeting in Gothenburg, Sweden

    MPEG Column: 127th MPEG Meeting in Gothenburg, Sweden

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The 127th MPEG meeting concluded on July 12, 2019 in Gothenburg, Sweden with the following topics: Versatile Video Coding (VVC) enters formal approval stage, experts predict 35-60% improvement over HEVC Essential Video Coding (EVC) promoted to Committee Draft Common ...

  • JPEG Column: 83rd JPEG Meeting in Geneva, Switzerland

    JPEG Column: 83rd JPEG Meeting in Geneva, Switzerland

    The 83rd JPEG meeting was held in Geneva, Switzerland. The meeting was very dense due to the multiple activities taking place. Beyond the multiple standardization activities, like the new JPEG XL, JPEG Pleno, JPEG XS, HTJ2K or JPEG Systems, the 83rd JPEG meeting had the report and discussion of a new exploration study on the use of learning based ...


Open Source

  • nteract – A Desktop-Based Tool for Notebooks

    nteract - A Desktop-Based Tool for Notebooks

    Introduction Writing source code for programs with lightweight text editors or fully featured integrated development environments is considered the main method of programming. Notebooks, however, are an extremely practical tool. In contrast to IDEs, projects are set up more easily and they allow for running programs in a read-eval-print loop (REPL) environment. The Jupyter Notebooks Quick ...

  • Open Source Video Streaming & Recording

    Open Source Video Streaming & Recording

    By the time of writing, the CoViD-19 disease has spread, impacting the world. Education and research are affected as well, but fortunately the community can continue working due to all the developments over the last few years. Even more so, streaming tech and video conferences allow us to keep in touch with family and friends. ...

  • OpenVSLAM: A Versatile Visual SLAM Framework

    OpenVSLAM: A Versatile Visual SLAM Framework

    Visual simultaneous localization and mapping (VSLAM) systems are essential for augmented reality devices, autonomous control of robots and drones, etc. However, conventional open-source visual SLAM frameworks are not designed to be called as libraries from third-party programs. To overcome this situation, we have developed OpenVSLAM , a novel visual SLAM framework, and released it as ...

  • Configurable image annotation on the Web

    Configurable image annotation on the Web

    Image annotations are required in a wide range of applications including image classification (which requires textual labels), object detection (bounding boxes), or image segmentation (pixel-wise classification). The application we show here was presented in the ACM Multimedia 2018 Open Source Software Competition track, and provides a number of configurable manual image annotation tools for detection and segmentation. It is available online, but in ...

  • Deep Learning in the Browser: TensorFlow JS

    Having already discussed MatConvNet and Keras, let us continue with an open source framework for deep learning, which takes a new and interesting approach. TensorFlow.js is not only providing deep learning for JavaScript developers, but it’s also making applications of deep learning available in the WebGL enabled web browsers, or more specifically, Chrome, Chromium-based browsers, ...

  • Deep learning with Keras

    Deep learning with Keras

    Following the last column on MatConvNet, let us continue to look at open source frameworks for deep learning. In this column we are going to check Keras, a Python API that allows to use several different backends like Tensorflow and CNTK. Actually, it also supports Theano, although the development of this framework has been halted by the ...

  • Simulating Adaptive Video Streaming Using Sabre

    Simulating Adaptive Video Streaming Using Sabre

    Sabre . Sabre is ...

  • MatConvNet: CNNs are also for MATLAB users

    MatConvNet: CNNs are also for MATLAB users

    MatConvNet is an open source MATLAB toolbox implementing Convolutional Neural Networks (CNNs) for computer vision and multimedia applications, developed by the same authors of the famed VLFeat library. Both libraries have associated papers that have been presented within the Open Source Software Competition track of ACM Multimedia: “MatConvNet: Convolutional Neural Networks for MATLAB” and “Vlfeat: ...

  • Content-based Multimedia Retrieval using vitrivr

    Content-based Multimedia Retrieval using vitrivr

    vitrivr is an open source retrieval system capable of processing multimedia documents such as images, videos, music, and 3D-models. It supports a wealth of content based features for multiple modalities and comes with a ready-to-use Docker image and user interface. We focus on the vitrivr stack in its second version, comprised of ADAMPro  2.0.0, Cineast ...

  • UDLF: Unsupervised Distance Learning Framework for Multimedia Retrieval

    UDLF: Unsupervised Distance Learning Framework for Multimedia Retrieval

    The Unsupervised Distance Learning Framework (UDLF) is a software developed to facilitate the general use and evaluation of novel unsupervised learning methods. These methods aim at post-processing the ranking information for different tasks, being especially useful for multimedia retrieval. The major advantage of UDLF is that it provides a unified and extensive model for ...


Datasets

  • Dataset Column: ToCaDa Dataset with Multi-Viewpoint Synchronized Videos

    Dataset Column: ToCaDa Dataset with Multi-Viewpoint Synchronized Videos

    This column describes the release of the Toulouse Campus Surveillance Dataset (ToCaDa). It consists of 25 synchronized videos (with audio) of two scenes recorded from different viewpoints of the campus. An extensive manual annotation comprises all moving objects and their corresponding bounding boxes, as well as audio events. The annotation was performed in order to ...

  • Dataset Column: Report from the MMM 2019 Special Session on Multimedia Datasets for Repeatable Experimentation (MDRE 2019)

    Dataset Column: Report from the MMM 2019 Special Session on Multimedia Datasets for Repeatable Experimentation (MDRE 2019)

    Special Session Information retrieval and multimedia content access have a long history of comparative evaluation, and many of the advances in the area over the past decade can be attributed to the availability of open datasets that support comparative and repeatable experimentation. Sharing data and code to allow other researchers to replicate research results is needed ...

  • Dataset Column: Datasets for Online Multimedia Verification

    Dataset Column: Datasets for Online Multimedia Verification

    Introduction Online disinformation is a problem that has been attracting increased interest by researchers worldwide as the breadth and magnitude of its impact is progressively manifested and documented in a number of studies (Boididou et al., 2014; Zhou & Zafarani, 2018; Zubiaga et al., 2018). This emerging area of research is inherently multidisciplinary and there have ...

  • The V3C1 Dataset: Advancing the State of the Art in Video Retrieval

    The V3C1 Dataset: Advancing the State of the Art in Video Retrieval

    Download In order to download the video dataset as well as its provided analysis data, please follow the instructions described here: https://github.com/klschoef/V3C1Analysis/blob/master/README.md Introduction Standardized datasets are of vital importance in multimedia research, as they form the basis for reproducible experiments and evaluations. In the area of video retrieval, widely used datasets such as the IACC , which has ...

  • ACM Multimedia 2019 and Reproducibility in Multimedia Research

    The first months of the new calendar year, multimedia researchers traditionally are hard at work on their ACM Multimedia submissions. (This year the submission deadline is 1 April.) Questions of reproducibility, including those of data set availability and release, are at the forefront of everyone’s mind. In this edition of SIGMM Records, the editors of ...

  • Predicting the Emotional Impact of Movies

    Predicting the Emotional Impact of Movies

    Affective video content analysis aims at the automatic recognition of emotions elicited by videos. It has a large number of applications, including mood based personalized content recommendation . Beyond the analysis of existing video material, affective computing techniques can also be used to generate new ...

  • Sharing and Reproducibility in ACM SIGMM

    Sharing and Reproducibility in ACM SIGMM

      This column discusses the efforts of ACM SIGMM towards sharing and reproducibility. Apart from the specific sessions dedicated to open source and datasets, ACM Multimedia Systems started to provide official ACM badges for articles that make artifacts available since last year. This year, it has marked a record with 45% of the articles acquiring such ...

  • Socially significant music events

    Socially significant music events

    Social media sharing platforms (e.g., YouTube, Flickr, Instagram, and SoundCloud) have revolutionized how users access multimedia content online. Most of these platforms provide a variety of ways for the user to interact with the different types of media: images, video, music. In addition to watching or listening to the media content, users can also engage ...

  • Diversity and Credibility for Social Images and Image Retrieval

    Diversity and Credibility for Social Images and Image Retrieval

    Social media has established itself as an inextricable component of today’s society. Images make up a large proportion of items shared on social media . Since its introduction in 2013, the ...


Quality-of-Experience

  • Definitions of Crowdsourced Network and QoE Measurements

    Definitions of Crowdsourced Network and QoE Measurements

    1 Introduction and Definitions Crowdsourcing is a well-established concept in the scientific community, used for instance by Jeff Howe and Mark Robinson in 2005 to describe how businesses were using the Internet to outsource work to the crowd , but can be dated back up to 1849 (weather prediction in the US). Crowdsourcing has enabled a ...

  • Collaborative QoE Management using SDN

    Collaborative QoE Management using SDN

    The Software-Defined Networking (SDN) paradigm offers the flexibility and programmability in the deployment and management of network services by separating the Control plane from the Data plane. Being based on network abstractions and virtualization techniques, SDN allows for simplifying the implementation of traffic engineering techniques as well as the communication among different services providers, included Internet Service Providers (ISPs) and Over ...

  • Can the Multimedia Research Community via Quality of Experience contribute to a better Quality of Life?

    Can the Multimedia Research Community via Quality of Experience contribute to a better Quality of Life?

    Can the multimedia community contribute to a better Quality of Life? Delivering a higher resolution and distortion-free media stream so you can enjoy the latest movie on Netflix or YouTube may provide instantaneous satisfaction, but does it make your long term life better? Whilst the QoMEX conference series has traditionally considered the former, in more ...

  • Report on QoMEX 2019: QoE and User Experience in Times of Machine Learning, 5G and Immersive Technologies

    Report on QoMEX 2019: QoE and User Experience in Times of Machine Learning, 5G and Immersive Technologies

    The QoMEX 2019 was held from 5 to 7 June 2019 in Berlin, with Sebastian Möller (TU Berlin and DFKI) and Sebastian Egger-Lampl (AIT Vienna) as general chairs. The annual conference celebrated its 10th birthday in Berlin since the first edition in 2009 in San Diego. The latter focused on classic multimedia voice, video and ...

  • Qualinet Databases: Central Resource for QoE Research – History, Current Status, and Plans

    Qualinet Databases: Central Resource for QoE Research - History, Current Status, and Plans

    Introduction Datasets are an enabling tool for successful technological development and innovation in numerous fields. Large-scale databases of multimedia content play a crucial role in the development and performance evaluation of multimedia technologies. Among those are most importantly audiovisual signal processing, for example coding, transmission, subjective/objective quality assessment, and QoE (Quality of Experience) . Publicly available ...

  • Report from QoE-Management 2019

    The 3rd International Workshop on Quality of Experience Management (QoE-Management 2019) was a successful full day event held on February 18, 2019 in Paris, France, where it was co-located with the 22nd Conference on Innovation in Clouds, Internet and Networks (ICIN). After the success of the previous QoE-Management workshops, the third edition of the workshop ...

  • On System QoE: Merging the system and the QoE perspectives

    On System QoE: Merging the system and the QoE perspectives

    With Quality of Experience (QoE) research having made significant advances over the years, increased attention is being put on exploiting this knowledge from a service/network provider perspective in the context of the user-centric evaluation of systems. Current research investigates the impact of system/service mechanisms, their implementation or configurations on the service performance and how it ...

  • Solving Complex Issues through Immersive Narratives — Does QoE Play a Role?

    Solving Complex Issues through Immersive Narratives -- Does QoE Play a Role?

    Introduction A transdisciplinary dialogue and innovative research, including technical and artistic research as well as digital humanities are necessary to solve complex issues. We need to support and produce creative practices, and engage in a critical reflection about the social and ethical dimensions of our current technology developments. At the core is an understanding that no ...

  • Towards an Integrated View on QoE and UX: Adding the Eudaimonic Dimension

    Towards an Integrated View on QoE and UX: Adding the Eudaimonic Dimension

    In the past, research on Quality of Experience (QoE) has frequently been limited to networked multimedia applications, such as the transmission of speech, audio and video signals. In parallel, usability and User Experience (UX) research addressed human-machine interaction systems which either focus on a functional (pragmatic) or aesthetic (hedonic) aspect of the experience of the ...

  • Quality of Experience Column: An Introduction

    Quality of Experience Column: An Introduction

    “Quality of Experience (QoE) is the degree of delight or annoyance of the user of an application or service. It results from the fulfillment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state.“ (Definition from ...

Comments are closed.