Open Science

Standardization, open source software and datasets

Jump to Introduction, Reports from Standardization, Open Source, Datasets, Quality-of-Experience

Introduction

Standards Column: JPEG and MPEG

Standards Column: JPEG and MPEG

Introduction ISO/IEC JTC 1/SC 29 area of work comprises the standardization of coded representation of audio, picture, multimedia and hypermedia information and sets of compression and control functions for use with such information. SC29 basically hosts two working groups responsible for the development of international standards for the compression, decompression, processing, and coded representation of media content, ...


Reports from Standardization

  • MPEG Column: 128th MPEG Meeting in Geneva, Switzerland

    MPEG Column: 128th MPEG Meeting in Geneva, Switzerland

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The 128th MPEG meeting concluded on October 11, 2019 in Geneva, Switzerland with the following topics: Low Complexity Enhancement Video Coding (LCEVC) Promoted to Committee Draft 2nd Edition of Omnidirectional Media Format (OMAF) has reached the first ...

  • JPEG Column: 84th JPEG Meeting in Brussels, Belgium

    JPEG Column: 84th JPEG Meeting in Brussels, Belgium

    The 84th JPEG meeting was held in Brussels, Belgium. This meeting was characterised by significant progress in most of JPEG projects and also exploratory studies. JPEG XL, the new image coding system, has issued the Committee Draft, giving shape to this new effective solution for the future of image coding. JPEG Pleno, the standard for new imaging technologies, Part 1 ...

  • MPEG Column: 127th MPEG Meeting in Gothenburg, Sweden

    MPEG Column: 127th MPEG Meeting in Gothenburg, Sweden

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The 127th MPEG meeting concluded on July 12, 2019 in Gothenburg, Sweden with the following topics: Versatile Video Coding (VVC) enters formal approval stage, experts predict 35-60% improvement over HEVC Essential Video Coding (EVC) promoted to Committee Draft Common ...

  • JPEG Column: 83rd JPEG Meeting in Geneva, Switzerland

    JPEG Column: 83rd JPEG Meeting in Geneva, Switzerland

    The 83rd JPEG meeting was held in Geneva, Switzerland. The meeting was very dense due to the multiple activities taking place. Beyond the multiple standardization activities, like the new JPEG XL, JPEG Pleno, JPEG XS, HTJ2K or JPEG Systems, the 83rd JPEG meeting had the report and discussion of a new exploration study on the use of learning based ...

  • MPEG Column: 126th MPEG Meeting in Geneva, Switzerland

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The 126th MPEG meeting concluded on March 29, 2019 in Geneva, Switzerland with the following topics: Three Degrees of Freedom Plus (3DoF+) – MPEG evaluates responses to the Call for Proposal and starts a new project on ...

  • MPEG Column: 125th MPEG Meeting in Marrakesh, Morocco

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The 125th MPEG meeting concluded on January 18, 2019 in Marrakesh, Morocco with the following topics: Network-Based Media Processing (NBMP) – MPEG promotes NBMP to Committee Draft stage 3DoF+ Visual – MPEG issues Call for Proposals on ...

  • JPEG Column: 82nd JPEG Meeting in Lisbon, Portugal

    JPEG Column: 82nd JPEG Meeting in Lisbon, Portugal

    The 82nd JPEG meeting was held in Lisbon, Portugal. Highlights of the meeting are progress on JPEG XL, JPEG XS, HTJ2K, JPEG Pleno, JPEG Systems and JPEG reference software. JPEG has been the most common representation format of digital images for more than 25 years. Other image representation formats have been standardised by JPEG committee like ...

  • MPEG Column: 124th MPEG Meeting in Macau, China

    The original blog post can be found at the Bitmovin Techblog and has been modified/updated here to focus on and highlight research aspects. The MPEG press release comprises the following aspects: Point Cloud Compression – MPEG promotes a video-based point cloud compression technology to the Committee Draft stage Compressed Representation of Neural Networks – MPEG issues Call for ...

  • JPEG Column: 81st JPEG Meeting in Vancouver, Canada

    JPEG Column: 81st JPEG Meeting in Vancouver, Canada

    The 81st JPEG meeting was held in Vancouver, British Columbia, Canada, at which significant efforts were put into the analysis of the responses to the call for proposals on the next generation image coding standard, nicknamed JPEG XL, that is expected to provide a solution for image format with improved quality and flexibility, allied with ...

  • JPEG Column: 80th JPEG Meeting in Berlin, Germany

    JPEG Column: 80th JPEG Meeting in Berlin, Germany

    The 80th JPEG meeting was held in Berlin, Germany, from 7 to 13 July 2018. During this meeting, JPEG issued a record number of ballots and output documents, spread through the multiple activities taking place. These record numbers are very revealing of the level of commitment of JPEG standardisation committee. A strong effort is being accomplished on the standardisation of ...


Open Source

  • Configurable image annotation on the Web

    Configurable image annotation on the Web

    Image annotations are required in a wide range of applications including image classification (which requires textual labels), object detection (bounding boxes), or image segmentation (pixel-wise classification). The application we show here was presented in the ACM Multimedia 2018 Open Source Software Competition track, and provides a number of configurable manual image annotation tools for detection and segmentation. It is available online, but in ...

  • Deep Learning in the Browser: TensorFlow JS

    Having already discussed MatConvNet and Keras, let us continue with an open source framework for deep learning, which takes a new and interesting approach. TensorFlow.js is not only providing deep learning for JavaScript developers, but it’s also making applications of deep learning available in the WebGL enabled web browsers, or more specifically, Chrome, Chromium-based browsers, ...

  • Deep learning with Keras

    Deep learning with Keras

    Following the last column on MatConvNet, let us continue to look at open source frameworks for deep learning. In this column we are going to check Keras, a Python API that allows to use several different backends like Tensorflow and CNTK. Actually, it also supports Theano, although the development of this framework has been halted by the ...

  • Simulating Adaptive Video Streaming Using Sabre

    Simulating Adaptive Video Streaming Using Sabre

    Sabre . Sabre is ...

  • MatConvNet: CNNs are also for MATLAB users

    MatConvNet: CNNs are also for MATLAB users

    MatConvNet is an open source MATLAB toolbox implementing Convolutional Neural Networks (CNNs) for computer vision and multimedia applications, developed by the same authors of the famed VLFeat library. Both libraries have associated papers that have been presented within the Open Source Software Competition track of ACM Multimedia: “MatConvNet: Convolutional Neural Networks for MATLAB” and “Vlfeat: ...

  • Content-based Multimedia Retrieval using vitrivr

    Content-based Multimedia Retrieval using vitrivr

    vitrivr is an open source retrieval system capable of processing multimedia documents such as images, videos, music, and 3D-models. It supports a wealth of content based features for multiple modalities and comes with a ready-to-use Docker image and user interface. We focus on the vitrivr stack in its second version, comprised of ADAMPro  2.0.0, Cineast ...

  • UDLF: Unsupervised Distance Learning Framework for Multimedia Retrieval

    UDLF: Unsupervised Distance Learning Framework for Multimedia Retrieval

    The Unsupervised Distance Learning Framework (UDLF) is a software developed to facilitate the general use and evaluation of novel unsupervised learning methods. These methods aim at post-processing the ranking information for different tasks, being especially useful for multimedia retrieval. The major advantage of UDLF is that it provides a unified and extensive model for ...

  • Open Source Column – Introduction

    Open Source Column - Introduction

    “Open source software is software that can be freely accessed, used, changed, and shared (in modified or unmodified form) by anyone” (cp. https://opensource.org/osd). So open source software (OSS) is actually something that one or more people can work on, improve it, refine it, change it, adapt it and share or use it. Why would anyone ...

  • Open Dataset and Software Track @ ACM MMSys 2017

    The ACM Multimedia Systems Conference (MMSys) provides a forum for researchers to present and share their latest research findings in multimedia systems. While research about specific aspects of multimedia systems are regularly published in the various proceedings and transactions of the networking, operating system, realtime system, and database communities, MMSys aims to cut across these ...

  • MediaEval 2016 multimedia benchmark: Registration open—first data releases starting soon

    MediaEval offers shared-tasks in multimedia retrieval and analysis. Successful approaches make use of multiple modalities and go beyond visual content to also exploit audio, text, and other contextual information. For each task, participants receive a task definition, task data, and accompanying resources (dependent on task) such as keyframes, visual features, and social metadata. Register through ...


Datasets

  • Dataset Column: Report from the MMM 2019 Special Session on Multimedia Datasets for Repeatable Experimentation (MDRE 2019)

    Dataset Column: Report from the MMM 2019 Special Session on Multimedia Datasets for Repeatable Experimentation (MDRE 2019)

    Special Session Information retrieval and multimedia content access have a long history of comparative evaluation, and many of the advances in the area over the past decade can be attributed to the availability of open datasets that support comparative and repeatable experimentation. Sharing data and code to allow other researchers to replicate research results is needed ...

  • Dataset Column: Datasets for Online Multimedia Verification

    Dataset Column: Datasets for Online Multimedia Verification

    Introduction Online disinformation is a problem that has been attracting increased interest by researchers worldwide as the breadth and magnitude of its impact is progressively manifested and documented in a number of studies (Boididou et al., 2014; Zhou & Zafarani, 2018; Zubiaga et al., 2018). This emerging area of research is inherently multidisciplinary and there have ...

  • The V3C1 Dataset: Advancing the State of the Art in Video Retrieval

    The V3C1 Dataset: Advancing the State of the Art in Video Retrieval

    Download In order to download the video dataset as well as its provided analysis data, please follow the instructions described here: https://github.com/klschoef/V3C1Analysis/blob/master/README.md Introduction Standardized datasets are of vital importance in multimedia research, as they form the basis for reproducible experiments and evaluations. In the area of video retrieval, widely used datasets such as the IACC , which has ...

  • ACM Multimedia 2019 and Reproducibility in Multimedia Research

    The first months of the new calendar year, multimedia researchers traditionally are hard at work on their ACM Multimedia submissions. (This year the submission deadline is 1 April.) Questions of reproducibility, including those of data set availability and release, are at the forefront of everyone’s mind. In this edition of SIGMM Records, the editors of ...

  • Predicting the Emotional Impact of Movies

    Predicting the Emotional Impact of Movies

    Affective video content analysis aims at the automatic recognition of emotions elicited by videos. It has a large number of applications, including mood based personalized content recommendation . Beyond the analysis of existing video material, affective computing techniques can also be used to generate new ...

  • Sharing and Reproducibility in ACM SIGMM

    Sharing and Reproducibility in ACM SIGMM

      This column discusses the efforts of ACM SIGMM towards sharing and reproducibility. Apart from the specific sessions dedicated to open source and datasets, ACM Multimedia Systems started to provide official ACM badges for articles that make artifacts available since last year. This year, it has marked a record with 45% of the articles acquiring such ...

  • Socially significant music events

    Socially significant music events

    Social media sharing platforms (e.g., YouTube, Flickr, Instagram, and SoundCloud) have revolutionized how users access multimedia content online. Most of these platforms provide a variety of ways for the user to interact with the different types of media: images, video, music. In addition to watching or listening to the media content, users can also engage ...

  • Diversity and Credibility for Social Images and Image Retrieval

    Diversity and Credibility for Social Images and Image Retrieval

    Social media has established itself as an inextricable component of today’s society. Images make up a large proportion of items shared on social media . Since its introduction in 2013, the ...


Quality-of-Experience

  • Report on QoMEX 2019: QoE and User Experience in Times of Machine Learning, 5G and Immersive Technologies

    Report on QoMEX 2019: QoE and User Experience in Times of Machine Learning, 5G and Immersive Technologies

    The QoMEX 2019 was held from 5 to 7 June 2019 in Berlin, with Sebastian Möller (TU Berlin and DFKI) and Sebastian Egger-Lampl (AIT Vienna) as general chairs. The annual conference celebrated its 10th birthday in Berlin since the first edition in 2009 in San Diego. The latter focused on classic multimedia voice, video and ...

  • Qualinet Databases: Central Resource for QoE Research – History, Current Status, and Plans

    Qualinet Databases: Central Resource for QoE Research - History, Current Status, and Plans

    Introduction Datasets are an enabling tool for successful technological development and innovation in numerous fields. Large-scale databases of multimedia content play a crucial role in the development and performance evaluation of multimedia technologies. Among those are most importantly audiovisual signal processing, for example coding, transmission, subjective/objective quality assessment, and QoE (Quality of Experience) . Publicly available ...

  • Report from QoE-Management 2019

    The 3rd International Workshop on Quality of Experience Management (QoE-Management 2019) was a successful full day event held on February 18, 2019 in Paris, France, where it was co-located with the 22nd Conference on Innovation in Clouds, Internet and Networks (ICIN). After the success of the previous QoE-Management workshops, the third edition of the workshop ...

  • On System QoE: Merging the system and the QoE perspectives

    On System QoE: Merging the system and the QoE perspectives

    With Quality of Experience (QoE) research having made significant advances over the years, increased attention is being put on exploiting this knowledge from a service/network provider perspective in the context of the user-centric evaluation of systems. Current research investigates the impact of system/service mechanisms, their implementation or configurations on the service performance and how it ...

  • Solving Complex Issues through Immersive Narratives — Does QoE Play a Role?

    Solving Complex Issues through Immersive Narratives -- Does QoE Play a Role?

    Introduction A transdisciplinary dialogue and innovative research, including technical and artistic research as well as digital humanities are necessary to solve complex issues. We need to support and produce creative practices, and engage in a critical reflection about the social and ethical dimensions of our current technology developments. At the core is an understanding that no ...

  • Towards an Integrated View on QoE and UX: Adding the Eudaimonic Dimension

    Towards an Integrated View on QoE and UX: Adding the Eudaimonic Dimension

    In the past, research on Quality of Experience (QoE) has frequently been limited to networked multimedia applications, such as the transmission of speech, audio and video signals. In parallel, usability and User Experience (UX) research addressed human-machine interaction systems which either focus on a functional (pragmatic) or aesthetic (hedonic) aspect of the experience of the ...

  • Quality of Experience Column: An Introduction

    Quality of Experience Column: An Introduction

    “Quality of Experience (QoE) is the degree of delight or annoyance of the user of an application or service. It results from the fulfillment of his or her expectations with respect to the utility and / or enjoyment of the application or service in the light of the user’s personality and current state.“ (Definition from ...

Comments are closed.