Open Source Column: Mozilla Popcorn

Mozilla Popcorn: Web Video Interaction Using Client-Side Javascript

Context and history

Popcorn is an HTML5 media project from Mozilla, the non-profit organization that makes the Firefox web browser. It makes media-oriented web development easy through shared development, open source libraries and tools.

Popcorn.js: a Javascript library for interactions between video and the web

Popcorn.js makes web media more connected by providing an event-driven API to hook <video> and <audio> content into the of the capibilities of the web platform (developer.mozilla.org). Prior to HTML5, web video lived exclusively inside browser plug-ins like Flash and VLC, which put it outside the reach of JavaScript, CSS, and other techniques for interacting with the rest of the surrounding HTML document. Popcorn.js turns media into fully-interactive JavaScript objects, so that media objects can both trigger and listen for events. It enables developers to cue events along a media timeline using a simple Javascript syntax:

var pop = Popcorn("#my-video");
pop.text({
start: 1.38,
end: 5.12,
text: "Hello World",
target: "my-div"
});
pop.play();

Live source available at http://jsfiddle.net/p8Kbs/80/. Additionally, media playback is accessible via popcorn.play(), popcorn.pause(), and popcorn.currentTime(seconds), which allows you to jump to any point in the timeline of the referenced media. As a nod toward the expectations of media producers and videographers, Popcorn.js also provides methods like popcorn.cue(), which simply ties actions to specific times. Aside from simple time-based triggers, you can use popcorn.listen(event,callback_function) to bind the callback function to a specified event. Built-in events are provided to handle typical HTML5 web video playback scenarios, such as “play,” “pause,” “loadstart,” “seeked,” “volumechange,” and so on. However, you can define custom events and trigger them directly by using popcorn.trigger(event[,data]), where the data parameter is an optional data object to send to listeners.

Extensibility

By design, Popcorn is extensible. Mozilla supports about 20 plugins that come packaged with the library, ranging from simple HTML element insertion, to complex data retrieval and aggregation. Examples include a subtitle plugin, a GoogleMaps plugin, a Twitter plugin, a Facebook plugin, and a JavaScript code plugin. If some desired functionality doesn’t yet exist in the library, Popcorn.js has a well-documented plugin architecture: http://popcornjs.org/popcorn-docs/addon-development/. Popcorn works best with HTML5 media, but also has wrappers for arbitary objects (through the “baseplayer”) and Flash players, like YouTube, Vimeo, Flowplayer, and Soundcloud. It’s easy to write a wrapper for any web-oriented video player. Popcorn also includes a set of parsers for reading common data files (SRT, TTML, XML, etc). Of course, as with other parts of Popcorn, it is easy to create a custom data parser. Tested thoroughly, Popcorn.js supports all modern browsers and IE8. Currently, it’s stable at version 1.2. You can download the Popcorn source or use a web-based build tool to wrap a custom, compressed version.

Potential Applications

Popcorn is in use by a range of publishers, service providers, creative coders and individuals to mash video with the rest of the web. RAMP, a content optimization company, uses an automated process to display time-coded metadata about significant people, places and things whenever they are mentioned in a video. Using Popcorn, RAMP can support a range of player types and contexts (web, mobile, headless) by developing against the common Popcorn API (http://www.ramp.com/solutions/optimized-video/metaplayer/popcorn/). The Dutch multimedia archive Beeld en Geluid has used Popcorn to create a “living archive,” connecting cultural archival material with a range of semantic metadata (http://www.openimages.eu/blog/2012/01/13/open-images-videos-enriched-with-open-data/). Popcorn has also been used to create hyperlinked transcripts that use text as an interface for traversing and editing long media assets (http://yoyodyne.cc/h/) Aside from scale applications, Popcorn is also supported by a burgeoning creative community (In fact, the project was started and is run by Brett Gaylor–a filmmaker!). For instance, documentary producer Kat Cizek uses Popcorn to create web based interactive films. In “1 Millionth Tower,” the web browser creates a navigable 3D space that simulates high rises in major cities around the world. Popcorn is used to turn the camera at key moments, spawn visual effects, and to download live weather data from web APIs. If it’s raining in Toronto, it’s also raining in virtual Toronto (http://highrise.nfb.ca/onemillionthtower/1mt_webgl.php).

Popcorn Maker

A key goal of the Popcorn project is to enable more connected web video on a mass scale, and to open creative possibilities to individual media-makers. Popcorn Maker is a user-facing web application used to create interactive media. It requires no code knowledge. Users pick a video from YouTube or the wider web, open the media object in a prepared HTML template, customize the project, and publish. Popcorn Maker can be used to create pop-up videos, multimedia reports, guided web tours and more. Project composition happens live in the browser. Users can drag and drop events onto a timeline interface, position objects on the page, and watch a live preview of the project be constructed. Popcorn Maker projects are entirely human-readable HTML, CSS and Javascript. For the time being, Popcorn Maker does not support media editing and sequencing. Users must come prepared with an edited video file. For this reason, Popcorn Maker is not a web-based video editor–rather, it’s a video-based web editor. We may revisit this decision later when web browsers handle media playback and synchronization more precisely. Like the rest of the Popcorn project, Popcorn Maker is 100% free and open source. Developers of time-based multimedia apps are encouraged to build on the Butter SDK (source code available at http://github.com/mozilla/butter) and contribute back to the project. At the time of this writing, Popcorn Maker is in active development at version 0.5, and is scheduled for a 1.0 release in late 2012. http://mozillapopcorn.org.

Credits

The Popcorn project and its constituents are lovingly crafted by Ben Moskowitz, Bobby Richter, Brett Gaylor, David Seifried, Christopher De Cairos, Matthew Schranz, Jon Buckley, Scott Downe, Mohammed Buttu, Kate Hudson, David Humphrey, Jeremy Banks, Brian Chirls, James Burke, Robert Stanica, Anna Sobiepanek, Rick Waldron, Nick Cammarata, Daniel Hodgin, Daniel Brooks, Boaz Sender, Dan Ventura, Brad Chen, Minoo Ziaei, Cesar Gomes, Steven Weerdenburg, Cole Gillespie, and Nick Doiron.

MPEG Column: 100th MPEG Meeting

MPEG news: a report from the 100th meeting, Geneva, CH

The official press release is available here and I’d like to highlight two topics from MPEGs’ 100th meetingĀ in Geneva, Switzerland:

  • MP100E“: MPEG celebrates its 100th meeting
  • Systems news: ISOBMFF 4th edition, MDS social metadata, DASH conformance/refsw et al.
  • WebVC and ARAF goes CD
  • HEVC preliminary subjective test results publicly available Read more

Video Browser Showdown

The Video Browser Showdown (VBS) is a live video browsing competition where international researchers, working in the field of interactive video search, evaluate and demonstrate the efficiency of their tools in presence of the audience. The aim of the VBS is to evaluate video browsing tools for efficiency at known-item search (KIS) tasks with a well-defined data set in direct comparison to other tools. For each task the moderator presents a target clip on a shared screen that is visible to all participants. The participants use their own systems to perform an interactive search in the specified video file taken from a common data set and try to find the desired segment as fast as possible. Found segments are submitted to a server that is responsible for three tasks: (1) checking whether the submitted segment is correct, (2) measuring the task solve time and (3) computing scores for all teams and tasks. The performance of participating tools is evaluated in terms of successful submissions and search time. Read more

ACM International Conference on Multimedia 2009

On behalf of the entire Organizing Committee, we wish to report to you that the seventeen ACM International Conference on Multimedia (ACM Multimedia 2009), was held October 19-22, 2009 at the Beijing Hotel in Beijing, China.

The General Chairs at the Conference Banquet (l.t.r. Alan Hanjalic, Yong Rui, Wen Gao)

ACM Multimedia is the premier annual event on multimedia research, technology and art. Since 1993, the conference has brought together researchers, practitioners and users from academia, industry, and government active in the broad field of multimedia in order to communicate the state-of-the-art in multimedia research, technology and art. In particular, the conference brings newest insights into the possibilities to explore and exploit old and new media (e.g., text, audio, visual, haptics), used in isolation or in a synergetic combination, in order to bring the technology facilitating the interaction and communication among humans, machines and data a significant step further.

SIG Multimedia Chair Klara Nahrstedt

Richness of new fundamental concepts, practical tools and controversial ideas that emerged from the worldwide multimedia community in the past year is reflected in a wide variety of elements of this year’s conference program. In addition to the oral and poster sessions presenting the full and short technical papers, respectively, the conference also features a plenary brave new topic session and two panel discussions bringing up the issues that are currently hot and controversial in the field of multimedia. Special role in the conference program has been reserved for the workshops held in conjunction with the main conference and meant to focus on specific multimedia-related topics, either to explore them more in depth or to promote them in the multimedia community. One key aspect of this conference that is different from most other academic conferences is its emphasis on systems and applications. To this end, the conference also includes technical demonstrations of research prototypes and systems, open source software competition, video demonstration of concepts and applications, as well as multimedia art sessions. Finally, by including the doctoral symposium and tutorials on various topics, the conference is also committed to inspire and educate junior scientists in the field and so strengthen and expand the multimedia research community for the years to come.

Recipient of the 2009 SIGMM Award for Outstanding Technical Contributions to Multimedia Computing, Communications and Applications, Lawrence A. Rowe

A highlight of ACM Multimedia 2009 was the Multimedia Grand Challenge, organized for the first time as a part of the conference program. The Multimedia Grand Challenge is a set of problems and issues from a number of industry leaders geared to engage the multimedia research community in solving relevant, interesting and challenging questions about the industry’s 2-5 year horizon for multimedia. Researchers were encouraged to submit working systems in response to the challenge to win the Grand Challenge competition. A large number of submissions were received for this first edition of the competition. The large number not only reveals the interest of the research community to address relevant real-life problems, but also reflects the high potential that we already have in the community to successfully address these problems.

Editor-in-Chief of ACM SIGMM’s TOMCCAP journal, Nicholas Georganas

The Content, Applications, Systems, and Human-Centered Multimedia tracks received 305 long paper submissions (138 in Content, 75 in Applications, 56 in Systems, and 36 in Human-Centered Multimedia). Each paper was reviewed by at least three qualified reviewers in a double-blind review process. The Program Committee met on June 28 2009 in New York to discuss the papers and make final selections for papers to be included as oral presentations in the conference program. This rigorous review process resulted in the acceptance of 50 long papers: 22 in the Content track, 12 in the Applications track, 10 in the Systems track, and 6 in the Human-Centered Multimedia track. This represents an acceptance rate of 16.4% percent.

The short paper program received 369 submissions. After a thorough review process, we accepted 103 papers resulting in an acceptance rate of 27.9% percent. These short papers will be presented during poster sessions at the conference. This year’s sixth version of the Interactive Art Program will consist of long and short papers in the dedicated multimedia art sessions.

Welcome to the Animation School of Beijing Film Academy, hosts of the Conference Reception

We would like to thank our supporters: Baidu, Beijing Film Academy, FXPAL, Google, HP Labs, Microsoft Research, National Natural Science Foundation of China, NEC Labs, Netease, Peking University, Star Software, and Tencent. Without their generous support, organizing this conference would have been difficult.

The ACM Multimedia 2009 conference is the result of a strong and dedicated effort by a large number of volunteers. We would like to express our deep gratitude to everyone on the Organizing Committee for making the conference happen, and to the Program Committee and external reviewers who diligently worked to review submissions and provide suggestions and feedback to authors that resulted in a high quality final program. We also thank the ACM Staff for their strategic and administrative support. Finally we would like to acknowledge ACM and thank the special interest group SIGMM for sponsoring this event.

We hope you enjoyed the conference.

Wen Gao, Peking University, China
Yong Rui, Microsoft, China
Alan Hanjalic, Delft University of Technology, The Netherlands
ACM Multimedia 2009 General Co-Chairs

ACM International Conference on Image and Video Retrieval (CIVR) 2009

CIVR is one of the most important and influential conferences in the area of image and video analysis and retrieval and gathers many important researchers and practitioners from academia and industry. Following this tradition, CIVR 2009 has been a very successful event. This year 138 submissions from 29 countries were received and, after being reviewed by the Program Committee members, 45 were accepted for presentation (18 orals and 27 posters). Additionally, the program included two excellent invited presentations given by Prof. Luis von Ahn from Carnegie Mellon University, USA, and Prof. Luc van Gool, from ETH Zurich (Switzerland) and the University of Leuven (Belgium). Read more

ACM Multimedia Conference Review Committee

Dear SIGMM Members,

our flagship conference, the ACM Multimedia, has now existed for existed for 17 years. And still, the conference organization is changing every year. With an approach that puts new chairs and entirely new organizing committees in charge every year in a bidding process, ACM Multimedia is highly dynamic. However, this dynamicity comes with major downsides. Every committee makes changes, and because continuity is not guaranteed, good changes do often get lost, while bad ones persist. An institutional memory is missing. Read more

An Interview with Video Quality Experts

For multimedia researchers, improvement of users’ quality-of-experience is a more valuable goal that an easily measurable quality-of-service. Consequently, researchers use video quality evaluation metrics to assess whether they can increase or maintain it. In this issue, we publish an interview with renowned video quality experts. Read more

Report from NOSSDAV 2009

International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV)

The 19th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV 2009) was held in Williamsburg, Virginia from 3 – 5 June, 2009. NOSSDAV 2009 adhered to the workshop’s long tradition of focusing on emerging topics, controversial ideas, and future research directions in the area of multimedia systems research. The main goals of the workshop are to accommodate timely exchange of research results and to foster lively, constructive discussions on potentially controversial concepts and solutions. Read more

Featured Paper: Wireless network security: Comparison of WEP mechanism, WPA and RSN security protocols

In this edition of the SIGMM Records, we present some background for the paper “Wireless network security: comparison of WEP (Wired Equivalent Privacy) mechanism, WPA (Wi-Fi Protected Access) and RSN (Robust Security Network) security protocols”. Of all papers that were presented at workshops and conferences that were sponsored or co-sponsored by SIG Multimedia, it was the second most downloaded paper in the third quarter of 2008. We have therefore asked the authors to describe the background of their work, their motivation, the problems in performing the research, and possible errata. Read more