Download Media presentation playback annotation

Transcript
Nov. 22, 2012
US 2012/0297284 A1
three-dimensional pro?le of objects in front of the device.
can store the annotations locally and deliver links to the
One example of such a device is Microsoft’s Xbox 360®
remotely stored annotation ?les to the device for inclusion
into the media presentation master ?le.
Kinect® motion controller. A device can determine Whether a
user is speaking toWard a device during media presentation
playback based in part on the input received at these devices.
For example, the device can determine Whether the three
dimensional pro?le of an object in front of the device is that of
a single human head (torso, body), the distance from the head
to the device and the direction that the head is facing. If the
device determines that the vieWer is speaking toWards the
device and is positioned Within a speci?ed distance range in
front of the device, the device can determine that it is more
likely that voice input received from the user is an annotation.
Example 12
Exemplary User Interface During Media Presenta
tion Playback
[0058]
In any of the examples described herein, user inter
face elements relating to annotation are absent from the
device display While the media presentation is being played.
In some embodiments, annotation user interface elements can
be presented to alloW a user to capture annotations that Would
In one example Where the device is a smartphone, digital
otherWise not automatically be captured by a device, such as
camera or camcorder, the speci?ed distance range is 12 to 36
inches. In another example Where the device is an Xbox 360®
When a user is shoWing a presentation of a recent vacation to
With Kinect® motion controller, the speci?ed distance range
betWeen the device and his friends, and Wants his narrative to
is 6 to 10 feet. The speci?ed distance range can be any other
range of distances that re?ects that voice input comprises an
annotation, and can be con?gured by a user or determined by
the device based on parameters supplied by a user (e.g.,
distance from the Kinect® controller to a couch, siZe of the
television connected to the Xbox®, etc.).
[0054] In some embodiments, annotation capture can be
controlled by voice commands. For example, a computing
device can be con?gured to process the voice input to detect
audio commands (e.g., “annotate start” or “annotate stop”)
and begin and end the capture of annotation in response. The
computing device can be con?gured to detect additional
annotation commands such as “remove last 5 seconds,”
“remove ?rst 5 seconds,” “increase annotation volume,”
“decrease annotation volume” and “delete annotation.” In
be captured as an annotation to the presentation. Such an
annotation user interface could comprise annotation user
addition, a video input device or other sensor can be part of a
natural interface that interprets hand, face or body gestures as
annotation control commands.
a friend, is repeatedly moving his head back and forth
interface elements that are selected When a user hits a key or
button, clicks on a user element With a mouse, or touching an
element if the display is a touchscreen.
Example 13
Exemplary Detection of the End of an Annotation
[0059]
In any of the examples described herein, the end of
an annotation can be detected When no voice input is received
for a speci?ed period (e.g., several seconds). A pause in a
person speaking does not start a neW annotation unless the
pause extends long enough for the device to consider the
current annotation to have ended. Any further voice input
determined to be an annotation starts a neW annotation.
Example 14
Exemplary Handling of Voice Input from Multiple
Example 11
Users
Exemplary Timing of Annotation Processing
[0060] In any of the examples described herein, a comput
ing device can be con?gured to handle voice input from
[0055] In any of the examples described herein, annotation
processing can be performed on the ?y during media presen
tation playback or at a later time. For example, a computing
device can buffer the incoming voice input and any other
input data it is capable of receiving during presentation play
back. If voice input is detected, the computing device saves
the incoming voice input until it determines that the voice
input does not comprise an annotation.
[0056] During on-the-?y processing, the device canbe con
?gured to postpone advancing the media presentation to the
next media element if the element currently playing has ?n
ished, and an annotation currently being captured has not
ended (e.g., the device has not yet detected a silence). In such
a case, once the annotation has been detected to have ended,
the master ?le can be modi?ed to indicate that the media
multiple users. The device can detect voice input from mul
tiple users by, for example, determining that voice input is
coming from more than one physical location based on the
differences in voice input signal strength or delays in the same
voice input being received at multiple audio input devices.
[0061] In some embodiments, detection of voice input
coming from multiple users is discarded. In other embodi
ments, detection of voice input coming from multiple users
simultaneously canbe regarded as a single annotation. AlloW
ing multiple voice input annotations can be desired to capture
the response of a group of vieWs to a media presentation.
Example 15
Exemplary Annotation Tracks
element that has just ?nished playing is to be played or pre
sented for the duration of the annotation.
[0057] In some embodiments, the device can postpone
[0062] In any of the examples described herein, a media
presentation can comprise multiple annotation tracks. An
voice input processing until after the media presentation has
playback of a media presentation. The annotation data stored
?nished playing, When su?icient computing device resources
in the master ?le can contain annotation track information
such as identifying information about the user Who laid doWn
the track, and When and Where the track Was made.
become available, or under other device conditions. The cap
tured voice input (and any additional input) can be delivered
to a remote resource such as a cloud-based service for anno
tation detection and capture. The resulting annotations can be
delivered back to the computing device, or the remote service
annotation track is one or more annotations created during a
[0063] A computing device can be con?gured to handle the
capture of an annotation that overlaps an existing annotation.
In some embodiments, annotations are added to the media