Thursday, February 25, 2010

Eyes-Free: TalkBack And Shell Improvements

Here is a brief summary of updates to Android's eyes-free tools--- including TalkBack, and the Eyes-Free Shell from the last two weeks.

TalkBack

  • Speech during a phone call is now re-enabled.
  • Turning the screen on/off is spoken. This announcement includes the ringer mode/volume.
  • Changes in the the ringer mode - silent, vibrate, and normal are now announced.
  • Unlocking the phone is announced.
  • Other Android applications can programmatically discover if TalkBack is enabled.

Eyes-Free Shell

Now that applications can programmatically discover whetherTalkBack has been enabled, configuring Eyes-Free shell to become your default home screen has become a lot easier. In a nutshell,if you are a TalkBack user and install Eyes-Free shell, hitting the Home button will bring up the eyes-free shell, ---no configuration needed. Note that you can always get to the default Android home screen by long-pressing the Back button.

Share And Enjoy

Friday, February 12, 2010

Eyes-Free Updates: Marvin And TalkBack Simplified

We routinely push updates to our access tools on Android; users get these updates automatically via Android Market updates. We just pushed out updated versions of TalkBack, our Open Source screenreader for Android, and Marvin, the Eyes-Free shell. Here is a brief summary of these updates:

  • Android applications can now programmatically discover if TalkBack is running, thanks to the latest changes in TalkBack. From an end-user perspective, this means that you no longer need to configure Eyes-Free shell via EyesFreeConfig to be the default home. If you run TalkBack, and have EyesFree Shell installed, then pressing Home automatically gives you the EyesFree Shell. Remember, you can always get to the default Android Home by long-pressing Back.
  • EyesFree Shell now includes a touch-based shortcuts manager. Until now, shortcuts needed to be explicitly configured by editting an XML file on the SDCard. With the recent EyesFree update, you can interactively define short-cuts via a touch-based ShortCuts manager. By default, we have assigned shortcut 1 to the ShortCuts manager; so to invoke this new feature, do:
    1. Stroke left (4 using stroke dialer notation) to enter the shortcuts screen.
    2. Stroke up and to the left (1 using stroke-dialer notation) to invoke application ShortCuts Manager.
    3. Use the trackball/D-Pad to configure each of the 8 available shortcuts.

Marvin: We hope this gives some minimal relief to the pain in all the diodes on your left side.

Monday, February 8, 2010

Silencing Speech With A Wave Of Your Hand On Android 2.0

Update To Android Access: TalkBack

Smart phones tend to be short on physical buttons --- even devices like the G1 or MotoRola Droid have very few buttons when the physical keyboard is not open. This provides interesting challenges when designing an efficient eyes-free interface --- especially given the old maxim Speech is silvern, but silence is golden!.Said differently, once you have built a system that talks back, the first thing you want to build is an efficient means of silencing spoken feedback.

Early versions of TalkBack on Android skimmed by without a stop speech button --- you basically moved from one activity to another,and the speech produced by the new activity effectively stopped ongoing spoken output. However, as we make more and more applications work seamlessly with our Access APIs, it's always been clear to us that we need a global stop speech gesture! Notice that I said gesture --- not key --- stopping speech is a critical function that we'd like to enable without having to pull out the physical keyboard, and something we'd like to have devices without a physical keyboard.

In the spirit of the dual to every access challenge is an opportunity to innovate, we recently launched a new experimental TalkBack feature on devices running Android 2.0. Devices on the Android 2.0 platform have a proximity sensor on the top front left corner of the phone --- this is typically used to lock the screen when you're holding the phone up to your ear when on a phone call. As the name implies, the proximity sensorfires when you get close to it --- you can activate it by waving your hand close to the top left corner of the phone. As an experimental feature, we have configured the latest version of TalkBack to silence ongoing speech if you wave your hand in front of the proximity sensor.

Note that this is a new, experimental feature --- it's something that we welcome feedback on our public Eyes-Free Google Group. We'd like to know if you accidentally activate stop speechbecause of this new feature. In having used it for a few weeks, I find that I am not triggering it accidentally --- but that might well be a function of how I hold the phone.

What Devices Does This Available On?

Note that at the time of writing, the devices that have a proximity sensor that I have used this on include:

  • MotoRola Droid from Verizon
  • Google NexusOne

Note that the G1 and other older Android devices did not have a proximity sensor.

Friday, January 22, 2010

1Vox --- Your Query Is Our Command

Video: 1Vox --- Your Query Is Our Command

1 Video: 1Vox --- Your Query Is Our Command!

Device Used: Motorola Droid on Verizon

Speech interface designers often express surprize at the the fact that the average blind user rarely if ever uses spoken input. But when you come down to it, this is not too surprizing --- given that the eyes-free user has speech output active, the overall system ends up talking to itself!

To show that these conflicts can be avoided by careful user-interface design, we demonstrate 1Vox --- our voice-search wizard for the Marvin Shell.

  1. You activate 1Vox by stroke 9 on the Marvin screen.
  2. You hear a spoekn prompt Search
  3. You hear a little auditory icon when the system is ready for you.
  4. You speak oft-used queries e.g., Weather Mountain View.
  5. You hear a short spoken snippet in response.

We called this widget 1Vox --- in honor of the Google onebox found on the Google Results page.

Author: T.V Raman <raman@google.com>

YouTube And TalkBack --- Entertainment On The Go

Video: TalkBack And YouTube

1 Video: TalkBack And YouTube

Device: Motorola Droid on Verizon

This video demonstrates searching for and playing YouTube videos with TalkBack providing spoken feedback at each step in the interaction.

  1. Launch YouTube from the Marvin Application launcher.
  2. The trackball can be used here to move through the list of videos.
  3. Pressing down on the trackball launches the selected video.
  4. Press menu key to enter the YouTube application menu.
  5. Click on Search with the trackball.
  6. Type a query into the edit field. TalkBack speaks as you type.
  7. Press Enter to perform the search.
  8. Scroll the results list with the track-ball.
  9. Click a desired result to start playing the video.

Author: T.V Raman <raman@google.com>

Using TalkBack With Google Maps

Video: TalkBack And Google Maps

1 Video: TalkBack And Google Maps

Device Used: Motorola Droid On Verizon

TalkBack provides spoken feedback as you use Google Maps. In this video, we will demonstrate typical maps tasks such as:

  1. Launch Google Maps using the Marvin application launcher.
  2. From within the Maps application, press the menu key.
  3. Select Search and type a query into the search field.
  4. Notice that I can type a partial query and have auto-completion based on previous searches.
  5. Press Enter to perform the search.
  6. Bring up the result list in ListView by touching the bottom left of the screen.
  7. Scroll through this list using the D-Pad.
  8. Click with the D-Pad (or enter) to select a business.
  9. Scroll through available options, and click Get Directions.

10.Click the Go button to get directions.

  1. Scroll with the trackball to hear the directions spoken.

In addition, you can also use Google Latitude to locate your friends.

Note that other Map tools such as Google Latitude are accessible from within the set of options that appear when you press the menu key.

Author: T.V Raman <raman@google.com>

TalkBack: An Open Source Android Screenreader

Video: Introducing TalkBack, An Open Source Screenreader

1 Video: Introducing TalkBack, An Open Source Screenreader

Device Used: Motorola Droid On Verizon

We briefly introduced TalkBack in the previous video while enabling Accessibility from the settings menu.Here, we show off some of this screenreader's features.

TalkBack is designed to be a simple, non-obtrusivescreenreader. What this means in practice is that you interactdirectly with your applications, and not withTalkBack. TalkBack's job is to remain in the background andprovide the spoken feedback that you need.

TalkBack works with all of Android's native user interfacecontrols. This means you can configure all aspects of the Androiduser interface with TalkBack providing appropriate spokenfeedback. What is more, you can use most native Androidapplications --- including those downloaded from the AndroidMarket with TalkBack providing spoken feedback.

Here are some examples of Android applications (both from Google as well as third-party applications available onmarket) that work with TalkBack:

  • Google Maps: Perform searches, and listen to directions.
  • YouTube: Search, browse categories and play.
  • Simple Weather: Listen to local weather forecasts.
  • Facebook: Moving around on the social Web.

But in this video, we'll demonstrate the use of a very simple butuseful Android application --- the Android Alarm clock.

  • Launch: I launch the alarm clock from Marvin's eyes-free application launcher.
  • TalkBack: TalkBack takes over and starts speaking.
  • Navigate: Navigating with the trackball speaks the alarmunder focus.
  • Activate: Activating with the trackball produces appropriate feedback.
  • Navigate: Selected alarm displays its settings in a list-view which speaks as we navigate.

Author: T.V Raman <raman@google.com>