Thursday, September 26, 2013

JustSpeak: Control All Aspects Of Android By Voice

JustSpeak: Controlling Android By Voice

1 JustSpeak: Controlling Android By Voice

JustSpeak is an Android Accessibility Service that enables voice control of your Android device. Once enabled, you can activate on-screen controls, launch installed applications, and trigger other commonly used Android actions using spoken commands.

1.1 Starting JustSpeak

Once installed, you can start JustSpeak under Settings->Accessibility on your Android device — you only need to do this once, i.e., JustSpeak will be automatically restarted when you reboot your phone.

JustSpeak is an Accessibility Service i.e., once started, it uses Acessibility APIs on the platform to augment Android's user interface. JustSpeak augments the Android user interface with voice-input control; other Accessibility Services like TalkBack provide spoken feedback. Note that JustSpeak can be used either by itself, or in conjunction with other platform Accessibility Services such as TalkBack.

1.2 Initiating Voice Commands

Once started, JustSpeak registers itself as an Assistant on your device; you can initiate voice commands by swiping up from the bottom of the screen. Note that this is the same gesture that activates Google Now on devices running the stock version of Android. When using JustSpeak, you can get to Google Now by saying Google. Successful invocation of voice-control produces an auditory icon, indicating that your device is ready to listen. The auditory tone, along with an optional vibration (if available) you hear is your cue to start speaking; JustSpeak displays a visual overlay on the right-edge of the screen to indicate that it is listening. the recognized utterance is displayed visually, — additionally, it is spoken out if TalkBack is active. JustSpeak supports two types of voice control commands as described below.

1.3 Global Voice Commands

JustSpeak supports a set of global commands — these are global in that they are available on any screen. Global commands include:

CommandUtteranceAction
OpenOpen <Installed Application>Launch Application
RecentRecentRecent Applications
Quick SettingsQuick SettingsLaunch Quick Settings
Toggle WiFiSwitch WiFi (On/Off)Toggle WiFi
Toggle BluetoothSwitch Bluetooth (On/Off)Toggle Bluetooth
Toggle TetheringSwitch Tethering (On/Off)Toggle Tethering
HomeGo HomeReturn to home screen
BackGo BackReturn to previous screen
NotificationsOpen NotificationsPull down notifications shade
Note that voice commands are flexible in that you can use a number of synonyms for verbs such as open e.g., launch. In addition, voice control commands can be formulated as full sentences, e.g., "Please open GMail".

List Of Synonyms For Open:

  • open
  • go to
  • show
  • display

In addition, JustSpeak provides the following spoken aliases as a means of triggering commonly used applications:

UtteranceAction
BrowserLaunch default Web browser
WebLaunch default Web Browser
OK Google NowLaunch Google Now
SearchLaunch Voice Search
Voice SearchLaunch Voice Search

1.4 Local Voice Commands

In addition to the global voice commands that are available on any screen, JustSpeak lets you activate on-screen controls in a variety of ways.

CommandUtteranceAction
ActivateClick <control name>Activate control by its on-screen name
ToggleTurn on/off <toggle>Toggle on/off switch
ScrollScroll Up/DownScroll e.g., Lists.
List Of Synonym For Activate:
  • touch
  • click on
  • press
  • activate
  • open
  • push
  • tap

1.5 Chaining Commands

Note that you can issue a sequence of commands via a single utterance by using simple connectives such as then or and when speaking; as an example, you can say:

Quick Settings then  WiFi

to open "Quick Settings" and then click the "WiFi" item that appears within quick settings. This is an example of chaining together a global command followed by a local command that becomes available after the global command has executed successfully. Similarly, you can say:

Open GMail, then compose

to launch GMail, and immediately start composing a new message.

1.6 Alternative Means Of Triggering JustSpeak

We are continuing to experiment with alternative ways of initiating voice control. Toward this end, JustSpeak enables you to configure an NFC tag that can then be tapped to initiate voice control; see JustSpeak->Settings for configuring an NFC tag. On Android 4.3 and above, you can also trigger JustSpeak by long-pressing both volume buttons at the same time.

Date: 2013-08-06 Tue

Author: T.V Raman

Org version 7.9.3f with Emacs version 24

Validate XHTML 1.0