Reading the Screen Using the Mouse Pointer Read the Screen Using the Mouse Pointer: With Window Eyes, not only can you read relative to the cursor, but you can view the entire screen. Since you have little control over the application cursor, you are limited to what you can review. In your document of your word processor, this works great. But if you want to review sections of your word processor, like the status line or toolbars, your cursor can’t go there. So Window Eyes allows you to view the screen with your mouse pointer. The mouse pointer is free to move about the entire screen. But to make things easier, Window Eyes allows you to set a boundary, so as to not get lost outside of that boundary. To show how you use the mouse to review the screen, I’m going to start up Wordpad again. Actually, we are still in Wordpad from the previous session, and I have Wordpad running with Section 1 of the Window Eyes manual. We already know how to read the current character, word, line, etc. relative to the cursor, but let’s show you how to read it relative to the mouse. I’m going to press control-home to go back to the beginning of the document. WE: Beginning of document, 1 Introducing Window Eyes It takes me to the first line of the document. Let me go ahead and route the mouse pointer to the current position. Press insert-numpad +. WE: Pointer route to cursor. So now we have actually moved the mouse to the current cursor position. We talked about how the mouse can read relative to certain boundaries. Those boundaries are the focus window, application window, full screen, or read relative to the user window. We will not talk about the user window option, though. Let me show you what the key press is for this first. If I hold control and shift down, and press “b,” that is the mouse boundary hotkey. Press that now to make it rotor through the options. WE: Focus window Focus window. I still have my control and shift keys held down, so I can just tap the “b” key to keep rotoring through these options. WE: User window User window. Tap “b” again. WE: Full screen. Full screen. Tap “b” again. WE: Active window. Active window. WE: Focus window. It just goes around in a circle. Go through these options again and leave it set to active window. Let’s go ahead and discuss what we mean by focus window and active window. Remember that when a window is up, and the Window Eyes control panel pops up, that window is the active window. When the dialog boxes come up, that dialog was the active window. It is the foreground window. It is the piece of paper that is on top of my desk that draws visual attention to whoever is sitting there using it. Same with on the computer. It is the window on the top that has the keyboard’s attention. Now within the active window, you can actually have an element that has focus. By focus, I mean it actually has the keyboard’s attention. So if I am within my dialog, which has activation, I could be tabbing between all of the controls, and whatever control is currently focused, has the keyboard attention. So if I’m tabbing between buttons, the button would have focus and the dialog would have activation. Inside Wordpad here, Wordpad is the active window, but because I am in the document area, that edit box is the focused control within Wordpad. If I set my mouse boundary to focused, it would bound the mouse into the document area. That is what currently has focus. If I set it to application window, it would bound it to Wordpad. It would not let me get out of the Wordpad window. If I set it to full screen, then I can use it to search the entire screen. So I have kept it to application window, which will allow me to go outside of my document area and be able to read the title bar and things like that, but it won’t let me go out and see the start menu or things outside of the window. That would require me setting the boundary to full screen. In my case, I have set it to the active window. I have synched the mouse already to the cursor position. Remember when reading relative to the cursor we used the control key to think of it as reading relative to the cursor. Well, with the mouse pointer, if you want to be able to move it around and read information, you can just use the numeric keypad without the control key, but think of the arrow keys, you can use them to move the mouse pointer left and right one character. So if I hit the right arrow key on the numeric keypad, with the num lock off, I hear: WE: Colon, space, I, n, t, r, o, d, u, c... So I am just going letter by letter relative to the mouse pointer. It is actually moving to the next character. Now if I press control-numpad left arrow to hear the character that is currently under the cursor, it will say…. WE: 1 It says this because the cursor has not moved, just the mouse pointer. But when I press the numpad right arrow, it moves the mouse pointer to the right by one character. Press the right arrow repeatedly. WE: I, n, g, space, W So I am just using the numpad to move left and right by one character. WE: Space, g, n, i I’m just going backwards there by one character at a time. This is very similar to Word, in that if I hold down the insert key while doing this, it acts as a modifier. So if I hold down the insert key on the numeric keypad, and press the left or right arrow, it will move the mouse pointer one word to the left or right, and will speak that word. Go ahead and hold down the insert key and tap the right arrow. WE: Window Eyes, This, section, of And if I press the left arrow, it will go backwards. WE: of, section, this So, left and right moves by character, while insert-left and right moves by word. If I want to go by line, you would use the up and down arrow keys. Press the down arrow key. WE: bolts of the Window Eyes package Down again. WE: our technical support department Down again. WE: works best with Window Eyes. Up arrow now. WE: our technical support department… So I am sitting on that line with the mouse pointer. I could read the line under the cursor with control-numpad 5… WE: 1. Introducing Window Eyes. It hasn’t moved at all. I’m only moving the mouse pointer. If I want to move by sentence, I could just use the end, down arrow, and page down keys, which are numbers 1, 2, and 3 on the numeric keypad. I can just press insert with those keys, and it will read the previous sentence, current sentence, and next sentence and the mouse pointer will actually move. Press insert-page down. WE: Section 1.1 Welcome to Window Eyes Section 1.2 System Requirements Section 1.3…(silenced) Now it is reading all of those because there is no terminating punctuation. So it thinks that all of those lines are one big sentence. Again, it requires a sentence to be ended with a period and then two spaces. If I want to go to prior, current, or next paragraph, I would use the same keys that I used for the sentence, only I would hold the control key down this time. So if I held down control-insert-page down, it would go to the next paragraph. Go ahead and do that. WE: 1.1 Welcome to Window Eyes . Again. WE: Congratulations on your purchase of Window Eyes, a screen reading program….(silenced) That actually moves me by paragraph and allows me to review things that way. One of the nice things that is unique to Window Eyes is that we have the ability to move by what we call clips. Let me explain what a clip is. When you are reviewing with the mouse pointer or the cursor, it is nice to go by character, word, line, etc. But with Windows, things become a little more complicated, because you can have a line of text, and maybe within that line you have multiple font changes, size changes, graphics, etc. It is nice to know that these things are happening in there. So we came up with a term at GW Micro called a clip. A clip is a graphic element. So whenever you see a graphic on the screen, whether it be an icon or a picture of something, that is a clip. So if I am moving by clip, and all there are are graphics on the screen, then each graphic image would be a clip. So, graphic is pretty easy to explain as a clip. Text is a little bit more complicated. Text is considered a clip if it is text of the same attributes and is continuous text. If you have the word “this” and then way over on the right you put “there,” but there are no spaces between these words, then those are two clips. These are clips because they are continuous text but are not spaced together. Now if I have a line in my word processor, and let’s say that the middle word is bolded, then I would have three clips in my line. There would be the left clip, the bolded word, and then the right clip. The top three keys on the numeric keypad, 7, 8, and 9, are used to move by clip. Use the insert key to do this. Hold down the insert key and tap the 9 key to go forward one clip. WE: Program which allows access to Microsoft Windows and compatible Again. WE: applications through synthesized speech and refreshable Braille. What it is doing now is just going by line. If there were attribute changes within this, then it would actually break that up. Let me go ahead and go into this line. Let me route my cursor to the mouse pointer. The cursor is still on the first line of the document. But let’s say that I found something interesting with my mouse pointer, I don’t want to have to move way down the page to get my cursor there, I can just press the numpad + sign by itself. Remember, when we did an insert-+, it took the mouse pointer and put it at the position of the cursor. If I do not use the insert key, it will do the reverse of that, and move the cursor to where my mouse pointer is. Go ahead and press the numpad + key. WE: Cursor routed Now my cursor and my mouse pointer are back at the same spot. Let me just move my mouse pointer over some, using control-right arrow to move by word. WE: through, synthesized Let me go ahead and select this word using control-shift-right arrow. WE: Synthesized, selected And now I want to bold this word by pressing control-b WE: b Now, let me get rid of that highlight, and move back by clip, so press insert-numpad7 to go back by clip. WE: Program which allow access to Microsoft Windows and compatible We didn’t touch that line. Now let’s go to the right one clip. Previously, it read the whole line. Let’s see what we get. WE: Applications through It stopped. It said, “applications through.” If I press that keystroke again, I get… WE: synthesized That is the bolded word. Press insert-numpad 9 again. WE: speech output and refreshable Braille. So those are the three clips on that line. Now if I were moving down by line, then it would have just read the entire line and I would not have known about the clips. Again, if there is a graphic in there, I would get that as well. Moving by clips is a great way to be able to navigate around. Let me move my cursor up to the top with control home. WE: Beginning of document…. Now go ahead and press insert-+ to get the mouse pointer there as well. WE: Pointer route to cursor. Now let me go back by clip from here. My cursor can’t go any further up, because it is at the top already. My mouse pointer can though, because I set the boundary to application. Press insert-numpad 7 now. WE: Graphic There is a graphic there. Press it again. WE: Graphic, date/time There is another graphic. Press it again. WE: Graphic, undo Now we are reading the tooltip options as we move. Again. WE: Graphic, find Again. WE: Graphic, print preview These are tooltips that are popping up as I move to the graphic, because typically when a sighted user takes the mouse and they hover over one of these icons, that tooltip will pop up. There is a visual indication of what they are and we could label this graphic if we chose to. Press insert – numpad 7. WE: Graphic, Print Again. WE: Graphic, save Again. WE: Graphic, open Again. WE: Graphic, new Again. WE: Graphic, paste Again. WE: Graphic, copy Again. WE: Graphic, cut Again. WE: Help h pull down Here is the help menu. We just found the help text up there in the help menu. Again. WE: Format, o pull down Again. WE: Insert, I pull down Again. WE: View, v pull down Again. WE: Edit, e pull down Again. WE: File, f pull down Again. WE: Graphic There is the close button of this particular window. Again. WE: Graphic That is the restore button. Again. WE: Graphic That is the minimize button. Again. WE: Section 1 Introducing Window Eyes, WordPad That is the title bar. Again WE: Graphic That is the icon of WordPad. Again. WE: (dings) And we cannot go anywhere now. We are at the top left of this application window and not allowed to go any further. So we are getting a “ding.” Moving by clip is very important to deal with that. We also give you the ability of using the mouse sort of like an Etch-a-Sketch, where you can move it straight across, left, right, up, or down. You can do that by holding down control and shift, and pressing the four arrow keys on the numeric keypad. Control-shift-down (2) will move me down a certain amount of pixels. Press that four more times. Now press control-shift-right (6). WE: File, f pull down I happen to land on “file” then. Again, I am just moving the mouse pointer, and I can see it coming down a certain number of pixels each time. You can define how many pixels that you move each time. The default is either 5 or 8 pixels. If you would move by one pixel, it would take a while to move since there are so many pixels on the screen. We talked about routing the cursor to the mouse pointer. You can also “click” some things as well. Once the mouse pointer is where you want it to be, you can use the numeric keypad. The “/” key does a left click. So I am sitting on file now, if I hit slash, it will do a left click. Let me do that. WE: Left It actually opened up the file menu, so we can now down arrow. WE: New, n contol, n dialog Down arrow again. WE: Open, o control, o dialog So that is another way to open it up. If you have a menu that is not keyboard accessible, and you have to get the mouse on it, you can find it that way. You can do a left click, and you are all set to go. Pressing the * key on the numeric keypad will do a right-click for you. If you need to do something that required a right-click, you could put the mouse where you wanted and press the * key. I’m going to press escape to get out of this menu. WE: Menu closed. File, f pull down Another thing that you can do with the mouse pointer is the “mouse find” ability. If you press control-shift-f, which is a Window Eyes command… WE: Menu closed. Find n, combo edit box, dialog find It brings up our “find” dialog and it is going to allow you to find information quickly and move the mouse pointer to it. So let’s say that I want to find “congratulations.” That is one of the text lines in the document. Go ahead and type in the word. WE: congratulations Now by default, this dialog has other radio button options that we can deal with that actually override the mouse boundaries. Let me tab once. WE: Match case, m checkbox unchecked If we wanted the search to be case sensitive, we could check this checkbox and it would find congratulations only if it was in lower case. I’m going to leave this unchecked and tab again. WE: Search full screen, l radio button unchecked, 1 of 4 Here it brings us to the “search” radio buttons. There are 4 radio buttons. There is full screen, active window, focused window, and user window. Usually when you are doing a search, you would want it to be for the active window. By default, we choose active window to be selected. We just felt that was more accurate for what you were trying to search for. If that is not the case, you can come down here and simply select another option. Tab again. WE: Search, active window… Tab again. WE: Search, focused window… Tab again. WE: Search, user window… Tab again. WE: Attributes bold, b checkbox unchecked So here we have the bold checkbox, so if we wanted to only find congratulations if the text was bolded, we could check this. There are also settings for italics, underline, strikethrough, and a highlight. So we could set it if it had to be all of these conditions for us to find it. But again, I’m going to quickly tab past all of these options. WE: Forward find, f button If I hit enter here, it would actually do a forward find. Tab again. WE: Reverse find, r button This does a reverse find. The default is forward find, so I’m going to so a shift-tab once to get back there. WE: Forward find, f button Press enter on this. WE: Found, Congratulations on your purchase of Window Eyes, a screen reading, rich text window, 1 Introducing Window Eyes….(silenced) This put the mouse pointer right on the line that had “congratulations,” and the mouse pointer is sitting right at the “c.” I could verify that by just moving left and right. Press your right and left arrow. WE: o, c I could read the current word if I wanted to, or move by word. Now the mouse search is limited to what is visible on the screen. So if you are searching for something that is not on the screen, it will not find it. We also have a continuous search that will look for the next occurrence of congratulations, which I doubt is actually there. I can press insert-f. I am holding down the insert key while num lock is off, and tapping the letter “f.” WE: Not found. In my case, it wasn’t found, so it said, “Not found.” Otherwise, it would have found the next occurrence and gone in the direction that I last went in. If I was doing a reverse find, insert-f would have gone backwards. So you will find, especially for applications that don’t give you good keyboarding accessibility, that the extensive mouse manipulation is excellent. Again, set the mouse boundary the way that you want it, and once you have the boundary the way that you want it, you can move by character, word, line, sentence, paragraph, or clip. You can find text quickly to get around to that. Hopefully this gives you a good understanding of a navigation of the mouse. Let’s go on to the next section.