PatentView/EP249293

Title

Processor-based data and/or graphics display apparatus.

Title - german

Title - french

EP Status

Granted. Appealed, patent maintained

Applicant

Philips electronics uk ltd (GB); philips nv (NL)

Inventors

Clark, David George (GB)

ECLA

G06F3/033A1M

IPC

G06F3/033

Priority

GB19860014106 19860610

Designated countries

DE, FR, GB, IT, SE

Domains

Menu, UserInterface

Equivalents

JP62290924-A, GB2191665-A, EP249293-A3, EP249293-B2, EP249293-B1

Filing date

1987-06-05

Publish date

1987-12-16

Grant Date

1994-02-23

Publication no.

ep249293

Application no.

EP19870201082 19870605

[[patent( Description of <strong>EP0249293</strong><br/> <br/> <br/> PROCESSOR-BASED DATA AND/OR GRAPHICS DISPLAY APPARATUS <br/> <br/> This invention relates to a digitally operable data and/or graphics display apparatus of a type for displaying on the screen of a CRT (cathode ray tube) or other display device an image which is composed of discrete pixels and is represented by a quantity of data stored in a display memory, the apparatus including processor means for selecting under user interface control the data which is to be stored in the display memory to produce any particular image. <br/> <br/> In display apparatus of the above type, the data stored in the display memory can be in so-called "bit-map" form comprising at least one information bit in respect of each of the pixels of a displayed image. Alternatively, this stored data can be in so-called "character-based" form. For this alternative, there is stored in a character memory of the apparatus a font of standard character shapes composed of information bits and the data, representing an image for display, stored in the display memory comprises digital codes which identify selected character shapes whose information bits are used to define the pixel content for the image in discrete display areas, composed of pixel matrices, instead of defining individual pixels.When a raster scan display device is used, the data stored in the display memory is accessed repeatedly to update the displayed image in a recurrent cycle of scanning lines which may be produced with or without interlaced field scanning. <br/> <br/> A display apparatus of the above type may be provided with a background memory containing a large amount of data from which any item can be selected for display under user control. Additionally or alternatively, the display apparatus may be adapted to establish selective connection to external data sources to obtain thereform items of data for display. <br/> <br/> This selective access to large amounts of data gives rise to the related problems of visually informing a user by means of the display device what data is available for selective display, and of making the data selection control of the display apparatus "user friendly" so that a user can readily find and select for display any item of data which is available. <br/> <br/> A widely used control technique is to identify the items of data which are for selection in a list, known as a menu, which is displayed on the display device. Menus may be 1-dimensional linear lists, or 2-dimensional (possibly nested) arrays of areas. The actual selection process can be effected by means of a suitable x-y position user interface device such as a mouse or a writing tablet and pen. However, a problem with traditional menus is how to present all the items for selection when there are more data choices than can be displayed simultaneously. <br/> <br/> One known solution to this problem is to organise the menu as a tree-structured hierarchy with two or more levels. However, finding an item by navigating up and down the tree can be tedious, particularly when there are a large number of different levels. <br/> <br/> Another known solution to this problem is to use a so-called pull-down (or pull-up) menu. This comprises a main menu of items which are permanently displayed along the top (or bottom) of the screen of the display device. When any one of these main items is selected, a sub-menu of items for that main item is displayed vertically beneath (or above it). Any item on the sub-menu can then be selected. The selected item on the main menu and also that on the sub-menu are highlighted (e.g. by luminance inversion). If a user cannot remember where a particular item to be selected is located in the menu, the whole menu can be scanned through rapidly simply by selecting each item of the main menu in turn and observing the resulting sub-menu which is displayed. Further levels of selection can be provided by means of "dialogue boxes" which are presented when an item on a sub-menu is selected. <br/> <br/> Although the pull-down type of menu has obvious advantages over the tree-structured menu, it also suffers from the following disadvantages. The main menu of items occupies permanent space on the screen of the display device, which is undesirable particularly if the screen resolution is low and/or any display is highly data intensive, such as in a word processor mode when it is desirable to be able to use as much of the screen for text as possible. Also, each sub-menu, and also any subsequent dialogue box, is displayed at a fixed position on the screen, and cannot be invoked at a desired position, for instance, so as not in effect to conceal information displayed beneath it. <br/> <br/> Furthermore, a relatively large amount of hand movement is required by a user when manipulating the user interface device to reach and scan the main menu and the sub-menus. <br/> <br/> Prior European patent specification 0 159 400 discloses a menu display technique which overcomes the first of the aforementioned disadvantages of having a menu occupy permanent space on the screen of a display device. This menu display technique relates to a display screen having at least one display window having lesser dimensions than the display screen and displaying subject matter different from that displayed on the remainder of the screen, and involves providing a virtual menu which comprises a plurality of items which are respectively distributed about the periphery of the window and which are not displayed in normal operations. These menu items are displayed selectively under user control by moving a cursor across selected regions in the periphery of the window.The menu items are respectively associated with the peripheral regions and therefore neither of the aforementioned second and third disadvantages are overcome by this known menu display technique because the menu items are at fixed positions and movement of the cursor from one region to another to make a change in menu selection can involve extensive hand movement. <br/> <br/> It is an object of the present invention to provide a menu display technique which overcomes all of the three disadvantages as detailed above. <br/> <br/> According to the present invention a digitally operable interactive display apparatus comprises:<br/>

• - processor means for controlling the operation of the apparatus;<br/> - a display memory for storing picture data to be displayed on a display screen of said apparatus;<br/> - menu generating means for generating a menu of items to be displayed on said display screen;<br/> - a user interface device including: :<br/> - position determining means which are operable to generate address signals for addressing respective locations in said display memory which locations correspond to respective positions indicated by a user on said display screen;<br/> - selection means for selecting data which is to be stored in the display memory;<br/> which apparatus is characterised in that said user interface device has associated with it a menu switch which is coupled with said menu generating means and said position determining means and which is provided for generating upon activation a control signal under control of which said menu generating means is enabled to load said menu into said display memory at a location being addressed by said address signals and corresponding to the position currently being indicated by said position determining means. <br/>

<br/> The displayed menu may be termed a "pop-out" menu, because until invoked by the menu switch it does not appear on the display screen. Conveniently the menu is subsequently removed from the display screen by the processor means in response to a subsequent operation of the menu switch. <br/> <br/> In carrying the invention into effect, the menu switch is preferably located either on a hand-manipulated part of the user interface device, or very close to it, so that it can be operated with maximum ease, preferably by the same hand that is manipulating the user interface device. For example, it can be a second button actuated switch on a mouse or a sideswitch on a pen. <br/> <br/> It is to be appreciated that the menu switch is additional to a select switch which conventionally is also provided on a user interface device for 'point and select' operations such as are used with pull-down menus. <br/> <br/> In further considering the nature of the invention, reference will now be made by way of example to the accompanying drawings, of which:- <br/>

• Figure 1 shows a block diagram which represents various logic and functional elements of a processor-controlled data and/or graphics display apparatus in which the present invention can be embodied; <br/> Figures 2 to 5 illustrate respective menu displays; and <br/> Figure 6 shows a flow chart which illustrates the menu selection program. <br/>

<br/> Referring to the drawings, the display apparatus is shown in Figure 1 as having, a display device 1 which is suitably a CRT monitor. The display device 1 receives video signals from a display section 2 which is assumed to include a display memory and a video signal generator in which digital-to-analogue conversion of digital data stored in the display memory is carried out to produce the video signals for driving the display device 1. The display memory is filled with data from a background memory 3 as selected by a processor control function 4. The processor is also shown as having a menu generator function 5 and a position detector function 6. <br/> <br/> User control of the display apparatus is by means of an x-y position user interface device 7 which is, for example, a mouse or a writing tablet and pen. This interface device 7 is operable to generate x, y signals which represent any selected position on the screen of the display device 1. These x, y signals are detected by the position detector function 6 and passed to the control function 4 which is responsive to cause the display section 2 to display on the screen of the display device 1 a pointer 10 which identifies the selected position on the display. The user interface device 7 has a menu switch 8 and a select switch 9. When the menu switch 8 is operated, it produces a "menu-display" command signal to which the control function 4 is responsive to cause the menu generator function 5 to be performed.This results in menu data being entered into the display memory of the display section 2 for displaying the menu 11 on the screen of the display device 1 at the position identified by the pointer 10. <br/> <br/> Once the menu is displayed, the individual items listed thereon can be selected by the pointer 10 and then expanded into sub-menus by actuation of the select switch 9. <br/> <br/> The following describes one possible menu implementation in accordance with the invention. Variations are of course possible, though the implementation described is believed to be fairly optimal. The pop-out menu consists of a main menu displayed vertically, with a sub-menu displayed beside it (to the right of the main menu), also vertically. This display is illustrated in Figure 2. As mentioned above, the pop-out menu is invoked by activating the menu switch 8, which is reserved for that purpose. The only other use of this switch is to remove the menu when a user has finished with it. <br/> <br/> The menu switch 8 should be positioned either on the x-y position device 7, or very close to it, so that it can be operated with maximum ease, preferably by the hand manipulating the device. For example, it can be a second button on a mouse or a sideswitch on a pen. However, it is distinguished from the select switch 9. The pop-out menu 11 is displayed at the position of the pointer 10 when invoked, or as close to that position as possible while retaining the menu entirely on the screen. It is positioned so that the pointer 10 is as close as possible to the menu item that is most likely to be selected - typically this would be designed to be the first item in the list. To reposition the pop-out menu 11, it is only necessary to point to the new position and press the menu switch 8 twice. This will cause the menu to be erased and then re-displayed in the new position. <br/> <br/> Any dialogue box resulting from sub-menu selection is displayed at the position of the pop-out menu. This allows the box to be positioned where the user requires, without hiding other information. This is particularly useful if the dialogue box allows pointing to other items on the screen as part of its dialogue process. The pop-out menu thus takes up no permanent space on the screen, but is only there when required. Although one more switch operation is required than for the pull-down menu, far less hand movement is needed. The menu is positioned at the current pointer position, activation of the menu switch replacing movement of the pointer to the top of the screen. In addition the menu is more compact and so less movement is needed within the menu itself. <br/> <br/>

• The basic menu selection is a two stage 'point and select' process. The desired category of commands is selected from the main menu, resulting in the highlighting of the main menu item chosen, and the display of its associated sub-menu. The command itself is then selected from the sub-menu. Before selecting from the sub-menu, the user may change his mind and select a new item from the main menu, repeating this process until he has the sub-menu he requires. When the main menu is invoked, one of the main menu items is 'pre-selected' and highlighted accordingly, and the corresponding sub-menu is displayed. The pre-selected item is the one most likely to be selected (e.g. the first in the list as shown in Figure 2). Pre-selection allows the most used commands to be chosen with a single selection from the initial sub-menu.If the user is unsure in which sub-menu the command he requires is located, he may scan through them by moving the pointer 10 through the main menu items with the select switch activated (held down), and releasing this switch when the required sub-menu is found. The highlighting follows the currently selected main item. If the select switch 9 is released with the pointer 10 outside the menu 11, the main item last pointed to remains selected. Similarly, the select switch 9 may be activated with the pointer 10 in the sub-menu, and the items scanned through, with associated highlighting, before releasing over the required item. If the switch 9 is released with the pointer 10 outside the sub-menu no item is selected. Combining these two processes allows commands to be chosen in a single step if the user wishes, exactly as with a pull-down menu.The select switch 9 is activated and the main menu is scanned, then when the required sub-menu is found the pointer 10 is moved into it (horizontally, to avoid selecting a new main item), moved to the required sub-menu item and the select switch 9 is released. While in the sub-menu, the pointer 10 may be moved back to the main menu, with the select switch 9 still activated, and the main menu may be scanned again to find the required sub-menu. <br/>

<br/> The operation of the apparatus shown in Figure 1 for the menu selection program is illustrated in the flow chart shown in Figure 6. The different program steps of the flow chart are explained below. <br/>

• (20) STR:<br/>

  • The program is entered into when the menu switch 8 is operated. <br/>

  (21) F-POS:<br/>

  • By means of the processor position detector function 6 the position XY indicated by the pointer 10 on the display device 1 is found. <br/>

  (22) F-MN:<br/>

  • The processor menu generator function is activated in order to generate the main menu. <br/>

  (23) S-MN:<br/>

  • The main menu which is generated is stored in the display memory of the display section at a location corresponding to the position XY on the display field. <br/>

  (24) DSP:<br/>

  • Under control of the processor 4 the content of the display memory is displayed. <br/>

  (25) CRS?::<br/>

  • This is a check for verifying if the pointer 10 has been removed from position XY, for example for indicating a main item at a position X'Y' in the main menu. This check is for example realised by comparing the actual coordinates x'y' of the pointer with the coordinates x, y. <br/>

  (26) F-POS:<br/>

  • By means of the processor position detector function 6 the new position X'Y' indicated by the pointer 10 on the display device 1 is found. <br/>

  (27) R-MI:<br/>

  • The main item indicated at position X'Y' is recognised. <br/>

  (28) AD-SM:<br/>

  • The sub-menu corresponding to the indicated main item is fetched from the background memory or generated by the processor menu generator functions. <br/>

  (29) S-SM:<br/>

  • The sub-menu concerned is stored in the display memory at a location corresponding to the position X'Y' the display field. <br/>

  30) DSP::<br/>

  • Under control of the processor 4 the content of the display memory is displayed. <br/>

  (31) M-CM?<br/>

  • This is a check for verifying if the menu switch 8 has been operated again in order to erase the displayed menu. <br/>

  (32) SM-SEL?:<br/>

  • This is a check for verifying if the select switch 9 has been activated in order to formulate the selection of a sub-item of the sub-menu. <br/>

  (33) EX-IT:<br/>

  • This is a sub-routine for performing the selected sub-item. <br/>

  (34) ERS:<br/>

  • In the case that the menu switch 8 has been operated again in step (31) the displayed menu is erased. <br/>

  (35) EMP?:<br/>

  • This is a check for verifying if the pointer 10 indicates a position not located within the displayed menu. <br/>

  (36) STP:<br/>

  • This is to exit the program. <br/>

<br/> A number of considerations related to presentation of the pop-out menu are discussed below.<br/>

• - Positioning of sub-menus: A sub-menu should be positioned so that its most used items are as close as possible to its corresponding main menu item, for minimum pointer movement. If items are ordered with the most likely ones at the top, the top of a sub-menu should be in line with its parent main menu item. It may be necessary to deviate from this ideal position to keep the sub-menu entirely on the screen. Alternatively, the main menu position can be restricted such that all sub-menus can be displayed on the screen in their ideal positions.<br/> - Differentiation of sub-menus from main menu: In order to make it clear which is the main menu and which is the sub-menu, some visual indication should be given that the sub-menu is derived from the currently selected item in the main menu.However, it should still be clear that the user may select from either menu. The indication may be (e.g.) in the form of a bracket (see Figure 2).<br/> - Delinearation and grouping of items: Some indication of the limits of the selection area for each item should be given. Also, like items should be grouped and the group boundaries marked. This can be done by (e.g.) placing a light or dotted line between items, and a heavy or continuous line between groups.<br/> - Highlighting of items: Currently selected items should be highlighted. This can be done (e.g.) by luminance inversion of the whole item selection area.<br/> - Inactive items: In any system there will be contexts in which certain items on a menu are not available. Instead of removing such items from the list, it is recommended that they are marked as inactive. This may be done by (e.g.) displaying them with reduced luminance or by crossing them out.<br/> - Indication of selection: As the menu disappears when a sub-menu item is selected, some visual verification should be given that the correct item has been selected. This may be (e.g.) to flash the item for a short time. <br/>

<br/> A pop-out menu in accordance with the invention is particularly useful where screen space is limited, either for data intensive applications or for screens of low resolution. Where there is room to put some control items permanently on the screen these should be the ones most likely to be used. Less used options should be placed in the pop-out menu. <br/> <br/> The basic form of the pop-out menu as described so far may be extended by including other forms of selection mechanism at the second level as well as simple linear sub-menus. Some examples are described below. <br/> <br/> Instead of being presented as a linear list, the items in the sub-menu may be arranged in a two dimensional array as shown in Figure 3. This is particularly suitable for pictorial display of items rather than description in words. Operation of the two-dimensional sub-menu is identical to that of the linear sub-menu. <br/> <br/> The need frequently arises to select more than one item from a sub-menu (e.g. the items may be text attributes in a word processor). This is slow if the menu has to be called up each time. The multiple-selection menu as shown in Figure 4 allows more than one item to be selected from the sub-menu. Each item may be ticked, or un-ticked if it is already ticked, and when the desired combination has been reached an 'OK button' is selected. As certain combinations of items may not be allowed, each item has associated with it a set of items which must be selected or deselected when the item itself is selected/deselected. At any stage a new sub-menu may be selected from the main menu, or the entire menu cancelled with the menu switch 8. <br/> <br/> A common method of scrolling in a graphical control environment is by a scroll bar containing scroll arrow buttons and an 'elevator'. This is displayed permanently along the side of the screen or, in a windowing system, the active window. For two dimensional scroll two such scroll bars are displayed, one vertical and one horizontal. Such scroll bars use up permanent space on the screen, and also require much hand movement, particularly between widely spaced arrow buttons. A scroll bar can be included as a sub-menu in a pop-out menu as shown in Figure 5. The scroll bar illustrated is for two-dimensional scroll. For vertical scroll only it is much simpler. When a selection is made in the scroll bar, the main menu is removed and the scrolling action is carried out. The scroll bar remains, for further scrolling actions until it is cancelled by activating the menu switch.As the scroll bar may be on top of the area to be scrolled, it may need to be rewritten during scrolling. <br/> <br/> It will be apparent to a person skilled in the art that the inventive principle herein defined can be readily performed, using conventional software procedures to enter menu data as required into the display memory in response to select and command signals from the user interface device. Therefore, it is considered unnecessary to burden the present disclosure with details of these software procedures by means of further high level flow charts which, in essence, would only re-iterate the narrative description already given. <br/> <br/> From reading the present disclosure, other modifications will be apparent to persons skilled in the art. Such modifications may involve other features which are already known per se and which may be used instead of or in addition to features already described herein. Although claims have been formulated in this application to particular combinations of features, it should be understood that the scope of the disclosure of the present application also includes any novel feature or any novel combination of features disclosed herein either explicitly or implicitly or any generalisation or modification thereof which would be apparent to persons skilled in the art, whether or not it relates to the same invention as presently claimed in any claim and whether or not it mitigates any or all of the same technical problems as does the present invention. The applicants hereby reserve the right to formulate new claims to such features and/or combinations of such features during the prosecution of the present application or of any further application derived thereform. )]]

[[patent( Claims of <strong>EP0249293</strong><br/> <br/> <br/> 1. A digitally operable interactive display apparatus, comprising<br/>

• - processor means for controlling the operation of the apparatus;<br/> - a display memory for storing picture data to be displayed on a display screen of said apparatus;<br/> - menu generating means for generating a menu of items to be displayed on said display screen;<br/> - a user interface device including::<br/> - position determining means which are operable to generate address signals for addressing respective locations in said display memory which locations correspond to respective positions indicated by a user on said display screen;<br/> - selection means for selecting data which is to be stored in the display memory;<br/> characterised in that said user interface device has associated with it a menu switch which is coupled with said menu generating means and said position determining means and which is provided for generating upon activation a control signal under control of which said menu generating means is enabled to load signal menu into said display memory at a location being addressed by said address signals and corresponding to the position currently being indicated by said position determining means. <br/>

<br/> 2.A display apparatus as claimed in Claim 1, characterised in that the menu is subsequently removed from the display screen in response to a subsequent operation of the menu switch. <br/> <br/> 3. A display apparatus as claimed in Claim 1 or claim 2, wherein said position determining means are further operable for identifying visually on the display screen by means of a movable pointer a selected position determining means are further operable for identifying visually on the display screen by means of a movable pointer a selected position as signified by said address signals, characterised in that said user interface device is further operable for identifying any item of the displayed menu by means of said pointer and includes a select switch which is provided for generating upon activation a further control signal under control of which said menu generating means is enabled to generate a sub-menu appertaining to said identified item and to cause said sub-menu to be entered into the display memory for display on the display screen at a position adjacent to said identified item. <br/> <br/> 4. A display apparatus as claimed in Claim 3, characterised that said menu switch and said select switch are located on or adjacent a hand-manipulated part of the user interface device. )]]