|
(11) | EP 0 163 872 A2 |
| (12) | EUROPEAN PATENT APPLICATION |
|
|
|
|
|||||||||||||||||||||||||||
| (54) | Method of correlating on straight lines in an interactive display system |
| (57) A method of correlating on straight lines with a correlation window in an interactive
display including the steps of:
a) defining a correlation window on a display area and dividing the rest of the display area into eight surrounding regions. b) determining which lines stored as coordinates in a display list buffer can be trivially accepted or rejected by computing the configuration of regions in which the end points lie. c) determining for each line not trivially accepted or rejected, on which side of the line one or two selected corner points of the correlation window lie and consequently whether or not it intersects the correlation window. |
[0001] The present invention relates to improvements in methods of correlating on straight lines with a correlation window in an interactive display.
[0002] A common form of interaction with a graphic picture is for an operator to want to identify, to the application with which the operator is interacting, a particular line within the picture. This may be for one of a variety of reasons, for example to move the line in its relation to the other objects, modify or delete the object. A possible method of accomplishing this would be to identify the object by means of a command, e.g., DELETE LINE 23. It is much more natural however for the operator to use a suitable device to actually point to the line. Typical devices are joystick, thumbwheel, trackball, or optical mouse coupled to a cursor in the display screen.
[0003] The immediate result of such a pointing is an (x, y) position on the screen. A correlation operation has then to be carried out to determine which of the lines in the picture actually passes through (or sufficiently close to) that point.
[0004] In order to do this a picture definition (display list) has to be scanned, just as if it were being drawn, but instead of actually drawing the lines defined in the list, they are each inspected to see whether they intersect a small rectangle (for example) drawn around the point of interest.
[0005] It is important that this process occurs quickly. The operator expects a rapid system response to indicate whether or not the pointing was successful. Since the operator has generally only pointed at one line out of the many in the picture, a critical performance factor is how quickly each of the remaining objects can be rejected.
[0006] The Cohen-Sutherland clipping algorithm is described on page 146 Fandamentals of Interactive Computer Graphics' - J D FOley, A Van Dam published by Addison Wesley 1982.
[0007] The Cohen-Sutherland clipping algorithm is designed to identify efficiently those lines that can be trivially accepted or rejected by using region checks. Intersection calculations are required only for those lines for which neither occurs. The algorithm is especially efficient in the two extreme cases of a large window including most of the primitives, or a relatively small window and a large, dense picture in which most primitives lie outside the window; most lines can then be trivially accepted or trivially rejected, respectively.
[0008] The algorithm starts by assigning to each endpoint of a line a four-bit outcode based on nine regions with bit 1 the leftmost bit. The nine regions are the correlation window sorrounded by eight regions, four having a side adjacent the correlation window sides and four diagonal corner regions. Each bit in the out-code is set to 1 (TRUE) if a given relation between the endpoint and window is true:
otherwise the bit is 0 (FALSE).
[0009] one way to calculate the outcode in systems allowing bit manipulation derives from the observation that bit 1 is the sign bit of (ymax - y); bit 2 is the sign bit of (y - ymin); bit 3, (xmax - x); bit 4, (x - xmin). A point is inside the window (outcode 0000) if all these differences are nonnegative. A line can be trivially accepted if both ends are in the window (corresponding to outcodes of 0000). A line is trivially rejected if both endpoints are in a region above, below, to the left, or to the right of the window. This will be the case if the corresponding bits in the outcodes for both endpoints are 1, and this can easily be tested by taking the logical AND of the outcodes and testing for "NOT 0000".
[0010] If the result of the logical and is 0000, the line can be neither trivially rejected nor accepted - it may intersect the window.
[0011] The algorithm has the drawback in that in clipping lines which extend through the correlation window at least two intersections must be calculated. This can be very time consuming in data processing terms.
[0012] U.S.A. Patent 4,412,296 - Smiths Industries Inc. describes a circuit arrangement for determining line conflict in a display.
[0013] The circuit is capable of generating curvilinear as well as linear border segments as produced by a graphics generator. The circuit is capable of generating a multitude of clipping boundaries at different horizontal positions across the CRT screen.
[0014] Positional information is fed from the graphics generator to the circuit so that this input information may address a look-up table to determine whether a conflict exists between certain portions of the symbol to be displayed and an area in which a high priority symbol is to be displayed. If a conflict is determined to exist, the circuit clips the portion of the symbol that would otherwise obscure the high priority information.
[0015] It is an object of the present invention to provide an improved method of correlating on straight lines in an interactive display device whereby the time taken for the processing of the method is shorter than in previous methods resulting in a shorter wait time for the user of the system.
[0016] According to the invention there is provided a method of correlating on straight lines with a correlation window in an interactive display system comprising the steps of:
a) defining a correlation window on a display area and dividing the rest of the display area into eight surrounding regions.
b) determining which lines stored as coordinates in a display list buffer can be trivially accepted or rejected by computing the configuration of regions in which the end points lie.
c) determining for each line not trivially accepted or rejected, on which side of the line one or two selected corner points of the correlation window lie and consequently whether or not it intersects the correlation window.
[0017] According to a second aspect of the invention there is provided an interactive display system comprising a display screen and a control unit including a processor device, a read only memory for storing a control program and a random access store having at least register regions and a display test buffer store, first means under the control of the control program for defining a correlation window on a display area and dividing the rest of the iisplay area into eight surrounding regions,
[0018] second means under the control of the control program for determining which lines stored as coordinates in the display list buffer can be trivially accepted or rejected by computing the configuration of regions in which the end points lie,
[0019] third means under the control of the control program for determining for each line not trivially accepted or rejected, on which side of the line one or two selected corner points of the correlation window lie and consequently whether or not it intersects the correlation window.
[0020] In order that the invention may be fully understood a preferred embodiment will now be described with reference to the accompanying drawings in which:
FIG. 1 diagrammatically shows a division of a display area into nine regions including a correlation window.
FIG. 2 is a flow chart illustrating the steps of the preferred method.
FIG. 3 is a block schematic of an interactive display system.
[0021] The Cohen-Sutherland algorithm referred to above involves performing intersection calculations between the input line and the correlation window. These calculations are performed either by using divide instructions or by using an iterative mid-point subdivision algorithm.
[0022] If the input line is found to intersect the correlation window then a correlate hit has occurred, otherwise no correlate hit has occurred.
[0023] The Method embodying the invention has the following advantages:
(i) No divisions are performed.
(ii) The method is not iterative and operates in a single 'pass'.
(iii) The method utilises the 'side function' of a point with respect to a line. An intersection between a line segment and a semi-infinite ray is detected by computing the side function of the end point of the ray with respect to the line segment.
(iv) The outcodes of the line segment end points are extended to 5-bit outcodes and are used in a novel way to distinguish between various sub-cases which arise in the new algorithm. In particular:-
1. The 'corner to corner sub-case is distinguished from the middle to corner' sub-case by testing the logical OR of the outcodes for equality with 11111000.
2. In the 'middle to corner' sub-case, the direction of the line segment (ordered from start point to end point) is deternined to be clockwise or anticlockwise around the correlation window by shifting one outcode left and computing the logical AND of the result with the other outcode.
[0024] Referring now to Fig. 1, a screen 10 is shown divided into nine areas. A pick window 1 and areas 2-9 surrounding the pick or correlation window. Each area is identified with a 5-bit outcode. The bits within each outcode are indicated as follows:
Thus Area 1 = 00000 (Pick area)
[0025] Using this notation the effect of shifting an outcode left by one bit is to produce, in the first four bits of the code, the outcode of the region which corresponds to the result of rotating the original outcode region 90 degrees anti-clockwise.
[0026] While in Figure 1 the areas are shown to be more or less the same size in reality the pick window can be of the order of ten or fifteen pels square and the other areas taking up a correspondingly larger area so that the centre areas have one short edge (adjacent the pick window) and comparatively larger side adjacent the other areas.
[0027] The preferred method embodying the invention will now be described with reference to the flow chart of Fig. 2 and the interactive display illustrated schematically in Fig. 3. The component parts of the system of Fig. 3 are a display screen 30 connected to a control unit 31. The control unit 31 includes a processor 32 connected through a bus 33 to a read only store 34 a random access store 35, and a display buffer 36. Input/output connections are made to a keyboard 37 and a cursor control device 38 which may be a light pen, an optical moose, a tablet or similar device.
[0028] The processor 32 is controlled by a control program stored in the ROS 34. The RAM 35 contains areas set aside to perform the function of temporary storage registers. In the preferred method ten registers A-J are utilised.
[0029] The control unit 31 also has a connection 39 to a host data processing unit, which send a display list, through a suitable link which defines the contents of a picture to be displayed on the screen 30.
[0030] The display list is stored in the display list buffer 36 in the form of coordinate values for the end points of lines which farm the display.
[0031] A user of the system will wish to indicate a line or area which requires some action to be taken, e.g., deleted from total picture, highlighted, moved etc. The user moves the cursor on the screen through the device 38.
[0032] In a complex picture the cursor will not necessarily come to rest on a particular line and the system must determine which lines are to be selected by the cursor position. A pick window 1 (Fig. 1) is defined around the cursor position. The method described below is then used to correlate the lines of the display with the pic.: window, under control of a control program stored in the ROS 34.
[0035] The outcodes oc of a point (x,y) with respect to the pick window are defined to be an 8-bit byte with bits set as follows:
[0036] Outcode bit 1 is duplicated in bit 5 so that in middle to corner cases it can easily be determined whether the line segment points clockwise or anti-clockwise around the pick window: The outcodes are ordered in an anti-clockwise sequence around the pick window.
[0037] SHIFT LEFT is defined as:
Register I is set with the result of register F OR register G.
Register J is set with the result of register F AND register G.
[0040] If any of the following conditions is true
then the line is accepted as passing through the pick window and Step 2 is entered. Otherwise Step 3 is entered.
[0041] Step 2 Register H is set to '1' indicating a 'hit' for the line being processed and a corresponding flag is set in the display list buffer.
[0042] The coordinates for the next line to be processed are obtained and Step 1 is re-entered. Processing stops when the display list buffer is exhausted.
[0044] If the contents of Register J = 00000000 and the contents of Register I = 11111000 then Step 5 is entered. If the contents of Register J = 00000000 and the contents of Register I do not equal 11111000 then Step 10 is entered.
[0046] Step 4 The line is rejected Register H remains at '0' and a corresponding flag is set in the display list buffer. The coordinates for the next line to be processed are obtained and Step 1 is re-entered. Processing stops when the display list buffer is exhausted.
[0047] Step 5 x and x2 are compared if x1 is greater than x2 then Step 6 is entered. If not then Step 7 is entered.
[0048] Step 6 This step swaps the ends of the line to ensure that xl is less than x2. A simple routine for performing this function uses two work registers in the RAM, T and U, as follows
Continue at Step 7.
[0049] Step 7, 8 and 9 (corner to corner routine) determine whether a line having end points in diagonally opposite corner regions 2 and 9 or 4 and 7 passes between the corner points of the pick window 1 which intersect the other pair of corner regions.
[0050] Step 7 y1 and y2 are compared if y1 is less than y2 then Step 8 is entered if not Step 9 is entered.
[0051] Step 8 If the expression: (NOT Cleft side(x1, y1, x2, y2, xR, yB))) AND (NOT (right side(x1, y1, x2, y2, xL' yT))) is TRUE then Step 2 is entered otherwise Step 4 is entered.
[0052] Step 9 If the expression: (NOT(left side(x1,y1, x2, y2, xL, yB))) AND (NOT (right side (x1, y1, x2, y2, xR, yT))) is TRUE then Step 2 is entered otherwise Step 4 is entered.
[0053] Steps 10, 11, 12 and 13 (middle to corner) determine for a line having one end point in a centre area 3, 5 6 or 8 and its other end point in an area in a different row and column of Figure 1 to the area containing the first end point. Whether the line passes between the corner points of the pick window on the extended diagonal which passes between the areas containing the line end points.
[0054] Step 10 This step ensures that the line from (x1,y1) to (x2, y2) points clockwise around the pick window. This is done by computing a shift left of register F and ANDing the result with register G. If the result of the AND is equal to 00000000, then the ends are swapped as in Step 6 above and the AND of the Shift Left of register F with register G recomputed. The AND is stored in register K.
[0055] Step 11 This step sets a register y with a value of yB or y depending upon the first and fourth bits of Register F.
[0057] Step 12 This step sets a register x with a value xR or xL depending upon the first and second bits of Register F.
[0059] Step 13 If the expression: (NOT(right side(x1,y1, x2, y2, x, y ))) is TRUE then Step 2 is entered otherwise Step 4 is entered.
[0060] The function left side (px, py, qx, qy, rx, ry) is performed by the following routine:
IF(xp-xr)*(yq-yp)>(yp-yr)*(xq-xp) THEN left side = TRUE OTHERWISE left side = FALSE.
[0061] The function right side (px, py, qx, qy, rx, ry) is performed by the following routine:
IF (xp-xr)*(yq-yp)<(yp-yr)*(xq-xp) THEN right side = TRUE OTHERWISE right side = FALSE.
[0062] The method described above can be implemented in either hardware or software. In an interactive display system such as illustrated in FIG. 3, the processor 32 performs the method under the control of a central program formed in the read only store 34. In other embodiments the control program may reside on a diskette and read into a portion of the random access store 35 when required.
[0063] In a display control unit such as illustrated at 31 a general control program residing in ROS 34 controls the position of the cursor on the screen 30 in response to input from devices 38 or 37 and defines the correlation or pick window in response to commands received from the Keyboard 37. The processor 32 under control of the control program performs the process for correlating the lines with the pick window. Thus in the following claims both the first, second and third means operating under control of the control program may be the processor 32, parts thereof or the processor in combination with the registers of the random access store 35.
a) defining a correlation window on a display area and dividing the rest of the display area into eight surrounding regions.
b) determining which lines stored as coordinates in a display list buffer can be trivially accepted or rejected by computing the configuration of regions in which the end points lie.
c) determining for each line not trivially accepted or rejected, on which side of the line one or two selected corner points of the correlation window lie and consequently whether or not it intersects the correlation window.
first means under the control of the control program for defining a correlation window on a display area the rest of the display area into eight surrounding regions,
second means under the control of the control program for determining which lines stored as coordinates in the display list buffer can be trivially accepted or rejected by camparing the regions in which the end points lie,
third means under the control of the control program for determining for each line not trivially accepted or rejected, on which side of the line one or two selected corner points of the correlation window lie and consequently whether or not it intersects the correlation window.