(19)
(11)EP 2 673 058 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
01.04.2020 Bulletin 2020/14

(21)Application number: 12744498.2

(22)Date of filing:  09.02.2012
(51)International Patent Classification (IPC): 
A63B 69/36(2006.01)
A63B 67/02(2006.01)
G09B 19/00(2006.01)
A63F 13/20(2014.01)
A63B 69/00(2006.01)
(86)International application number:
PCT/KR2012/000954
(87)International publication number:
WO 2012/108699 (16.08.2012 Gazette  2012/33)

(54)

VIRTUAL GOLF SIMULATION APPARATUS AND METHOD

VIRTUELLE GOLFSIMULATIONSVORRICHTUNG UND VERFAHREN DAFÜR

APPAREIL ET PROCÉDÉ DE SIMULATION DE GOLF VIRTUELLE


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 11.02.2011 KR 20110012297

(43)Date of publication of application:
18.12.2013 Bulletin 2013/51

(73)Proprietor: Golfzon Co., Ltd.
Daejeon (KR)

(72)Inventors:
  • WOO, Chang Heon
    Yongin-si, Gyeonggi-do 448-531 (KR)
  • JANG, Hyung Wook
    Daejeon 305-792 (KR)
  • ZO, Heung Ryul
    Daejeon 305-810 (KR)

(74)Representative: Cabinet Laurent & Charras 
Le Contemporain 50 Chemin de la Bruyère
69574 Dardilly Cedex
69574 Dardilly Cedex (FR)


(56)References cited: : 
KR-A- 20080 106 904
KR-B1- 100 937 922
US-A1- 2005 272 517
US-A1- 2008 039 222
KR-B1- 100 871 595
US-A- 5 342 054
US-A1- 2007 196 800
US-A1- 2009 042 627
  
  • Anonymous: "Physics", , 27 August 2008 (2008-08-27), XP055245150, Retrieved from the Internet: URL:https://web.archive.org/web/2008082716 2857/http://www.golf-simulators.com/physic s.htm [retrieved on 2016-01-27]
  • Anonymous: "Thread (computing) - Wikipedia", , 7 February 2011 (2011-02-07), XP055367042, Retrieved from the Internet: URL:https://en.wikipedia.org/w/index.php?t itle=Thread_(computing)&oldid=412585734 [retrieved on 2017-04-25]
  
Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


Description

[Technical Field]



[0001] The present invention relates to a virtual golf simulation apparatus and method, and more particularly to a virtual golf simulation apparatus and method wherein a virtual golf course is visualized and simulated and a trajectory of a golf ball struck directly by a user is simulated in the virtual golf course.

[Background Art]



[0002] With recent increase in the popularity of golf, a so-called screen golf system has been introduced which allows users to practice golf and enjoy virtual golf games using a virtual golf simulation apparatus and the like. Basically, when a user hits a golf ball placed on a golf mat by swinging a golf club, the virtual golf simulation apparatus senses the golf ball through a sensing device to extract physical characteristics of the moving golf ball and implements an image simulating the trajectory of the ball in a virtual golf course using the extracted physical characteristics.

[0003] When the sensing device is capable of calculating only basic physical characteristics of the moving ball among various physical characteristics, it is possible to quickly perform sensing processes to allow a simulation image of the trajectory of the ball to be implemented almost at the same time as when the ball is struck. However, in this case, there is a problem in that simulation accuracy is reduced since the trajectory of the ball cannot be accurately calculated using the basic physical characteristics only. This kind of simulation is disclosed in the document US 2008/039222.

[0004] On the other hand, when the sensing device is capable of calculating various physical characteristics of the moving ball, simulation accuracy is increased. However, in this case, the time required to perform sensing processes is increased such that a simulation image of the trajectory of the ball is implemented after the required time elapses after the user hits the ball. This significantly reduces the realism of virtual golf, thereby greatly reducing the user's interest in the virtual golf.

[Disclosure]


[Technical Problem]



[0005] Therefore, the present invention has been made in view of the above problems, and it is an object of the present invention to provide a virtual golf simulation apparatus and method, wherein a sensing device senses hitting a ball by a user with a golf club and a ball trajectory is simulated in a virtual golf course according to sensing results, allowing the user to enjoy a virtual golf on a virtual golf course to provide the same sense of realism that a golfer would feel when playing golf on a real golf course, and wherein, while it takes a lot of time to perform the sensing processes as the sensing device accurately senses physical characteristics of a moving ball, it is possible to achieve rapid implementation of a simulation image of a ball trajectory according to sensing results to reduce the difference between the time at which a ball is struck by the user and the time at which a ball trajectory starts to be implemented in the simulation image to a level that cannot be perceived by humans, thereby greatly improving the realism of virtual golf.

[Technical Solution]



[0006] In accordance with an aspect of the present invention, the above and other objects can be accomplished by the provision of a virtual golf simulation apparatus including a sensing device for sensing hitting a ball by a user, the sensing device including a camera unit and a sensing processing unit, wherein the camera unit is configured to acquire a plurality of images of the moving ball hit by the user, and the sensing processing unit is configured to process the plurality of images and extract physical characteristics of the moving ball including a speed of the ball, a direction of the ball, a vertical angle of the ball and a spin of the ball; and a simulator configured for providing an image of a virtual golf course and a simulation image of a trajectory of the moving ball in the virtual golf course according to results from the sensing device to perform virtual golf simulation, the simulator including an image processing unit and a control unit, wherein the image processing unit is configured to implement an image of a virtual golf course and a simulation image of a trajectory of the moving ball in the virtual golf course and let an image output device output the implemented image of the virtual golf course and the implemented simulation image of the trajectory of the moving ball, and the control unit is configured to receive the extracted physical characteristics of the moving ball from the sensing processing unit and control the image processing unit based on the received physical characteristics of the moving ball to perform virtual golf simulation.

[0007] The invention is characterized in that :
  • the sensing processing unit is configured to process the physical characteristics of the moving ball through a first ball processing module and a second ball processing module in a distributed manner by which the first ball processing module and the second ball processing module process and analyze different physical characteristics independently of each other,
  • the first ball processing module is configured to process and analyze a first physical characteristics of the moving ball by using said acquired images including the speed, the direction and the vertical angle of the ball, and the second ball processing module is configured to process and analyze a second physical characteristic of the moving ball including the spin of the ball, wherein :
    • the first ball processing module is configured to be first operated through a thread, and the second ball processing module is configured to be second operated by using the images analyzed by the first ball processing module through the same thread, the sensing processing unit being configured to primarily transmit the first physical characteristics of the moving ball to the control unit ; and to secondarily transmit the second physical characteristic of the moving ball to the control unit, or
    • the first ball processing module is configured to be operated through a thread, the second ball processing module is configured to be operate through another thread simultaneously with and independently from the first ball processing module, the sensing processing unit being configured to transmit first information when it is obtained and to transmit second information, after first information, when it is obtained,
  • wherein the control unit is configured to control the image processing unit to start implementing the simulation image of the trajectory of the moving ball based on the first physical characteristics of the moving ball received from the sensing processing unit and to correct a ball trajectory in the simulation image of the image processing unit by applying the second physical characteristic of the moving ball received from the sensing processing unit after the first physical characteristics of the moving ball.


[0008] Preferably, the sensing processing unit estimates the spin of the ball to analyze the second physical characteristic of the moving ball by extracting and analyzing an image of a golf club, with which the ball has been hit, from the acquired image. Preferably, the first ball processing module is configured to extract and analyze a ball image from each of the acquired images to obtain the first physical characteristics of the moving ball; and the second ball processing module is configured to extract and analyze a club image from each of the images analyzed by the first ball processing module to obtain the second physical characteristic of the moving ball through the same thread.

[0009] Preferably, the first ball processing module is configured to extract and analyze a ball image from each of the acquired images to obtain the first physical characteristics of the moving ball; and the second ball processing module is configured to estimate the spin of the ball to analyze the second physical characteristic of the moving ball by extracting a ball image from each of the acquired images and analyzing changes of a predetermined mark or dimples on the ball image through the different threads, simultaneously.

[0010] Preferably, the apparatus further comprising a database that stores weather information received from a weather information server or arbitrarily set weather information, the control unit controls the image processing unit to process the simulation image of the trajectory by applying the weather information stored in the database to the simulation image of the trajectory of the moving ball.

[0011] Preferably, the control unit controls the image processing unit to process the simulation image of the trajectory of the moving ball by: combining i) a first simulation image portion that has been implemented according to the first physical characteristics of the moving ball primarily received and ii) a second simulation image portion that is to be implemented from an end of the first simulation image portion according to both the first physical characteristics of the moving ball and the secondarily received second physical characteristic of the moving ball as the second physical characteristic of the moving ball is applied.

[0012] Preferably, the control unit controls the image processing unit to start implementing a simulation image of a trajectory of the moving ball according to the first physical characteristics of the moving ball primarily received; calculate a trajectory of the moving ball from a beginning of the trajectory by using both the first physical characteristics of the moving ball and the second physical characteristic of the moving ball as the second physical characteristic of the moving ball has been secondarily received, and process the simulation image such that a remaining portion of the ball trajectory gradually matches the calculated trajectory of the moving ball.

[0013] In accordance with another aspect of the present invention, there is provided a virtual golf simulation method implemented in a virtual golf simulation apparatus above mentioned, the method comprising acquiring, by the camera unit, a plurality of images of a moving ball hit by a user; processing, by the sensing processing unit, the acquired plurality of images to extract physical characteristics of the moving ball including a speed of the ball, a direction of the ball, a vertical angle of the ball and a spin of the ball.

[0014] The method is characterized in that the step of processing by the sensing processing unit includes : the following operations:
  • firstly processing and analyzing, by the first ball processing module through a thread, a first physical characteristics of the moving ball by using the acquired images, and secondly processing and analyzing by the second ball processing module through the same thread, when the thread is not used by the first ball processing module, a second physical characteristic of the moving ball by using the images analyzed by the first ball processing module, said first physical characteristics of the moving ball including the speed, the direction and the vertical angle of the ball, and said second physical characteristic of the moving ball including the spin of the ball,
  • firstly transmitting, by the sensing processing unit, said first physical characteristics of the moving ball to the control unit and transmitting secondly said second physical characteristic of the moving ball to the control unit,
or the following operations:
  • processing and analyzing a first physical characteristics of the moving ball by the first ball processing module through a thread, and processing and analyzing a second physical characteristic of the moving ball by the second ball processing module through another thread, simultaneously with and independently from the first ball processing module, said first physical characteristics of the moving ball including the speed, the direction and the vertical angle of the ball, and said second physical characteristic of the moving ball including the spin of the ball,
  • the first physical characteristics of the moving ball determination being faster than the second physical characteristic of the moving ball determination, transmitting first information when it is obtained and transmitting second information, after first information, when it is obtained;
and characterized in that the method further includes the step of controlling the image processing unit based on the received physical characteristics of the moving ball, wherein the control unit controls the image processing unit to start implementing the simulation image of the trajectory of the moving ball based on the first ball-information received from the sensing processing unit, and corrects the image processing unit to process the simulation image by applying the second ball-information received from the sensing processing unit to the started trajectory of the moving ball.

[0015] Preferably, the method further comprising extracting weather information received from a weather information server or arbitrarily set and stored weather information, the extracted weather information is applied to a trajectory of the ball corresponding to at least one of the step of starting implementation of the simulation image and the step of continuing to implement the simulation image.

[0016] Preferably, the step of controlling the image processing unitincludes combining i) a first simulation image portion that has been implemented according to the first ball-information primarily received and ii) a second simulation image portion that is to be implemented from an end of the first simulation image portion according to both the first ball-information and the second ball-information, as the second ball-information is applied.

[0017] Preferably, the step of controlling the image processing unit includes calculating a first trajectory of the moving ball based on the first ball-information; calculating a second trajectory of the moving ball based on both the first ball-information and the second ball-information as the second ball-information is applied; and processing the simulation image such that a remaining portion of the first trajectory not implemented gradually matches the calculated second trajectory of the moving ball.

[Advantageous Effects]



[0018] In the virtual golf simulation apparatus and method according to present invention, the sensing device efficiently performs sensing processes in a distributed manner although it takes a lot of time to perform the sensing processes as the sensing device accurately senses physical characteristics of a moving ball, thereby achieving rapid implementation of a simulation image of a ball trajectory according to sensing results. This reduces the difference between the time at which a ball is struck by the user and the time at which a ball trajectory starts to be implemented in the simulation image to a level that cannot be perceived by humans, thereby greatly improving the realism of virtual golf.

[Description of Drawings]



[0019] The above and other objects, features and other advantages of the present invention will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:

FIG. 1 illustrates an example of a screen golf system to which a virtual golf simulation apparatus according to an embodiment of the present invention is applied;

FIG. 2 is a block diagram illustrating a configuration of the virtual golf simulation apparatus;

FIG. 3 is a flowchart of a virtual golf simulation method;

FIG. 4 is a flowchart of a virtual golf simulation method; and

FIGS. 5 and 6 illustrate various methods for implementing a simulation image according to physical characteristic of the moving ball items that are transmitted from a sensing device of a virtual golf simulation apparatus after being processed in a distributed manner by the sensing device.


[Best Mode]



[0020] Embodiments of a virtual golf simulation apparatus and method useful for understanding the invention will now be described in more detail with reference to the drawings.

[0021] First, a virtual golf simulation apparatus according to an example useful for understanding the invention is described below with reference to FIGS. 1 and 2.

[0022] FIG. 1 illustrates an example of a screen golf system to which the virtual golf simulation apparatus according to the embodiment of the present invention is applied and FIG. 2 is a block diagram illustrating a configuration of the virtual golf simulation apparatus that is applied to the screen golf system shown in FIG. 1.

[0023] As shown in FIGS. 1 and 2, the virtual golf simulation apparatus according to the example useful for understanding the present invention includes a sensing device S that senses hitting a ball B by a user and a simulator 1 that implements an image of a virtual golf course and provides a simulation image of the trajectory of the ball in the virtual golf course according to the result of sensing by the sensing device S to perform virtual golf simulation.

[0024] As shown in FIG. 1, in the screen golf system to which the virtual golf simulation apparatus according to the embodiment of the present invention is applied, a swing plate 100 is provided at the bottom of a golf box 2, which provides a space of a specific size, such that the user can practice their golf swing on the golf box 2, and a golf mat 120 is provided at one portion of the swing plate 100 to allow the user on the swing plate 100 to hit a ball B placed at the golf mat 120 with a golf swing. In addition, a screen 3 is provided at the front side such that an image output device, which has received image information from the simulator 1, projects a virtual golf simulation image onto the screen 3. Here, the image output device is, for example, an image output unit 30 shown in FIG. 2 such as a beam projector.

[0025] The swing plate 100 and the golf mat 120 may be provided on the bottom surface of the golf box 2 and may also be provided on the swing plate 100 as shown in FIG. 1.

[0026] The swing plate 100 may be provided so as to be inclined to the front, rear, left, and right at a certain angle and may be connected to the simulator 1 to form an inclination with respect to the topography of the currently implemented virtual golf course.

[0027] The sensing device S is provided in the golf box 2 to sense hitting the ball B by the user. In the example of FIG. 1, a sensing device that uses an image sensing scheme is provided as the sensing device S.

[0028] Specifically, the virtual golf simulation apparatus according to an example useful for understanding the invention may include an image sensing type sensing device S which includes a camera unit 50 and a sensing processing unit 60 as shown in FIG. 2.

[0029] The camera unit 50 may include one camera or may include two or more cameras. To acquire an image of a moving ball B to extract 3-dimensional coordinates of the ball, the camera unit 50 preferably includes two or more cameras 51 and 52 to constitute a stereo camera as shown in FIG. 1.

[0030] Although the sensing device of the virtual golf simulation apparatus according to the example illustrated in FIGS. 1 and 2 is an image sensing type sensing device that uses cameras, the sensing device is not limited to the image sensing type and may include any type of sensing device which senses hitting a ball by a user to extract physical characteristics of a moving ball through information processing. The following is a description of an image sensing type sensing device that acquires an image of hitting the ball by the user to extract physical characteristics of the moving ball through information processing.

[0031] As shown in FIG. 2, the sensing device S may include a camera unit 50 including a plurality of cameras 51 and 52 and a sensing processing unit 60 that processes the image acquired by the camera unit 50 to extract physical characteristics of the moving ball.

[0032] Here, the physical characteristics of the moving ball may include a launch speed of the ball, the moving direction (horizontal launch angle) of the ball, the vertical launch angle of the ball, a spin applied to the ball, and the like.

[0033] The sensing processing unit 60 may include a first ball processing module 61 which extracts and analyzes a ball image from a source image acquired through the camera unit 50 to analyze first physical characteristic of the moving ball for calculating physical characteristics of the moving ball and a second ball processing module 62 which processes and analyzes the source image or the image used in the first ball processing module 61 to analyze second physical characteristic of the moving ball.

[0034] A moving ball basically has various physical characteristics. Therefore, when the various physical characteristics are collectively processed, it takes a lot of time to perform simulation. To rapidly perform simulation, the sensing device of the virtual golf simulation apparatus according to the present invention processes the various physical characteristics of the moving ball through the first ball processing module and the second ball processing module in a distributed manner.

[0035] Accordingly, it is preferable that the first ball processing module 61 and the second ball processing module 62 of the sensing processing unit 60 process and analyze different physical characteristics of the ball independently of each other.

[0036] That is, it is preferable that each of the first physical characteristic of the moving ball analyzed by the first ball processing module 61 and the second physical characteristic of the moving ball analyzed by the second ball processing module 62 include at least one different physical characteristic and the first physical characteristic of the moving ball and the second physical characteristic of the moving ball be processed and analyzed independently of each other.

[0037] Here, the first physical characteristic of the moving ball may include physical characteristics such as, for example, the speed, the direction, and the vertical angle of the ball and the second physical characteristic of the moving ball may include a physical characteristic such as, for example, the spin of the ball.

[0038] The simulator 1 included in the virtual golf simulation apparatus according to an example preferably includes a control unit M, a database 10, an image processing unit 20, and an image output unit 30.

[0039] The database 10 stores all data required for virtual golf simulation. For example, the database 10 stores data required to drive the system, data associated with implementation of an image of a virtual golf course, and data associated with implementation of a simulation image of the trajectory of the ball.

[0040] The image processing unit 20 performs image processing for implementing an image of a virtual golf course, a simulation image of the trajectory of a ball in the virtual golf course, or the like.

[0041] The image output unit 30 outputs image information received from the image processing unit 20 to the screen to allow the user to view the corresponding image.

[0042] The control unit M receives information associated with sensing results from the sensing device S and controls operation of all components such as the database 10, the image processing unit 20, and the image output unit 30. That is, the control unit M and the components such as the database 10 and the image processing unit 20 function as an image implementation means for implementing a simulation image of the trajectory of the ball according to the sensing results from the sensing device S.

[0043] While processing the physical characteristics of the moving ball in a distributed manner, the sensing device S of the virtual golf simulation apparatus according to an example useful for understanding the invention transmits a physical characteristic that has been first calculated among the physical characteristics to the image implementation means, i.e., the simulator 1, to start implementation of a simulation image of the trajectory of the ball and transmits next calculated information to the simulator 1 to apply the next calculated information to the simulation image which has already started to be implemented. Thus, it is possible to quickly implement a simulation image of an accurate ball trajectory although it takes a lot of time to accurately calculate the physical characteristics of the moving ball.

[0044] Here, it is preferable that the sensing device first calculate and transmit basic physical characteristics among various physical characteristics of the moving ball to the simulator and apply a physical characteristic, whose information processing takes a long time, after the simulation image starts to be implemented.

[0045] For example, it is preferable that the sensing device first calculate and transmit the speed, direction and vertical angle of the ball, which can be rapidly calculated among the physical characteristics of the ball, to the simulator and then transmit the spin of the ball whose information processing takes a longer time to the simulator immediately after the spin of the ball has been calculated, such that the transmitted ball spin is applied while implementation of the simulation image is in progress.

[0046] Although FIG. 2 illustrates an example in which the sensing device S including the camera unit 50 and the sensing processing unit 60 and the simulator 1 are provided independently of each other manner in the virtual golf simulation apparatus according to the present example, the present example is not limited to this example and may also be applied to an example in which the camera unit 50 and the sensing processing unit 60 are separated from each other, the sensing processing unit 60 is included in the simulator 1, and the camera unit 50 and the simulator 1 are provided independently of each other in the virtual golf simulation apparatus.

[0047] The control unit M and the sensing processing unit 60 in the simulator 1 may be provided independently of each other and the control unit M and the sensing processing unit 60 may also be integrated into a single control means.

[0048] The following Table 1 shows details of the first physical characteristic of the moving ball and the second physical characteristic of the moving ball.
[Table 1]
First physical characteristic of the moving ballSecond physical characteristic of the moving ball
Information required to start simulation of ball trajectory Information required to perform simulation of ball trajectory
At least one of ball speed, direction, and vertical angle At least one of ball speed, direction, vertical angle, and spin
Ball image information extracted from first acquired image Club image information extracted from first acquired image
Physical characteristic information first calculated among physical characteristics of ball Information sequentially calculated after the first calculated information among physical characteristics of ball


[0049] The first physical characteristic of the moving ball and the second physical characteristic of the moving ball described in Table 1 are described below in more detail with reference to various examples shown in FIGS. 4 and 5.

[0050] FIGS. 3 and 4 are flowcharts of operation of the sensing device and the simulator that are main components of the virtual golf simulation apparatus according to the present example and FIG. 5 is a flowchart of operation of the camera unit and the simulator of the virtual golf simulation apparatus according to the present example.

[0051] First, a virtual golf simulation method according to an example useful for understanding the invention is described below with reference to FIG. 3.

[0052] As shown in FIG. 3, the virtual golf simulation method according to the present example may be divided into a procedure performed by the sensing device and a procedure performed by the simulator.

[0053] When the userhits a ball, the sensing device senses the hitting and triggers a sensing procedure (S10). That is, when the user hits a ball, the sensing device starts a sensing procedure including acquiring an image and processing the acquired image.

[0054] Here, as shown in FIG. 3, the sensing device may simultaneously perform various processes in a multithreaded manner.

[0055] The image acquisition process S11, which is performed by the camera unit, may be performed through Thread 1 while the image processing and information analysis processes S12 and S13, which are performed by the first ball processing module and the second ball processing module of the sensing processing unit, may be performed through Thread 2.

[0056] Specifically, when the sensing device triggers a sensing procedure, the camera unit acquires an image and transmits the acquired image in real time to the first ball processing module of the sensing processing unit (S11) .

[0057] The first ball processing module extracts and processes a ball image from the image received from the camera unit to analyze and extract first physical characteristic of the moving ball such as the speed, direction, vertical angle, and the like of the ball among the physical characteristics of the moving ball (S12) .

[0058] When the first ball processing module has extracted the first physical characteristic of the moving ball, the sensing device immediately transmits the extracted first physical characteristic of the moving ball to the simulator (primary transmission). While the sensing device is performing a sensing process, the simulator is in a standby mode after completing the preparation for simulation image implementation (S20) and, upon receiving the first physical characteristic of the moving ball that has been primarily transmitted, the simulator calculates a ball trajectory according to the received first physical characteristic of the moving ball and starts implementing a simulation image based on the calculated ball trajectory (S21).

[0059] When the first ball processing module in the sensing device primarily transmits the first physical characteristic of the moving ball to the simulator since the first ball processing module completes the first physical characteristic of the moving ball analysis, the second ball processing module starts analyzing second physical characteristic of the moving ball such as the spin of the ball (S13).

[0060] When the second ball processing module has completed extracting the second physical characteristic of the moving ball, the sensing device secondarily transmits the second physical characteristic of the moving ball to the simulator. The simulator calculates the trajectory of the ball according to the second physical characteristic of the moving ball and corrects a ball trajectory image in the simulation image, which has already started to be implemented, according to the calculated ball trajectory (S22) to perform accurate simulation (S23).

[0061] Here, the process of extracting the speed, direction, and vertical angle of the ball by the first ball processing module may be performed every some milliseconds and the process of completing processing by the second ball processing module after completion of processing by the first ball processing module may also be performed every some milliseconds. Therefore, an accurate simulation image can be implemented, which has been secondarily transmitted, based on the second physical characteristic of the moving ball in less than 1 second after a simulation image is implemented based on the first physical characteristic of the moving ball that has been primarily transmitted. Therefore, it is possible to rapidly implement an accurate simulation image.

[0062] For example, it may take about 100ms for the first ball processing module to extract a ball image from an acquired source image, process the extracted ball image, and calculate the speed, direction, and vertical angle of the ball and it may take about 200ms for the second ball processing module to delete the ball image from the source image, extract a club image, and analyze a trajectory of the club head to estimate the spin of the ball.

[0063] The method, in which physical characteristic of the moving ball analysis by the first ball processing module and physical characteristic of the moving ball analysis by the second ball processing module are performed in the same thread as described above in this example, can be applied to the case in which the second ball processing module performs image processing according to the result of processing by the first ball processing module.

[0064] In the above example, the acquired source image may include a ball image, a club image, and a noise image which cannot be identified as a ball or club image. Here, the first ball processing module can accurately locate and analyze a ball image. Since it is possible to identify a ball image in the source image according to the result of processing by the first ball processing module, the second ball processing module can extract and analyze only a club image from the source image by deleting the ball image identified by the first ball processing module.

[0065] When the sensing device primarily transmits the first physical characteristic of the moving ball and secondarily transmits the second physical characteristic of the moving ball, the second physical characteristic of the moving ball preferably includes the first physical characteristic of the moving ball. That is, when the first physical characteristic of the moving ball includes the speed, direction, and vertical angle of the ball and the second physical characteristic of the moving ball includes the spin of the ball, the second physical characteristic of the moving ball preferably includes all of the speed, direction, vertical angle, and spin of the ball.

[0066] When the second ball processing module has failed to extract the spin of the ball (for example, when the second ball processing module cannot estimate the spin since the speed of the ball is too low as when putting), the second physical characteristic of the moving ball which is secondarily transmitted may include only the speed, direction, and vertical angle of the ball.

[0067] As described above, the sensing device of the virtual golf simulation apparatus according to the present example first analyzes first physical characteristic of the moving ball such as the speed, direction, and vertical angle among the physical characteristics of the moving ball and applies the analyzed result to a simulation image and analyzes second physical characteristic of the moving ball such as the spin of the ball within a very short time thereafter and applies the analyzed result to the simulation image. Therefore, it is possible to quickly and accurately implement a simulation image.

[0068] In all example useful for understanding the invention illustrated in FIG. 4, a process for acquiring an image (S11), a process for analyzing physical characteristic of the moving ball by the first ball processing module (S14), and a process for analyzing physical characteristic of the moving ball by the second ball processing module (S15) are separately performed through Thread 1, Thread 2, and Thread 3.

[0069] That is, physical characteristic of the moving ball analysis by the first ball processing module and physical characteristic of the moving ball analysis by the second ball processing module are simultaneously performed through different threads.

[0070] In this case, a result of physical characteristic of the moving ball analysis, which is first obtained from among a result of physical characteristic of the moving ball analysis by the first ball processing module and a result of physical characteristic of the moving ball analysis by the second ball processing module, is primarily transmitted to the simulator and a next analysis result is secondarily transmitted to the simulator. In the case in which the first ball processing module analyzes first physical characteristic of the moving ball such as the speed, direction, and vertical angle of the ball and the second ball processing module analyzes second physical characteristic of the moving ball such as the spin of the ball, typically, the first physical characteristic of the moving ball analyzed by the ball processing module is primarily transmitted to the simulator and the second physical characteristic of the moving ball analyzed by the ball processing module is secondarily transmitted to the simulator since it takes a longer time to analyze the spin of the ball.

[0071] In this example useful for understanding the invention, the second ball processing module may analyze physical characteristic of the moving ball by extracting and analyzing a club image from a source image and estimating a spin of the ball. However, this example may be more suitable for the case in which the second ball processing module extracts a spin of the ball by analyzing a ball image rather than by analyzing a movement trajectory of the club.

[0072] For example, the second ball processing module may extract a spin of the ball by analyzing changes of dimples of the ball in the source image and may also extract a spin of the ball by analyzing changes of a predetermined marking on the ball in a ball image in the source image. Here, the term "dimples" refers to crater-shaped depressions in the surface of a golf ball. Dimples allow the golf ball to more travel a greater distance than balls with a smooth surface.

[0073] Accordingly, in the case in which both the first ball processing module and the second ball processing module extract and analyze a ball image from a source image, it is possible to obtain a much faster analysis result by simultaneously performing physical characteristic of the moving ball analysis by the first ball processing module and physical characteristic of the moving ball analysis by the second ball processing module through different threads.

[0074] Also, in this example, when the sensing device primarily transmits the first physical characteristic of the moving ball and secondarily transmits the second physical characteristic of the moving ball, the second physical characteristic of the moving ball preferably includes the first physical characteristic of the moving ball. That is, when the first physical characteristic of the moving ball includes the speed, direction, and vertical angle of the ball and the second physical characteristic of the moving ball includes the spin of the ball, the second physical characteristic of the moving ball preferably includes all of the speed, direction, vertical angle, and spin of the ball.

[0075] Although not explicitly illustrated in FIGS. 3 and 4, it is preferable that a trajectory of the ball not be calculated based only on sensing results when a simulation image is implemented but instead a simulation image be implemented also using weather information of the virtual golf course.

[0076] That is, in the case in which weather information received from a weather information server has been stored in the database or weather information arbitrarily set in the system has been stored in the database, it is preferable that the simulator apply the weather information stored in the database to the physical characteristic of the moving ball received from the sensing device to obtain a more accurate and reliable simulation result.

[0077] In the example useful for understanding the invention shown in FIG. 5, the camera unit and the simulator are provided independently of each other. Here, the first physical characteristic of the moving ball includes ball image information generated from a ball image extracted from an initially acquired image and the second physical characteristic of the moving ball includes club image information or ball and club image information generated from a club image extracted from an initially acquired image.

[0078] That is, when a sensing procedure is triggered (S10), the camera unit acquires an image associated with a process of impact of the ball by the golf club (S11). Here, a process for extracting a ball image from the initially acquired image may be performed through a different thread (S11a) and a process for extracting a club image from the initially acquired image may be performed (S11b).

[0079] The first physical characteristic of the moving ball including ball image information generated from a ball image extracted from the initially acquired image is primarily transmitted to the simulator and the second physical characteristic of the moving ball including club image information is secondarily transmitted to the simulator.

[0080] Here, in the simulator, the first physical characteristic of the moving ball and the second physical characteristic of the moving ball transmitted from the camera unit may be processed through the sensing processing unit and processing results may be sequentially delivered to the control unit such that simulation starts and progresses as two processes. The simulator may also include a single control means that can perform functions of both the sensing processing unit and the control unit and perform physical characteristic of the moving ball analysis and ball trajectory simulation through different threads. That is, the control means may perform processes, which are performed by the sensing processing unit in the example of FIG. 5, through Thread 1 and may perform processes, which are performed by the control unit in the example of FIG. 5, through Thread 2.

[0081] The first physical characteristic of the moving ball primarily transmitted to the sensing processing unit is analyzed by the first ball processing module (S21a) and the analyzed result is delivered to the control unit. The control unit then calculates a ball trajectory based on the analyzed result and starts implementing a simulation image (S21b).

[0082] Then, when the second physical characteristic of the moving ball is secondarily transmitted to the sensing processing unit, the second physical characteristic of the moving ball is analyzed by the second ball processing module (S22a) and the analyzed result is delivered to the control unit. The control unit then calculates a ball trajectory based on the analyzed result and continues to implement a simulation image, which has already started to be implemented, while correcting the simulation image according to the calculated ball trajectory (S21b).

[0083] In this manner, the simulator may start implementing a simulation image based on the first physical characteristic of the moving ball and continue to implement the simulation image based on the second physical characteristic of the moving ball, thereby completing implementation of a ball trajectory simulation image (S23).

[0084] Various methods, in which a simulation image of a ball trajectory is implemented when physical characteristic of the moving ball items are separately transmitted from the sensing device after being processed in a distributed manner by the sensing device, are described below with reference to FIGS. 6 and 7.

[0085] FIG. 6(a) illustrates an example in which a ball trajectory is calculated according to first physical characteristic of the moving ball that is primarily transmitted from the sensing device, FIG. 6(b) illustrates an example in which the ball trajectory is calculated according to second physical characteristic of the moving ball that is secondarily transmitted from the sensing device, and FIG. 6(c) illustrates an example in which a simulation image of the ball trajectory, which has started to be implemented as shown in FIG. 6(a), continues to be implemented after being corrected according to the ball trajectory calculated according to the second physical characteristic of the moving ball as shown in FIG. 6(b).

[0086] Specifically, a simulation image portion (see FIG. 6(a)) that has been implemented according to the first physical characteristic of the moving ball that has been primarily transmitted to the simulator and a simulation image portion (see FIG. 6(b)) that is to be implemented according to both the first physical characteristic of the moving ball and the second physical characteristic of the moving ball that has been secondarily transmitted are combined to implement a simulation image of a final ball trajectory (see FIG. 6(c)).

[0087] In an example shown in FIG. 7, a simulation image is implemented in a manner different from that described above. FIG. 7(a) illustrates an example in which a ball trajectory is calculated according to first physical characteristic of the moving ball that is primarily transmitted from the sensing device, FIG. 7(b) illustrates an example in which a ball trajectory is recalculated from the beginning according to second physical characteristic of the moving ball that is secondarily transmitted from the sensing device, and FIG. 7(c) illustrates an example in which a simulation image of a final ball trajectory is implemented by gradually matching a simulation image of the ball trajectory, which has started to be implemented as shown in FIG. 7(a), with the ball trajectory recalculated according to the second physical characteristic of the moving ball as shown in FIG. 7(b).

[0088] Specifically, a simulation image of a ball trajectory starts to be implemented according to the first physical characteristic of the moving ball that has been primarily transmitted to the simulator (see FIG. 7(a)), a ball trajectory is recalculated from the beginning according to the first physical characteristic of the moving ball and the second physical characteristic of the moving ball as the second physical characteristic of the moving ball has been secondarily transmitted (see FIG. 7(b)), and a simulation image is implemented such that a ball, whose simulation image has already been implemented, gradually follows the recalculated ball trajectory (see FIG. 7(c)).

[0089] As described above, the sensing device processes and calculates different physical characteristics independently of each other and sequentially transmits calculated results, starting from an initially calculated result, to the simulator and the simulator starts implementing a simulation image immediately upon receiving physical characteristic of the moving ball and continues to implement the simulation image by applying sequentially received information to the simulation image. This method can quickly achieve a correct simulation result and reduces the difference between the time at which a ball is struck by the user and the time at which a ball trajectory starts to be implemented in the simulation image to a level that cannot be perceived by humans (for example, a level of milliseconds which is hardly perceived by humans), thereby greatly improving the realism of virtual golf.

[Industrial Applicability]



[0090] In the virtual golf simulation apparatus and method according to present invention, the sensing device efficiently performs sensing processes in a distributed manner although it takes a lot of time to perform the sensing processes as the sensing device accurately senses physical characteristics of a moving ball, thereby achieving rapid implementation of a simulation image of a ball trajectory according to sensing results. This reduces the difference between the time at which a ball is struck by the user and the time at which a ball trajectory starts to be implemented in the simulation image to a level that cannot be perceived by humans, thereby greatly improving the realism of virtual golf. Therefore, the present invention can be widely used in industries associated with the virtual golf simulation apparatus and method.


Claims

1. A virtual golf simulation apparatus comprising:

- a sensing device (S) for sensing hitting a ball by a user, the sensing device (S) including a camera unit (50) and a sensing processing unit (60), wherein

o the camera unit (50) is configured to acquire a plurality of images of the moving ball hit by the user, and

o the sensing processing unit (60) is configured to process the plurality of images and extract physical characteristics of the moving ball including a speed of the ball, a direction of the ball, a vertical angle of the ball and a spin of the ball; and

- a simulator (1) configured for providing an image of a virtual golf course and a simulation image of a trajectory of the moving ball in the virtual golf course according to results from the sensing device (S) to perform virtual golf simulation, the simulator (1) including an image processing unit (20) and a control unit (M), wherein

o the image processing unit (20) is configured to implement an image of a virtual golf course and a simulation image of a trajectory of the moving ball in the virtual golf course and let an image output device (30) output the implemented image of the virtual golf course and the implemented simulation image of the trajectory of the moving ball, and

o the control unit (M) is configured to receive the extracted physical characteristics of the moving ball from the sensing processing unit (60) and control the image processing unit (20) based on the received physical characteristics of the moving ball to perform virtual golf simulation,

characterized in that:

- the sensing processing unit (60) is configured to process the physical characteristics of the moving ball through a first ball processing module (61) and a second ball processing module (62) in a distributed manner by which the first ball processing module (61) and the second ball processing module (62) process and analyze different physical characteristics independently of each other,

- the first ball processing module (61) is configured to process and analyze a first physical characteristics of the moving ball by using said acquired images including the speed, the direction and the vertical angle of the ball, and the second ball processing module (62) is configured to process and analyze a second physical characteristic of the moving ball including the spin of the ball, wherein :

o the first ball processing module (61) is configured to be first operated through a thread, and the second ball processing module (62) is configured to be second operated by using the images analyzed by the first ball processing module (61) through the same thread, the sensing processing unit (60) being configured to primarily transmit the first physical characteristics of the moving ball to the control unit (M); and to secondarily transmit the second physical characteristic of the moving ball to the control unit (M), or

o the first ball processing module (61) is configured to be operated through a thread, the second ball processing module (62) is configured to be operate through another thread simultaneously with and independently from the first ball processing module (61), the sensing processing unit (60) being configured to transmit first information when it is obtained and to transmit second information, after first information, when it is obtained,

- wherein the control unit (M) is configured to control the image processing unit (20) to start implementing the simulation image of the trajectory of the moving ball based on the first physical characteristics of the moving ball received from the sensing processing unit (60) and to correct a ball trajectory in the simulation image of the image processing unit (20) by applying the second physical characteristic of the moving ball received from the sensing processing unit (60) after the first physical characteristics of the moving ball.


 
2. The virtual golf simulation apparatus according to claim 1, wherein the sensing processing unit (60) estimates the spin of the ball to analyze the second physical characteristic of the moving ball by extracting and analyzing an image of a golf club, with which the ball has been hit, from the acquired image.
 
3. The virtual golf simulation apparatus according to claim 1, wherein
the first ball processing module (61) is configured to extract and analyze a ball image from each of the acquired images to obtain the first physical characteristics of the moving ball; and the second ball processing module (62) is configured to extract and analyze a club image from each of the images analyzed by the first ball processing module (61) to obtain the second physical characteristic of the moving ball through the same thread.
 
4. The virtual golf simulation apparatus according to claim 1, wherein
the first ball processing module (61) is configured to extract and analyze a ball image from each of the acquired images to obtain the first physical characteristics of the moving ball; and the second ball processing module (62) is configured to estimate the spin of the ball to analyze the second physical characteristic of the moving ball by extracting a ball image from each of the acquired images and analyzing changes of a predetermined mark or dimples on the ball image through the different threads, simultaneously.
 
5. The virtual golf simulation apparatus according to claim 1, further comprising a database (10) that stores weather information received from a weather information server or arbitrarily set weather information,
wherein the control unit (M) controls the image processing unit (20) to process the simulation image of the trajectory by applying the weather information stored in the database (10) to the simulation image of the trajectory of the moving ball.
 
6. The virtual golf simulation apparatus according to claim 1, wherein the control unit (M) controls the image processing unit (20) to process the simulation image of the trajectory of the moving ball by:
combining i) a first simulation image portion that has been implemented according to the first physical characteristics of the moving ball primarily received and ii) a second simulation image portion that is to be implemented from an end of the first simulation image portion according to both the first physical characteristics of the moving ball and the secondarily received second physical characteristic of the moving ball as the second physical characteristic of the moving ball is applied.
 
7. The virtual golf simulation apparatus according to claim 1, wherein the control unit (M) controls the image processing unit (20) to
start implementing a simulation image of a trajectory of the moving ball according to the first physical characteristics of the moving ball primarily received
calculate a trajectory of the moving ball from a beginning of the trajectory by using both the first physical characteristics of the moving ball and the second physical characteristic of the moving ball as the second physical characteristic of the moving ball has been secondarily received, and
process the simulation image such that a remaining portion of the ball trajectory gradually matches the calculated trajectory of the moving ball.
 
8. A virtual golf simulation method implemented in a virtual golf simulation apparatus according to one of claims 1 to 7, the method comprising:

- acquiring, by the camera unit (50), a plurality of images of a moving ball hit by a user;

- processing, by the sensing processing unit (60), the acquired plurality of images to extract physical characteristics of the moving ball including a speed of the ball, a direction of the ball, a vertical angle of the ball and a spin of the ball ,

characterized in that the step of processing by the sensing processing unit (60) includes:

the following operations:

o firstly processing and analyzing, by the first ball processing module (61) through a thread, a first physical characteristics of the moving ball by using the acquired images, and secondly processing and analyzing by the second ball processing module (62) through the same thread, when the thread is not used by the first ball processing module (61), a second physical characteristic of the moving ball by using the images analyzed by the first ball processing module (61), said first physical characteristics of the moving ball including the speed, the direction and the vertical angle of the ball, and said second physical characteristic of the moving ball including the spin of the ball,

o firstly transmitting, by the sensing processing unit (60), said first physical characteristics of the moving ball to the control unit (M) and transmitting secondly said second physical characteristic of the moving ball to the control unit (M),

or the following operations:

o processing and analyzing a first physical characteristics of the moving ball by the first ball processing module (61) through a thread, and processing and analyzing a second physical characteristic of the moving ball by the second ball processing module (62) through another thread, simultaneously with and independently from the first ball processing module (61), said first physical characteristics of the moving ball including the speed, the direction and the vertical angle of the ball, and said second physical characteristic of the moving ball including the spin of the ball,

o the first physical characteristics of the moving ball determination being faster than the second physical characteristic of the moving ball determination, transmitting first information when it is obtained and transmitting second information, after first information, when it is obtained;

and characterized in that the method further includes the step of controlling the image processing unit (20) based on the received physical characteristics of the moving ball, wherein the control unit (M) controls the image processing unit (20) to start implementing the simulation image of the trajectory of the moving ball based on the first ball-information received from the sensing processing unit (60), and corrects the image processing unit (20) to process the simulation image by applying the second ball-information received from the sensing processing unit (60) to the started trajectory of the moving ball.
 
9. The virtual golf simulation method according to claim 8, further comprising extracting weather information received from a weather information server or arbitrarily set and stored weather information,
wherein the extracted weather information is applied to a trajectory of the ball corresponding to at least one of the step of starting implementation of the simulation image and the step of continuing to implement the simulation image.
 
10. The virtual golf simulation method according to claim 9, wherein the step of controlling the image processing unit(20) includes:
combining i) a first simulation image portion that has been implemented according to the first ball-information primarily received and ii) a second simulation image portion that is to be implemented from an end of the first simulation image portion according to both the first ball-information and the second ball-information, as the second ball-information is applied .
 
11. The virtual golf simulation method according to claim 9, wherein the step of controlling the image processing unit(20) includes :

calculating a first trajectory of the moving ball based on the first ball-information;

calculating a second trajectory of the moving ball based on both the first ball-information and the second ball-information as the second ball-information is applied; and

processing the simulation image such that a remaining portion of the first trajectory not implemented gradually matches the calculated second trajectory of the moving ball.


 


Ansprüche

1. Eine Vorrichtung zur virtuellen Golf-Simulation, die umfasst:

- eine Sensoreinheit (S) zur Erfassung des Ballabschlags durch Benutzer, die Sensoreinheit (S) enthält eine Kameraeinheit (50) und eine Erfassungs-Verarbeitungseinheit (60), wobei

o die Kameraeinheit (50) so konfiguriert ist, dass mehrere Bilder des vom Benutzer geschlagenen Balls erfasst werden, und

o die Erfassungs-Verarbeitungseinheit (60) so konfiguriert ist, dass eine Vielzahl von Bildern verarbeitet und physikalische Eigenschaften des sich bewegenden Balls extrahiert werden können, einschließlich der Ballgeschwindigkeit, des vertikalen Ballwinkels und des Spins des Balls; und

- ein Simulator (1), konfiguriert zur Lieferung eines Bildes einer virtuellen Golfanlage und ein Simulationsbild der Bahn des sich bewegenden Balls innerhalb der virtuellen Golfanlage, entsprechend den Ergebnissen der Sensoreinheit (S) zur Ausführung einer virtuellen Golfsimulation, der Simulator (1) enthält dabei eine Bildverarbeitungseinheit (20) und eine Steuereinheit (M), wobei

o die Bildverarbeitungseinheit (20) dazu konfiguriert ist, ein Bild einer virtuellen Golfanlage zu implementieren sowie ein Simulationsbild der Bahn des sich innerhalb der virtuellen Golfanlage bewegenden Balls und über ein Bildausgabegerät (30) das implementierte Bild der virtuellen Golfanlage und das implementierte Simulationsbild der Bahn des sich bewegenden Balls auszugeben, und

o die Steuereinheit (M) konfiguriert ist zum Empfang der extrahierten physikalischen Eigenschaften des sich bewegenden Balls von der Erfassungs-Verarbeitungseinheit (60) und zur Steuerung der Bildverarbeitungseinheit (20), auf Grundlage der empfangenen physikalischen Eigenschaften des sich bewegenden Balls zur Ausführung einer virtuellen Golfsimulation,

dadurch gekennzeichnet, dass:

- die Erfassungs-Verarbeitungseinheit (60) konfiguriert ist zur Verarbeitung der physikalischen Eigenschaften des sich bewegenden Balls durch ein erstes Ball-Verarbeitungsmodul (61) und ein zweites Ball-Verarbeitungsmodul (62) in verteilter Art und Weise, durch die das erste Ball-Verarbeitungsmodul (61) und das zweite Ball-Verarbeitungsmodul (62) verschiedene physikalische Eigenschaften unabhängig voneinander verarbeiten und analysieren,

- das erste Ball-Verarbeitungsmodul (61) zur Verarbeitung und Analyse einer ersten physikalischen Eigenschaft des sich bewegenden Balls, durch Nutzung der genannten erfassten Bilder, einschließlich Geschwindigkeit, Richtung und vertikaler Winkel des Balls konfiguriert ist und das zweite Ball-Verarbeitungsmodul (62) zur Verarbeitung und Analyse einer zweiten physikalischen Eigenschaft des sich bewegenden Balls, einschließlich des Ballspins konfiguriert ist, wobei:

o das erste Ball-Verarbeitungsmodul (61) so konfiguriert ist, dass es zuerst durch einen Thread betrieben wird und das zweite Ball-Verarbeitungsmodul (62) dazu konfiguriert ist, als zweites betrieben zu werden, unter Verwendung der vom ersten Ball-Verarbeitungsmodul (61) durch denselben Thread analysierten Bilder, die Erfassungs-Verarbeitungseinheit (60) dazu konfiguriert ist, in erster Linie die ersten physikalischen Eigenschaften des sich bewegenden Balls an die Steuereinheit (M) zu übertragen; und in zweiter Linie die zweite physikalische Eigenschaft des sich bewegenden Balls an die Steuereinheit (M) zu übertragen, oder

o das erste Ball-Verarbeitungsmodul (61) so konfiguriert ist, dass es zuerst durch einen Thread betrieben wird, das zweite Ball-Verarbeitungsmodul (62) so konfiguriert ist, dass es gleichzeitig und unabhängig vom ersten Ball-Verarbeitungsmodul (61) durch einen anderen Thread betrieben wird, die Erfassungs-Verarbeitungseinheit (60) dazu konfiguriert ist, eine erste Information zu übertragen, sobald sie eingeht und eine zweite Information nach der ersten Information zu übertragen, sobald sie eingeht,

- wobei die Steuereinheit (M) dazu konfiguriert ist, die Bildverarbeitungseinheit (20) zu steuern, um mit der Implementierung des Simulationsbildes der Bahn des sich bewegenden Balls auf Grundlage der ersten physikalischen Eigenschaften des sich bewegenden Balls, die von der Erfassungs-Verarbeitungseinheit (60) empfangen wurden, zu beginnen und um die Ballbahn im Simulationsbild der Bildverarbeitungseinheit (20) zu korrigieren, indem die zweite physikalische Eigenschaft des sich bewegenden Balls die von der Erfassungs-Verarbeitungseinheit (60) nach der ersten physikalischen Eigenschaft es sich bewegenden Balls empfangen wurde, angelegt wird.


 
2. Vorrichtung zur virtuellen Golf-Simulation gemäß Anspruch 1, wobei die Erfassungs-Verarbeitungseinheit (60) den Ballspin schätzt, zur Analyse der zweiten physikalischen Eigenschaften des sich bewegenden Balls durch Extraktion und Analyse einen Bildes eines Golfschlägers, mit dem der Ball geschlagen wurde, anhand des erfassten Bildes.
 
3. Vorrichtung zur virtuellen Golf-Simulation gemäß Anspruch 1, wobei das erste Ball-Verarbeitungsmodul (61) dazu konfiguriert ist, ein Ballabbild aus jedem der erfassten Bilder zu extrahieren und zu analysieren, um die ersten physikalischen Eigenschaften des sich bewegenden Balls zu erhalten; und das zweite Ball-Verarbeitungsmodul (62) dazu konfiguriert ist, ein Schlägerabbild aus jedem der vom ersten Ball-Verarbeitungsmodul (61) analysierten Bilder zu extrahieren und analysieren, um die zweite physikalische Eigenschaft des sich bewegenden Balls durch denselben Thread zu erhalten.
 
4. Vorrichtung zur virtuellen Golf-Simulation gemäß Anspruch 1, wobei das erste Ball-Verarbeitungsmodul (61) dazu konfiguriert ist, ein Ballabbild aus jedem der erfassten Bilder zu extrahieren und analysieren, um die erste physikalische Eigenschaft des sich bewegenden Balls zu erhalten; und das zweite Ball-Verarbeitungsmodul (62) ist dazu konfiguriert, den Ballspin zu schätzen, um die zweite physikalische Eigenschaft des sich bewegenden Balls zu analysieren, durch Extraktion eines Ballabbildes aus jedem der erfassten Bilder und Analyse von Veränderungen einer vorher festgelegten Markierung oder von Dellen auf dem Ballabbild durch verschiedene Threads, gleichzeitig.
 
5. Vorrichtung zur virtuellen Golf-Simulation gemäß Anspruch 1, die weiterhin eine Datenbank (10) enthält, die Wetterinformationen von einem Wetterdienst- Server oder beliebig eingegebene Wetterinformationen speichert, wobei die Steuereinheit (M) die Bildverarbeitungseinheit (20) steuert, um ein Simulationsbild der Bahn zu verarbeiten, indem die in der Datenbank (10) gespeicherte Wetterinformation auf das Simulationsbild der Bahn des sich bewegenden Balls angewendet wird.
 
6. Vorrichtung zur virtuellen Golf-Simulation gemäß Anspruch 1, wobei die Steuereinheit (M) die Bildverarbeitungseinheit (20) steuert, um das Simulationsbild der Bahn des sich bewegenden Balls zu verarbeiten, durch:
Kombination i) eines ersten Simulationsbildabschnitts, der gemäß der als erstes erhaltenen ersten physikalischen Eigenschaften des sich bewegenden Balls implementiert wurde, und ii) eines zweiten Simulationsbildabschnitts, der von einem Ende des ersten Simulationsbildabschnitts aus implementiert wird, entsprechend sowohl den ersten physikalischen Eigenschaften des sich bewegenden Balls und der als zweites erhaltenen zweiten physikalischen Eigenschaft des sich bewegenden Balls, wenn die zweite physikalische Eigenschaften des sich bewegenden Balls angewendet wird.
 
7. Vorrichtung zur virtuellen Golf-Simulation gemäß Anspruch 1, wobei die Steuereinheit (M) die Bildverarbeitungseinheit (20) anweist,
mit der Implementierung eines Simulationsbildes der Bahn des sich bewegenden Balls zu beginnen, entsprechend der ersten physikalischen Eigenschaften des sich bewegenden Balls, die als erstes empfangen wurden,
die Bahn des sich bewegenden Balls vom Anfang der Bahn an zu berechnen, unter Verwendung sowohl der ersten physikalischen Eigenschaften des sich bewegenden Balls und der zweiten physikalischen Eigenschaft des sich bewegenden Balls, sobald die zweite physikalische Eigenschaft des sich bewegenden Balls als zweites empfangen wurde, und
das Simulationsbild zu verarbeiten, so dass ein verbleibender Abschnitt der Ballbahn graduell zur berechneten Bahn des sich bewegenden Balls passt.
 
8. Virtuelles Golf-Simulationsverfahren, implementiert in einem virtuellen Golfsimulationsgerät, entsprechend einem der Ansprüche 1 bis 7, wobei das Verfahren umfasst:

- Erfassung durch die Kameraeinheit (50) einer Vielzahl von Bilder eines von einem Benutzer geschlagenen sich bewegenden Balls ;

- Verarbeitung durch die Erfassungs-Verarbeitungseinheit (60), der erfassten Vielzahl an Bildern zum Extrahieren physikalischer Eigenschaften des sich bewegenden Balls, einschließlich der Ballgeschwindigkeit, der Ballrichtung, dem vertikalen Ballwinkel und des Ballspins,

dadurch gekennzeichnet, dass der Schritt der Verarbeitung durch die Erfassungs-Verarbeitungseinheit (60)
die folgenden Operationen beinhaltet:

o zuerst Verarbeitung und Analyse durch das erste Ball-Verarbeitungsmodul (61) durch einen Thread, der ersten physikalischen Eigenschaften des sich bewegenden Balls durch Verwendung der erfassten Bilder, und zweitens Verarbeitung und Analyse durch das zweite Ball-Verarbeitungsmodul (62) durch denselben Thread, wenn der Thread nicht vom ersten Ball-Verarbeitungsmodul (61) genutzt wird, einer zweiten physikalischen Eigenschaft sich bewegenden Balls durch Verwendung der vom ersten Ball-Verarbeitungsmodul (61) analysierten Bilder, wobei die erste physikalische Eigenschaften des sich bewegenden Balls die Geschwindigkeit, die Richtung und den vertikalen Ballwinkel umfassen und die genannte zweite physikalische Eigenschaften den Ballspin enthält,

o zuerst Übermittlung, durch die Erfassungs-Verarbeitungseinheit (60), der genannten ersten physikalischen Eigenschaften des sich bewegenden Balls an die Steuereinheit (M) und zweitens Übermittlung der genannten zweiten physikalischen Eigenschaft des sich bewegenden Balls an die Steuereinheit (M),

oder die folgenden Operationen:

o Verarbeitung und Analyse erster physikalischer Eigenschaften des sich bewegenden Balls durch das erste Ball-Verarbeitungsmodul (61) durch einen Thread, und Verarbeitung und Analyse einer zweiten physikalischen Eigenschaft des sich bewegenden Balls durch das zweite Ball-Verarbeitungsmodul (62) durch einen anderen Thread, gleichzeitig mit und unabhängig vom ersten Ball-Verarbeitungsmodul (61), die genannten ersten physikalischen Eigenschaften des sich bewegenden Balls umfassen die Geschwindigkeit, die Richtung und den vertikalen Ballwinkel, und die genannte zweite physikalische Eigenschaft des sich bewegenden Balls umfassen den Ballspin;

∘ da die Bestimmung der ersten physikalischen Eigenschaften des sich bewegenden Balls dabei schneller erfolgt, als die Bestimmung der zweiten physikalischen Eigenschaft des sich bewegenden Balls, Übertragung der ersten Information sobald sie erhalten wird und Übertragung der zweiten Information nach der ersten Information, sobald sie erhalten wird;

und dadurch gekennzeichnet, dass das Verfahren weiterhin einen Schritt der Steuerung der Bildverarbeitungseinheit (20) enthält, auf Grundlage der erhaltenen physikalische Eigenschaften des sich bewegenden Balls, wobei die Steuereinheit (M) die Bildverarbeitungseinheit (20) anweist mit der Implementierung des Simulationsbildes der Bahn des sich bewegenden Balls auf Grundlage der ersten physikalischen Eigenschaften des sich bewegenden Balls, die von der Erfassungs-Verarbeitungseinheit (60) empfangen wurden, zu beginnen und die Bildverarbeitungseinheit (20) zu korrigieren das Simulationsbild zu verarbeiten, indem die vom Erfassungs-Verarbeitungseinheit (60) empfangene zweite Ballinformation auf die begonnene Bahn des sich bewegenden Balls angewendet wird.
 
9. Virtuelles Golf-Simulationsverfahren gemäß Anspruch 8, das weiterhin umfasst, Wetterinformationen von einem Wetterdienst- Server oder beliebig eingegebene Wetterinformationen zu extrahieren,
wobei die extrahierte Wetterinformationen auf die Ballbahn angewendet wird, entsprechend mindestens einem der Schritte des Beginns der Implementierung des Simulationsbildes und/ oder dem Schritt der Fortsetzung der Implementierung des Simulationsbildes.
 
10. Virtuelles Golf-Simulationsverfahren gemäß Anspruch 9, wobei der Schritt der Steuerung der Bildverarbeitungseinheit (20) umfasst:
Kombination i) eines ersten Simulationsbildabschnitts, der implementiert wurde, gemäß der als erstes erhaltenen Ballinformation und ii) eines zweiten Simulationsbildabschnitts, der von einem Ende des ersten Simulationsbildabschnitts aus implementiert wird, entsprechend sowohl der ersten Ballinformation und der zweiten Ballinformation, wenn die zweite Ballinformation angewendet wird.
 
11. Virtuelles Golf-Simulationsverfahren gemäß Anspruch 9, wobei der Schritt der Steuerung der Bildverarbeitungseinheit (20) umfasst:

Berechnung einer ersten Bahn des sich bewegenden Balls auf Grundlage der ersten Ballinformation;

Berechnung einer zweiten Bahn des sich bewegenden Balls auf Grundlage sowohl der ersten Ballinformation wie der zweiten Ballinformation, wenn die zweite Ballinformation angewendet wird; und

Verarbeitung des Simulationsbildes, so dass ein nicht implementierter verbleibender Abschnitt der ersten Bahn graduell zur berechneten zweiten Bahn des sich bewegenden Balls passt.


 


Revendications

1. Appareil de simulation de golf virtuel comprenant :

- un dispositif de détection (S) pour détecter qu'une balle est tapée par un utilisateur, le dispositif de détection (S) comprenant une unité de caméra (50) et une unité de traitement de détection (60), dans lequel

∘ l'unité de caméra (50) est configurée pour acquérir une pluralité d'images de la balle en mouvement tapée par l'utilisateur, et

∘ l'unité de traitement de détection (60) est configurée pour traiter la pluralité d'images et extraire des caractéristiques physiques de la balle en mouvement, y compris une vitesse de la balle, une direction de la balle, un angle vertical de la balle et une rotation de la balle ; et

- un simulateur (1) configuré pour fournir une image d'un parcours de golf virtuel et une image de simulation d'une trajectoire de la balle en mouvement dans le parcours de golf virtuel en fonction de résultats provenant du dispositif de détection (S) pour effectuer une simulation de golf virtuel, le simulateur (1) comprenant une unité de traitement d'image (20) et une unité de commande (M), dans lequel

∘ l'unité de traitement d'image (20) est configurée pour implémenter une image d'un terrain de golf virtuel et une image de simulation d'une trajectoire de la balle en mouvement dans le terrain de golf virtuel et laisser un dispositif de sortie d'image (30) délivrer en sortie l'image implémentée du terrain de golf virtuel et l'image de simulation implémentée de la trajectoire de la balle en mouvement, et

∘ l'unité de commande (M) est configurée pour recevoir les caractéristiques physiques extraites de la balle en mouvement en provenance de l'unité de traitement de détection (60) et commander l'unité de traitement d'image (20) sur la base des caractéristiques physiques reçues de la balle en mouvement afin d'effectuer une simulation de golf virtuel,

caractérisé en ce que :

- l'unité de traitement de détection (60) est configurée pour traiter les caractéristiques physiques de la balle en mouvement à travers un premier module de traitement de balle (61) et un second module de traitement de balle (62) d'une manière distribuée par l'intermédiaire de laquelle le premier module de traitement de balle (61) et le second module de traitement de billes (62) traitent et analysent différentes caractéristiques physiques indépendamment l'un de l'autre,

- le premier module de traitement de balle (61) est configuré pour traiter et analyser des premières caractéristiques physiques de la balle en mouvement en utilisant lesdites images acquises comprenant la vitesse, la direction et l'angle vertical de la balle, et le second module de traitement de balle (62) est configuré pour traiter et analyser une seconde caractéristique physique de la balle en mouvement incluant la rotation de la balle, dans lequel :

∘ le premier module de traitement de balle (61) est configuré pour être actionné en premier à travers un fil, et le second module de traitement de balle (62) est configuré pour être actionné en second en utilisant les images analysées par le premier module de traitement de balle (61) à travers le même fil, l'unité de traitement de détection (60) étant configurée pour transmettre principalement les premières caractéristiques physiques de la balle en mouvement à l'unité de commande (M) ; et pour transmettre secondairement la seconde caractéristique physique de la balle en mouvement à l'unité de commande (M), ou

∘ le premier module de traitement de balle (61) est configuré pour être actionné à travers un fil, le second module de traitement de balle (62) est configuré pour être actionné à travers un autre fil simultanément avec et indépendamment du premier module de traitement de balle (61), l'unité de traitement de détection (60) étant configurée pour transmettre des premières informations lorsqu'elles sont obtenues et pour transmettre des secondes informations, après les premières informations, lorsqu'elles sont obtenues,

- dans lequel l'unité de commande (M) est configurée pour commander l'unité de traitement d'image (20) pour commencer à implémenter l'image de simulation de la trajectoire de la balle en mouvement sur la base des premières caractéristiques physiques de la balle en mouvement reçues de l'unité de traitement de détection (60) et pour corriger une trajectoire de balle dans l'image de simulation de l'unité de traitement d'image (20) en appliquant la seconde caractéristique physique de la balle en mouvement reçue de l'unité de traitement de détection (60) après les premières caractéristiques physiques de la balle en mouvement.


 
2. Appareil de simulation de golf virtuel selon la revendication 1, dans lequel l'unité de traitement de détection (60) estime la rotation de la balle pour analyser la seconde caractéristique physique de la balle en mouvement en extrayant et en analysant une image d'un club de golf, avec lequel la balle a été tapée, à partir de l'image acquise.
 
3. Appareil de simulation de golf virtuel selon la revendication 1, dans lequel
le premier module de traitement de balle (61) est configuré pour extraire et analyser une image de balle à partir de chacune des images acquises pour obtenir les premières caractéristiques physiques de la balle en mouvement ; et le second module de traitement de balle (62) est configuré pour extraire et analyser une image de club à partir de chacune des images analysées par le premier module de traitement de balle (61) pour obtenir la seconde caractéristique physique de la balle en mouvement à travers le même fil.
 
4. Appareil de simulation de golf virtuel selon la revendication 1, dans lequel
le premier module de traitement de balle (61) est configuré pour extraire et analyser une image de balle à partir de chacune des images acquises pour obtenir les premières caractéristiques physiques de la balle en mouvement ; et le second module de traitement de balle (62) est configuré pour estimer la rotation de la balle afin d'analyser la seconde caractéristique physique de la balle en mouvement en extrayant une image de balle de chacune des images acquises et en analysant des changements d'une marque ou d'alvéoles prédéterminées sur l'image de balle à travers les différents fils, simultanément.
 
5. Appareil de simulation de golf virtuel selon la revendication 1, comprenant en outre une base de données (10) qui stocke des informations météorologiques reçues d'un serveur d'informations météorologiques ou des informations météorologiques définies arbitrairement,
dans lequel l'unité de commande (M) commande l'unité de traitement d'image (20) pour traiter l'image de simulation de la trajectoire en appliquant les informations météorologiques stockées dans la base de données (10) à l'image de simulation de la trajectoire de la balle en mouvement.
 
6. Appareil de simulation de golf virtuel selon la revendication 1, dans lequel l'unité de commande (M) commande l'unité de traitement d'image (20) pour traiter l'image de simulation de la trajectoire de la balle en mouvement en :
combinant i) une première partie d'image de simulation qui a été implémenté selon les premières caractéristiques physiques de la balle en mouvement principalement reçue et ii) une seconde partie d'image de simulation qui doit être implémentée à partir d'une extrémité de la première partie d'image de simulation selon à la fois les premières caractéristiques physiques de la balle en mouvement et la seconde caractéristique physique reçue secondairement de la balle en mouvement lorsque la seconde caractéristique physique de la balle en mouvement est appliquée.
 
7. Appareil de simulation de golf virtuel selon la revendication 1, dans lequel l'unité de commande (M) commande l'unité de traitement d'image (20) pour
commencer à implémenter une image de simulation d'une trajectoire de la balle en mouvement en fonction des premières caractéristiques physiques de la balle en mouvement reçue principalement
calculer une trajectoire de la balle en mouvement à partir d'un début de la trajectoire en utilisant à la fois les premières caractéristiques physiques de la balle en mouvement et la seconde caractéristique physique de la balle en mouvement lorsque la seconde caractéristique physique de la balle en mouvement a été reçue secondairement, et
traiter l'image de simulation de telle sorte qu'une partie restante de la trajectoire de la balle s'apparie graduellement à la trajectoire calculée de la balle en mouvement.
 
8. Méthode de simulation de golf virtuel implémentée dans un appareil de simulation de golf virtuel selon l'une des revendications 1 à 7, la méthode comprenant les étapes consistant à :

- acquérir, par l'intermédiaire de l'unité de caméra (50), une pluralité d'images d'une balle en mouvement tapée par un utilisateur ;

- traiter, par l'intermédiaire de l'unité de traitement de détection (60), la pluralité d'images acquises pour extraire des caractéristiques physiques de la balle en mouvement incluant une vitesse de la balle, une direction de la balle, un angle vertical de la balle et une rotation de balle,

caractérisée en ce que l'étape de traitement par l'unité de traitement de détection (60) comprend :

les opérations suivantes :

o premièrement, traitement et analyse, par le premier module de traitement de balle (61) à travers un fil, de premières caractéristiques physiques de la balle en mouvement en utilisant les images acquises, et deuxièmement traitement et analyse par le second module de traitement de balle (62) à travers le même fil fil, lorsque le fil n'est pas utilisé par le premier module de traitement de balle (61), d'une seconde caractéristique physique de la balle en mouvement en utilisant les images analysées par le premier module de traitement de balle (61), lesdites premières caractéristiques physiques de la balle en mouvement comprenant la vitesse, la direction et l'angle vertical de la balle, et ladite seconde caractéristique physique de la balle en mouvement comprenant la rotation de la balle,

∘ transmettre premièrement, par l'intermédiaire de l'unité de traitement de détection (60), lesdites premières caractéristiques physiques de la balle en mouvement à l'unité de commande (M) et transmettre deuxièmement ladite seconde caractéristique physique de la balle en mouvement à l'unité de commande (M),

ou les opérations suivantes :

∘ traitement et analyse d'une première caractéristique physique de la balle en mouvement par le premier module de traitement de balle (61) à travers un fil, et traitement et analyse d'une seconde caractéristique physique de la balle en mouvement par le second module de traitement de balle (62) à travers un autre fil, simultanément avec et indépendamment du premier module de traitement de balle (61), lesdites premières caractéristiques physiques de la balle en mouvement comprenant la vitesse, la direction et l'angle vertical de la balle, et ladite seconde caractéristique physique de la balle en mouvement comprenant la rotation de la balle,

∘ les premières caractéristiques physiques de la détermination de la balle en mouvement étant plus rapides que la seconde caractéristique physique de la détermination de la balle en mouvement, une transmission de premières informations lorsqu'elles sont obtenues et une transmission de secondes informations, après les premières informations, lorsqu'elles sont obtenues ;

et caractérisée en ce que la méthode comprend en outre l'étape de commande de l'unité de traitement d'image (20) sur la base des caractéristiques physiques reçues de la balle en mouvement, dans laquelle l'unité de commande (M) commande l'unité de traitement d'image (20) pour commencer à implémenter l'image de simulation de la trajectoire de la balle en mouvement sur la base des premières informations de balle reçues de l'unité de traitement de détection (60), et corrige l'unité de traitement d'image (20) pour traiter l'image de simulation en appliquant les secondes informations de balle reçues de l'unité de traitement de simulation (60) à la trajectoire commencée de la balle en mouvement.


 
9. Méthode de simulation de golf virtuel selon la revendication 8, comprenant en outre l'extraction d'informations météorologiques reçues d'un serveur d'informations météorologiques ou d'informations météorologiques définies et stockées arbitrairement,
dans laquelle les informations météorologiques extraites sont appliquées à une trajectoire de la balle correspondant à au moins l'une de l'étape de démarrage de l'implémentation de l'image de simulation et de l'étape de poursuite de l'implémentation de l'image de simulation.
 
10. Méthode de simulation de golf virtuel selon la revendication 9, dans laquelle l'étape de commande de l'unité de traitement d'image (20) comprend l'étape consistant à :
combiner i) une première partie d'image de simulation qui a été implémentée en fonction des premières informations de balle principalement reçues et ii) une seconde partie d'image de simulation qui doit être implémentée à partir d'une fin de la première partie d'image de simulation en fonction à la fois des premières informations de balle et des secondes informations de balle, lorsque les secondes informations de balle sont appliquées.
 
11. Méthode de simulation de golf virtuel selon la revendication 9, dans laquelle l'étape de commande de l'unité de traitement d'image (20) comprend les étapes consistant à :

calculer une première trajectoire de la balle en mouvement sur la base des premières informations de balle ;

calculer une seconde trajectoire de la balle en mouvement sur la base à la fois des premières informations de balle et des secondes informations de balle lorsque les secondes informations de balle sont appliquées ; et

traiter l'image de simulation de telle sorte qu'une partie restante de la première trajectoire non implémentée s'apparient graduellement à la seconde trajectoire calculée de la balle en mouvement.


 




Drawing

















Cited references

REFERENCES CITED IN THE DESCRIPTION



This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

Patent documents cited in the description