(19)
(11) EP 2 763 116 A1

(12) EUROPEAN PATENT APPLICATION

(43) Date of publication:
06.08.2014 Bulletin 2014/32

(21) Application number: 14152990.9

(22) Date of filing: 29.01.2014
(51) International Patent Classification (IPC): 
G08B 21/04(2006.01)
(84) Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated Extension States:
BA ME

(30) Priority: 01.02.2013 BE 201300065

(71) Applicant: FamilyEye BVBA
8630 Veurne (BE)

(72) Inventors:
  • De Smet, Sylvie
    8630 VEURNE (BE)
  • Dewaele, Natasha
    8630 VEURNE (BE)

(74) Representative: Plas, Axel Ivo Michel et al
IP HILLS NV Hubert Frère-Orbanlaan 329
9000 Gent
9000 Gent (BE)

   


(54) Fall detection system and method for detecting a fall of a monitored person


(57) The invention relates to a fall detection system (1) for detecting a fall of a monitored person (10), wherein an infrared source is provided to irradiate the person (10) with an infrared dot pattern which is detectable by a depth infrared sensor in order to generate an image of the infrared dot pattern, wherein an image-processing unit is provided to generate at least one identification point (10a) which is located in the area of the head on the basis of the infrared dot pattern and add it to the image received from the infrared sensor, and a fall-processing unit is provided to detect the fall. The invention furthermore relates to a method for detecting a fall of this type.










Description


[0001] The invention generally relates to a fall detection system and a method for detecting a fall of a monitored person.

[0002] The invention relates more specifically to a fall detection system for detecting a fall of a monitored person, wherein said fall detection system comprises at least one infrared source and at least one depth infrared sensor, wherein said infrared source is provided to irradiate said monitored person with a predetermined infrared dot pattern which is detectable by said depth infrared sensor in order to generate an image of said infrared dot pattern.

[0003] The invention furthermore relates more specifically to a method for detecting a fall of a monitored person, wherein said method comprises the following steps:
  • the irradiation of said monitored person with a predetermined infrared dot pattern which is detectable by at least one depth infrared sensor using at least one infrared source; and
  • the generation of an image of said infrared dot pattern.


[0004] Fall detection systems are mainly used in the care of the elderly. Fall incidents occur particularly often in the case of elderly people. In home care, one in three elderly people falls at least once a year, in rest homes around fifty to seventy per cent of the elderly people fall at least once a year. This can result in serious physical injuries in elderly people, such as hip fractures. Moreover, if an elderly person falls, it is crucial that this is quickly noticed, given that elderly people who remain recumbent for too long, sometimes even for an entire night, become cold or dehydrated, which is highly traumatising for this elderly person. Above all elderly people living alone face a greater risk of falling due to health disorders.

[0005] Consequently, a need exists for fall protection systems which are provided to detect and signal a fall of a person. Fall detection systems of this type also enable elderly people to live independently for a longer period.

[0006] Various types of fall detection systems are already known to date.

[0007] A first type of fall detection systems concerns portable sensor-based appliances. Examples thereof are the Zenio system from Vitaltronics or the monitoring and alarm system as described in CN 201853320. Most of these systems use accelerometers and gyroscopes which detect abnormal accelerations and trigger an alarm. However, a first major disadvantage of systems of this type is that a high risk exists that elderly people forget to don these appliances or forget to recharge the batteries or replace flat batteries in the appliances. A second major disadvantage of portable sensor-based appliances of this type is that these appliances are uncomfortable to wear, which discourages elderly people from using these appliances.

[0008] A second type of fall detection systems concerns video-based fall detection systems. In video-based fall detection, human activity is recorded in a video which is further analysed using image processing and computer image analysis systems in order to detect a fall and generate an alarm. A diversity of video-based fall detection systems of this type which use a diversity of fall detection technologies have already been described in both the technical literature and the patent literature.

[0009] The most frequently used and simplest technology for detecting a fall is the aspect ratio of the enclosing rectangle which is drawn around the person who falls, also referred to as the 'bounding box'. The aspect ratio is the ratio of the width and the height of the enclosing rectangle around the object. A standing person has a low value, whereas a recumbent person provides a wide, flat rectangle, which corresponds to a high aspect ratio.

[0010] In FR 2 870 378, a fall detection method which uses this fall detection technology is described for detecting persons with a restricted autonomy. Image-recording means such as a camera are provided here to capture consecutive images of the same surface. During this image capture, a movement is detected which represents the shape of a person. A rectangular contour is localized around the shape which represents the movement. The reduction in the height of the contour is detected, said reduction being representative of a fall of the person.

[0011] A first disadvantage of the fall detection technology which is described in this French patent is that a person is detected only at the time when he moves in his environment. A further disadvantage of the fall detection technology as described therein is that, given that the reduction in the height of a rectangular contour which is localized around a person therein is representative of a fall, it is not suitable for detecting every type of fall. A fall detection technology of this type is, for example, not always accurate for detecting a fall of a person who falls over partially somewhere, for example over a chair, or for detecting a fall of a wheelchair patient.

[0012] A different fall detection technology uses an enclosing ellipse which is drawn around a part of the falling person or the complete falling person. If this ellipse moves at a specific speed, a fall is registered.

[0013] Thus, for example, in the article 'Fall detection using 3D head trajectory extracted from a single camera video sequence', C Rougier, J Meunier, Journal of Telemedicine and Telecare, 2005, a fall detection method is described which uses this technology. This fall detection method is based on three steps, i.e.:
  1. 1/ head tracking: the head of a person is followed, given that the head of the person is usually visible in the image and undergoes a substantial movement during a fall. The head is modelled as an ellipsoid in 3D which is projected as an ellipse in a 2D image surface. In order to localize the head, the De Menthon algorithm is used which uses three input arguments, i.e. the 3D points of the main model, the corresponding 2D points projected in the image surface and the intrinsic parameters of the camera obtained from a calibration of the camera.
  2. 2/ 3D tracking: the head is traced by means of a particle filter in order to extract a 3D trajectory; and
  3. 3/ fall detection: a fall is detected using 3D velocities which are calculated from the 3D trajectory of the head. The vertical and horizontal velocity are used in the world coordinate system in order to distinguish a fall from normal activities.


[0014] However, the disadvantage of the fall detection technology as described in the aforementioned article is that no automatic tracking of the head can take place when a person to be monitored enters a room in which the fall detection system has been installed. This is still always carried out manually. The further tracking can take place only at the time when the ellipse has been placed around the head of the person.

[0015] Further different fall detection algorithms use the following:
  • the fall angle: the fall angle is defined as the angle between the floor surface and the person from which it is certain that the person will fall. Although this fall angle may differ from person to person, a good estimate for said angle is 45°;
  • the centroid of the falling person: the centroid is the geometric centre of a flat figure. During a fall, the centroid changes significantly and quickly;
  • the vertical projection histogram: the vertical projection histogram counts pixel values per column of a silhouette of a person. If a vertical projection histogram of a person is plotted in a graph, three peaks will be visible herein which correspond from left to right to the head, the hands and the hip of the person respectively. This vertical projection histogram of a person changes significantly when a person falls;
  • the horizontal and vertical gradient: when a fall starts, a significant change takes place in either the X-direction or the Y-direction. The gradient value is calculated both horizontally and vertically for each pixel. In the event of a fall, the vertical gradient is smaller than the horizontal gradient.


[0016] A major disadvantage of using the fall angle is that this fall detection algorithm does not work when the person falls in the direction of the camera.

[0017] The disadvantage of all known fall detection algorithms summarized above is that they work in specific circumstances only.

[0018] A different, more advanced fall detection algorithm uses the Hidden Markov Model (HMM). Thus, for example, a fall detection system is described in CN 102289911, wherein two pyroelectric infrared sensors are used to carry out signal acquisition, and wherein HMM pattern matching is used for the fall detection. The use of HMM pattern matching for the fall detection is subdivided into two phases, i.e. an HMM training phase and an HMM recognition phase.

[0019] The major disadvantage of fall detection algorithms which use HMM is the need to obtain training data which are necessary for the training phase (also referred to as the learning phase) of this algorithm.

[0020] Different types of cameras and sensors can also be used in these video-based fall detection systems. A frequently used type of cameras/sensors concerns infrared (IR) cameras or sensors.

[0021] Thus, for example, a fall detection system is described in WO 2012/119903 which uses passive optical sensors, including an infrared camera. Images of a monitored person are captured continuously using a number of passive optical sensors. A server containing logic analyses the images originating from these passive optical sensors in geometric primitives and thus determines by means of algorithms whether or not a fall or a different specific emergency situation occurs. The fall detection algorithms are defined in advance and form part of a library of activated fall detection algorithms. In the recognition algorithms, a person is removed from the background of the image and is vectorized and then disassembled into an image of a person in geometric primitives. The position of this person in space is then determined by means of the server or in the passive optical sensor. Here, the fall detection uses the dynamics of a fall. In other words, how quickly the location of the geometric primitives changes within an image sequence is analysed here. If a fall is detected, an alarm is generated. The monitored person can invalidate this alarm and thus classify it as a false alarm. If this has not happened after a specific time, a transfer of the image of the monitored person or a sequence of images to an unauthorized group of persons then follows.

[0022] However, the major disadvantage of this fall detection system is that ghost images are created. The reason for this is that the image is split up into a foreground and background, wherein the person to be followed is removed from the background of the image. However, if something is then changed in the background, for example a chair or a cupboard is moved, the information in the background is no longer true, resulting in a ghost image and an incorrect detection of a fall.

[0023] In the article entitled 'Development of a fall detection system with Microsoft Kinect', Christopher Kawatsu, Jiaxing Li and CJ Chung, Department of Mathematics and Computer Science, Lawrence Technological University, 2012, a fall detection system which uses the Microsoft Kinect is described. This Kinect comprises three types of sensors, i.e. a standard camera, a depth infrared camera and a microphone. The depth infrared camera detects points projected by an infrared source, more specifically a laser, and converts these automatically into a depth map. The cameras are calibrated in such a way that the pixels of the depth map match the pixels in the images of the standard camera. The Kinect SDK software automatically detects the 3D location of 21 joints of two persons. Moreover, the floor surface is automatically detected. A fall of a monitored person is detected using two algorithms, i.e.
  • a position algorithm which uses the position data of the joints. The distance from the floor surface to each joint of the monitored person is calculated. If the maximum distance is less than a determined limit value, a fall is detected; and
  • a speed algorithm which determines the speed of each joint in the normal direction in relation to the floor surface. The speeds are averaged over all joints and a number of frames. If this averaged speed is lower (speeds in the downward direction are defined as negative) than a determined limit value, a fall is detected.
Voice recognition is used in order to rule out false-positive fall reports. After a fall has been detected, the microphone and the Microsoft Kinect voice recognition system are used to validate the fall.

[0024] However, the disadvantage of this fall detection system is that the floor surface is used as a reference during the position algorithm, as a result of which, for example, a fall of a person sitting on a bed or on a table is not detected, given that, in most cases, this person will not fall to the floor. A further disadvantage is that voice recognition is used in order to validate the fall. Consequently, the person who has fallen must remain capable of responding audibly, which is not always possible, for example after suffering a stroke.

[0025] Consequently, a need exists for a simple and reliable fall detection system wherein no ghost images and as few false-positive fall detections as possible are generated.

[0026] According to a first aspect of the invention, a fall detection system is provided for detecting a fall of a person, wherein said fall detection system comprises at least one infrared source and a depth infrared sensor, wherein said infrared source is provided to irradiate said person with a predetermined infrared dot pattern which is detectable by said depth infrared sensor in order to generate an image of said infrared dot pattern, and wherein said fall detection system is provided with a control unit which:
  • comprises an image-processing unit which is configured to generate at least one identification point which is located in the area of the head of said person on the basis of said infrared dot pattern and to add it to said image received from said depth infrared sensor; and
  • comprises a fall-processing unit which is configured to:
    • receive at least a first and a second said image of said infrared dot pattern from said image-processing unit at a different time within a predetermined time interval, wherein said identification points on said images comprise a vertical Y-position; and
    • detect said fall if, for said identification point which is located in the area of the head, the extent of change in said Y-position between said first and said second image exceeds a predetermined minimum threshold value.


[0027] A depth infrared sensor is an infrared sensor which is provided with a transmitter and sensors which can measure the distance between the infrared sensor and objects according to the 'LightCoding' or 'Structured Light' principle. With the received data, the objects are built up in layers on the Z-axis and a depth map of the objects is produced. In 'LightCoding', an infrared dot pattern is converted into a depth map through pattern recognition on the infrared dots and triangulation between the infrared source and the depth infrared sensor. 'Structured Light' is the process of projecting a known pattern of pixels (usually grids or horizontal bars) onto an image. The manner in which these patterns deform when they collide with surfaces provides an image analysis system for calculating the depth and the surface information of the objects in the image.

[0028] A fall detection system of this type according to the invention has the major advantage that the fall of a person from any position of this person can be detected, from a standing, seated or recumbent position. Moreover, given that identification points which are generated in the images and which are located in the area of specific parts of the body of a person are used in this fall detection system, no ghost images are generated in this fall detection system. A fall detection system of this type according to the invention is thus very reliable.

[0029] A further advantage of the fall detection system according to the invention is that this is a relatively simple system and complex calculation formulae, comparative tables and the like do not need to be used herein.

[0030] In a preferred embodiment of a fall detection system according to the invention, said image-processing unit is configured to generate at least one identification point which is located in the area of the hip centre of said monitored person on the basis of said infrared dot pattern and to add it to said image received from said infrared sensor, wherein said image-processing unit is configured to detect said monitored person in said image from the depth infrared sensor if said identification points which are located in the area of the head and the hip centre of said monitored person have been generated and have been added to said image received from said depth infrared sensor.

[0031] Consequently, a person who enters a room in which the fall detection system according to the invention has been installed is detected as being a person if an identification point in the area of the head of the person and in the area of the hip centre of the person is added to the image received from the infrared sensor by the image-processing unit.

[0032] In one advantageous embodiment of a fall detection system according to the invention, said fall-processing unit is configured to adjust said predetermined minimum threshold value according to the distance between the head of said monitored person and said depth infrared sensor.

[0033] More specifically, said minimum threshold value is linearly proportional to said distance between the head of said monitored person and said depth infrared sensor.

[0034] In an advantageous embodiment of a fall detection system according to the invention, said extent of change in said Y-position between said first and second image is expressed in the number of pixels per second.

[0035] In a more specific embodiment of a fall detection system according to the invention, said images comprise a well-defined number of pixels on the horizontal X-axis and the vertical Y-axis, and a well-defined resolution on the vertical Y-axis, and said minimum threshold value is linearly proportional to:
  • said number of pixels on the horizontal X-axis and the vertical Y-axis; and
  • said resolution on the vertical Y-axis.


[0036] In a preferred embodiment of a fall detection system according to the invention, said control unit comprises an alarm-processing unit which is configured to alert automatically one or more external persons at the time when a said fall of said monitored person is detected.

[0037] This has the advantage that the monitored person does not have to carry out any manual action at the time when a fall occurs. The fall is registered by the fall-processing unit and the alarm-processing unit ensures that the necessary warnings are automatically sent to one or more external persons.

[0038] In a preferred embodiment of a fall detection system according to the invention, said alarm-processing unit is configured to set up automatically a connection to an external appliance which is located with said one or more external persons at the time when a said fall of said monitored person is detected.

[0039] In a more advantageous embodiment of a fall detection system according to the invention, said fall detection system comprises a colour camera which is configured to capture colour images of said monitored person at different times and said external appliance comprises a screen, and said alarm-processing unit is configured to send a said colour image of said monitored person to said external appliance at the time of said fall.

[0040] In an even more advantageous embodiment of a fall detection system according to the invention, said alarm-processing unit is configured to allow said external person to visually observe said monitored person via livestream on said screen.

[0041] Said fall detection system preferably comprises a microphone, wherein said alarm-processing unit is configured to allow said one or more external persons to make audible contact with said monitored person.

[0042] In a preferred embodiment of a fall detection system according to the invention, said fall detection system comprises a social contact unit which is configured to allow said monitored person to have visual and/or audible contact with said one or more external persons.

[0043] In a more preferred embodiment of a fall detection system according to the invention, said social contact unit is configured to allow said monitored person and said one or more external persons to have visual and/or audible contact with one another via a screen which is located, on the one hand, with said monitored person and, on the other hand, with said one or more external persons.

[0044] According to a second aspect of the invention, a method is provided for detecting a fall of a monitored person, wherein said method comprises the following steps:
  • the irradiation of said monitored person with a predetermined infrared dot pattern which is detectable by a depth infrared sensor using an infrared source;
  • the generation of an image of said infrared dot pattern;
wherein said method further comprises the following steps:
  • the generation of at least one identification point which is located in the area of the head of said monitored person on the basis of said infrared dot pattern using an image-processing unit;
  • the addition of said identification point to said image received from said depth infrared sensor;
  • the reception of at least a first and a second said image of said infrared dot pattern from said image-processing unit at a different time within a predefined time interval using a fall-processing unit, wherein said identification points on said images comprise a vertical Y-position; and
  • the detection of said fall by means of said fall-processing unit if, for said identification point which is located in the area of the head, the extent of change in said vertical Y-position between said first and said second image exceeds a predetermined minimum threshold value.


[0045] In a preferred embodiment of a method according to the invention, said method uses a fall detection system according to the invention as described above.

[0046] The invention will now be described in detail with reference to the drawings, wherein:
  • Fig. 1a-1c are a schematic representation of the different steps which a preferred fall detection system according to the invention carries out in order to detect a fall and following detection of a fall;
  • Fig. 2 is a schematic representation of 20 identification points which are generated in the area of the bones and the joints of the monitored person on the basis of the infrared dot pattern with which the monitored person is irradiated by the infrared source of the preferred fall detection system according to the invention;
  • Fig. 3 is a graphical representation of an example of the extent of change in the vertical Y-position of the identification point which is located in the area of the head of the monitored person between consecutive images 1 to 4; and
  • Fig. 4 is a graphical representation of the connection between the minimum threshold value of the extent of change in the vertical Y-position between different images received by the fall-processing unit, expressed in the number of pixels/s, in relation to the distance d between the head of the monitored person and depth infrared sensor.


[0047] A fall detection system (1) according to the invention for detecting a fall of a monitored person (10), as shown schematically in Figure 1, comprises at least one infrared source (not shown in the figures), preferably an infrared laser light source, which has the advantage that it emits invisible light. This infrared source irradiates the environment with a known infrared dot pattern (not shown in the figures). This infrared dot pattern is detectable by at least one depth infrared sensor (not shown in the figures), preferably a 3D depth infrared sensor. This infrared dot pattern preferably consists of a semi-random, constant pattern of small dots which are projected in front of the depth infrared sensor onto the environment. This infrared dot pattern is analysed by the depth infrared sensor and converted into a depth map. In this way, the depth infrared sensor generates an image of the infrared dot pattern.

[0048] This infrared source and the depth infrared sensor are preferably accommodated in the same housing (2).

[0049] The fall detection system (1) further comprises a control unit which comprises an image-processing unit which is configured to generate identification points (10a-10t) on the monitored person (10) on the basis of the infrared dot pattern and to add them to the image received from the depth infrared sensor. The image-processing unit is configured to generate at least one identification point (10a) in the area of the head of the monitored person (10) (see Figure 2). Furthermore, this image-processing unit is also configured to generate at least one identification point (10b) in the area of the hip centre of the monitored person (10) (see Figure 2) and to add it to the image received from the depth infrared sensor.

[0050] The image-processing unit is furthermore preferably designed to generate identification points in the area of a number of other bones and joints of the monitored person (10). In addition to the aforementioned identification points (10a,10b) in the area of the head and the hip centre of the monitored person (10), the following identification points specified below are preferably generated:
  • the right hand (10c);
  • the right wrist (10d);
  • the right elbow (10e);
  • the right shoulder (10f);
  • the shoulder centre (10g);
  • the left shoulder (10h);
  • the left elbow (10i);
  • the left wrist (10j);
  • the left hand (10k);
  • the spinal column (10l);
  • the right hip (10m);
  • the left hip (10n);
  • the right knee (10o);
  • the left knee (10p);
  • the right ankle (10q);
  • the left ankle (10r);
  • the right foot (10s); and
  • the left foot (10t).
Figure 1 also shows the monitored person (10) on the basis of the aforementioned identification points (10a-10t).

[0051] The aforementioned identification points (10a-10t) are preferably generated using a software program developed specifically for this purpose. A typical example thereof is the software program known as SDK which was developed by Microsoft and in which the identification points (10a-10t) described above are formed by "skeleton tracking", as described, inter alia, in US 2010/0199228.

[0052] The control unit of the fall detection system (1) furthermore comprises a fall-processing unit (not shown in the figures) which is responsible for the fall detection. As shown in Figure 1 b, the fall-processing unit (1) is configured to receive at least a first image (3a) and a second image (3b) of the infrared dot pattern of the image-processing unit at a different time within a predefined time interval. Thirty images per second are preferably captured by the infrared sensor and are processed by the image-processing unit, wherein the aforementioned identification points are generated by this image-processing unit and are added to these images. As shown in Figure 3, each of the identification points (10a-10t) on the images has a vertical Y-position. The fall-processing unit is furthermore provided to compare with one another the vertical Y-positions of the identification point (10a) which is located in the area of the head of the monitored person (10) on the different images received from the image-processing unit.

[0053] The detection of a fall by a monitored person (10) is illustrated in Figures 1 a to 1c.

[0054] As shown in Figure 1 a, if the monitored person (10) enters a room in which the fall detection system (1) according to the invention has been installed, the infrared source which is installed in the housing (2) will irradiate the monitored person (10) with the known infrared dot pattern. This infrared dot pattern will then be detected by the depth infrared sensor which, as described above, will convert this infrared dot pattern into a depth map. This image-processing unit will then generate the aforementioned identification points (10a-10t) and add them to the image received from this image-processing unit. At the time when the identification points (10a, 10b) which are located in the area of the head and the hip centre of the monitored person (10) have been generated, the monitored person (10) is then detected.

[0055] As shown in Figure 1b, the aforementioned fall-processing unit will compare the images received from the image-processing unit with one another. An image has a well-defined number of pixels on the horizontal X-axis, a well-defined number of pixels on the vertical Y-axis and a well-defined resolution on the vertical Y-axis. More specifically, the different vertical Y-positions of the identification point (10a) which is located in the area of the head of the monitored person (10) are compared with one another in the different images by the fall-processing unit. If the extent of change in the vertical Y-position between a first and a second image (3a, 3b), for example between image 2 (3a) and image 3 (3b), as shown in Figure 3, then exceeds a predetermined minimum threshold value, a fall is detected. This extent of change in the vertical Y-position is expressed in the number of pixels per second.

[0056] As shown in Figure 4, this minimum threshold value is linearly proportional to the distance (d) between the head of the monitored person (10) and the depth infrared sensor (see Figure 1 a). The fall-processing unit is preferably configured to adjust this predetermined minimum threshold value according to this distance (d).

[0057] Furthermore, this predetermined minimum threshold value is linearly proportional to the number of pixels on the horizontal X-axis and the vertical Y-axis and the resolution on the vertical Y-axis.

Example



[0058] Of a person who is located at a distance of 1.5 metres from the infrared sensor:
  • Number of pixels on the vertical Y-axis: 1024 pixels
  • Number of pixels on the horizontal X-axis: 768 pixels
  • Resolution on the vertical Y-axis: 320 x 240 pixels
  • Minimum threshold value of the extent of change in the vertical Y-position between two images (3a, 3b) received by the fall-processing unit at a different time: 10 pixels between the two images (3a, 3b) or 300 pixels/s (given that 30 images are captured per second) (see Figure 4).


[0059] If this person is located at a distance of 3 metres from the infrared sensor, the minimum threshold value is therefore 20 pixels between the two images (3a, 3b) or 600 pixels/s (see Figure 4).

[0060] The control unit of the fall detection system (1) according to the invention furthermore preferably comprises an alarm-signalling unit (not shown in the figures), whereby the latter is extremely suitable for being installed in one or more rooms in which a person in need of care, usually an elderly person, moves. One or more infrared sources and infrared sensors as described above are installed in these rooms. This alarm-processing unit is configured to alert automatically one or more external persons such as a family member, neighbour, informal care person, nurse/carer, person in an emergency services centre (not shown in the figures) at the time when a fall of the monitored person (10) is detected, without any manual intervention on the part of the monitored person (10). This alarm-processing unit is configured to set up automatically a connection to one or more external appliances, for example a smartphone, TV, computer, etc., which are located with the one or more external persons and which are provided with an independent platform such as IOS, Microsoft, Android with an app. This automatic signalling preferably consists of a photo or an image of the situation in the event of the fall, which is forwarded to one or more external appliances provided with a screen. To capture these images, the fall detection system (1) is preferably provided with one or more colour cameras, more preferably RGB colour cameras.

[0061] Furthermore, the fall detection system (1) according to the invention may comprise a loudspeaker in order to allow one or more external persons to make audible contact with the monitored person (10). A microphone is preferably present alongside the monitored person (10).

[0062] The alarm-processing unit is furthermore preferably configured to allow one or more external persons to observe the monitored person (10) via livestream on an external appliance provided with a screen, using the aforementioned colour camera.

[0063] The fall detection system (1) according to the invention preferably further comprises a social contact unit which is configured to allow the one or more external persons to make visual and audible contact with the monitored person (10). To do this, the aforementioned one or more colour cameras themselves must be connected to a screen (computer, tablet, TV, etc.). This social contact unit can be configured in such a way that the monitored person (10) can make visual and/or audible external contact by pressing once on the photo of the one or more external persons, who are preferably predetermined, resulting in a cost saving in terms of telephony.

[0064] The method according to the invention will typically be computer-implemented on a system or platform with a client-server architecture. The images, reports and tasks are retained centrally or are distributed among one or more servers. Users will typically have access to their task lists and will consult images which are stored in the system via a client device. The control unit or data processing unit or a computer device which is controlled according to a method according to the invention may comprise a workstation, a server, a laptop, a desktop, a portable control system such as a handheld device or mobile device, a tablet computer or any other computer device as known to the person skilled in the art.

[0065] The control unit or data processing unit may comprise a bus or a network for connectivity, directly or indirectly, between different components, a memory or database, one or more processors, input/output ports, a power supply and the like. It should be clear to a person skilled in the art that the bus or the network may comprise one or more buses, such as an address bus, a data bus or a combination thereof, or one or more network links. It should furthermore be clear to a person skilled in the art, depending on the intended application and the use of a specific embodiment, that a multiplicity of these components can be implemented in a single device.

[0066] The control unit or data processing unit may comprise a variety of computer-readable media or may interact therewith. Thus, for example, computer-readable media may comprise a Random Access Memory (RAM), Read Only Memory (ROM), Electronically Erasable Programmable Read Only Memory (EEPROM), flash memory or any other memory technology, CD-ROM, Digital Versatile Disks (DVD) or any other type of optical or holographic media, magnetic cassettes, magnetic tapes, magnetic disk storage or any other magnetic storage devices which may be used to encode information and which can be accessed by the control unit or data processing unit of the computer device.

[0067] The memory may comprise computer storage media in the form of volatile and/or non-volatile memories. The memory may be removable, non-removable or any combination thereof. Examples of hardware devices are devices such as HDD (hard drive disks), SSD (solid-state disks), ODD (optical disk drives), and the like. The control unit or data processing unit or the computer device may comprise one or more processors which read data from components such as memories, the different I/O components and the like.

[0068] The I/O ports may allow the control unit or data processing unit of the computer device to be logically coupled to other appliances such as I/O components. Some of the I/O components may be built into a computer device. Examples of I/O components of this type comprise a microphone, a joystick, a recording device, a game pad, a dish antenna, a scanner, a printer, a wireless device, a network device and the like.

[0069] Although the present invention has been illustrated with reference to specific embodiments, it will be clear to the person skilled in the art that the invention is not restricted to the details of the preceding illustrative example embodiments, and that the present invention can be designed with different modifications and adaptations without departing from the field of application of the invention. The present embodiments must therefore be regarded in all respects as illustrative and non-restrictive, wherein the field of application of the invention is described by the attached claims and not by the preceding description, and all modifications which fall within the meaning and the scope of the claims are therefore also incorporated therein. In other words, it is assumed that all modifications, variations or equivalents which fall within the field of application of the present basic principles and the essential attributes of which are claimed in this patent application are included herein. Moreover, the reader of this patent application will understand that the words "comprising" or "comprise" do not exclude other elements or steps, that the word "a/one" does not exclude a plurality, and that a single element, such as a computer system, a processor or other integrated unit can perform the functions of different appliances which are specified in the claims. Any references in the claims must not be construed as a restriction of the claims in question. The terms "first", "second", "third", "a", "b", "c" and the like, if used in the description or in the claims, are used to make the distinction between elements or steps of the same type, and do not necessarily describe a sequential or chronological order. Similarly, the terms "upper edge", "lower edge", "above", "below" and the like are used for the purpose of the description and do not necessarily refer to relative positions. It must be understood that these terms are interchangeable under the appropriate circumstances and that embodiments of the invention are capable of functioning according to the present invention in sequences or orientations other than those described or illustrated above.


Claims

1. Fall detection system (1) for detecting a fall of a monitored person (10), wherein said fall detection system (1) comprises at least one infrared source and at least one depth infrared sensor, wherein said infrared source is provided to irradiate said monitored person (10) with a predetermined infrared dot pattern which is detectable by said depth infrared sensor in order to generate an image of said infrared dot pattern,
CHARACTERIZED IN THAT said fall detection system (1) is provided with a control unit which:

- comprises an image-processing unit which is configured to generate at least one identification point (10a) which is located in the area of the head of said monitored person (10) on the basis of said infrared dot pattern and to add it to said image received from said depth infrared sensor; and

- comprises a fall-processing unit which is configured to:

• receive at least a first and a second said image (3a, 3b) of said infrared dot pattern from said image-processing unit at a different time within a predetermined time interval, wherein said identification points (10a-10t) on said images comprise a vertical Y-position; and

• detect said fall if, for said identification point (10a) which is located in the area of the head, the extent of change in said Y-position between said first and said second image (3a, 3b) exceeds a predetermined minimum threshold value.


 
2. Fall detection system according to Claim 1, CHARACTERIZED IN THAT said image-processing unit is configured to generate at least one identification point (10b) which is located in the area of the hip centre of said monitored person (10) on the basis of said infrared dot pattern and to add it to said image (3a, 3b) received from said infrared sensor, wherein said image-processing unit is configured to detect said monitored person in said image (3a, 3b) from the depth infrared sensor if said identification points (10a, 10b) which are located in the area of the head and the hip centre of said monitored person (10) have been generated and have been added to said image (3a, 3b) received from said depth infrared sensor.
 
3. Fall detection system according to Claim 1 or 2, CHARACTERIZED IN THAT said fall-processing unit is configured to adjust said predetermined minimum threshold value according to the distance (d) between the head of said monitored person (10) and said depth infrared sensor.
 
4. Fall detection system according to Claim 3, CHARACTERIZED IN THAT said minimum threshold value is linearly proportional to said distance (d) between the head of said monitored person (10) and said depth infrared sensor.
 
5. Fall detection system according to one of Claims 1 to 4, CHARACTERIZED IN THAT said extent of change in said Y-position between said first and second image (3a, 3b) is expressed in the number of pixels per second.
 
6. Fall detection system according to one of Claims 1 to 5, CHARACTERIZED IN THAT said images (3a, 3b) comprise a well-defined number of pixels on the horizontal X-axis and the vertical Y-axis, and a well-defined resolution on the vertical Y-axis, and that said minimum threshold value is linearly proportional to:

- said number of pixels on the horizontal X-axis and the vertical Y-axis; and

- said resolution on the vertical Y-axis.


 
7. Fall detection system according to one of Claims 1 to 6, CHARACTERIZED IN THAT said control unit comprises an alarm-processing unit which is configured to alert automatically one or more external persons at the time when a said fall of said monitored person (10) is detected.
 
8. Fall detection system according to Claim 7, CHARACTERIZED IN THAT said alarm-processing unit is configured to set up automatically a connection to one or more external appliances which are located with said one or more external persons at the time when a said fall of said monitored person (10) is detected.
 
9. Fall detection system according to Claim 8, CHARACTERIZED IN THAT said fall detection system comprises a colour camera which is configured to capture colour images of said monitored person (10) at different times and said external appliance comprises a screen, and that said alarm-processing unit is configured to send a said colour image of said monitored person (10) to said external appliance at the time of said fall.
 
10. Fall detection system according to Claim 9, CHARACTERIZED IN THAT said alarm-processing unit is configured to allow said one or more external persons to visually observe said monitored person (10) via livestream on said screen.
 
11. Fall detection system according to Claim 10, CHARACTERIZED IN THAT said fall detection system comprises a microphone and that said alarm-processing unit is configured to allow said one or more external persons to make audible contact with said monitored person (10).
 
12. Fall detection system according to one of Claims 7 to 11, CHARACTERIZED IN THAT said fall detection system comprises a social contact unit which is configured to allow said monitored person to have visual and/or audible contact with said one or more external persons.
 
13. Fall detection system according to Claim 12, CHARACTERIZED IN THAT said social contact unit is configured to allow said monitored person and said one or more external persons to have visual and/or audible contact with one another via a screen which is located, on the one hand, with said monitored person (10) and, on the other hand, with said one or more external persons.
 
14. Method for detecting a fall of a monitored person (10), wherein said method comprises the following steps:

- the irradiation of said monitored person (10) with a predetermined infrared dot pattern which is detectable by at least one depth infrared sensor using at least one infrared source;

- the generation of an image (3a, 3b) of said infrared dot pattern;

CHARACTERIZED IN THAT said method further comprises the following steps:

- the generation of at least one identification point (10a) which is located in the area of the head of said monitored person (10) on the basis of said infrared dot pattern using an image-processing unit;

- the addition of said identification point to said image (3a, 3b) received from said depth infrared sensor;

- the reception of at least a first and a second said image (3a, 3b) of said infrared dot pattern from said image-processing unit at a different time within a predefined time interval using a fall-processing unit, wherein said identification points (10a-10t) on said images (3a, 3b) comprise a vertical Y-position; and

- the detection of said fall by means of said fall-processing unit if, for said identification point (10a) which is located in the area of the head, the extent of change in said vertical Y-position between said first and said second image (3a, 3b) exceeds a predetermined minimum threshold value.


 
15. Method according to Claim 14, CHARACTERIZED IN THAT said method uses a fall detection system (1) according to one of Claims 1 to 13.
 




Drawing













Search report






Search report




Cited references

REFERENCES CITED IN THE DESCRIPTION



This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

Patent documents cited in the description




Non-patent literature cited in the description