(19)
(11)EP 3 726 496 A1

(12)EUROPEAN PATENT APPLICATION
published in accordance with Art. 153(4) EPC

(43)Date of publication:
21.10.2020 Bulletin 2020/43

(21)Application number: 18888641.0

(22)Date of filing:  14.12.2018
(51)International Patent Classification (IPC): 
G08G 1/0967(2006.01)
G01C 21/26(2006.01)
(86)International application number:
PCT/CN2018/120991
(87)International publication number:
WO 2019/114805 (20.06.2019 Gazette  2019/25)
(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated Extension States:
BA ME
Designated Validation States:
KH MA MD TN

(30)Priority: 15.12.2017 CN 201711346070

(71)Applicant: Nio Nextev Limited
Hong Kong (CN)

(72)Inventors:
  • ZHAO, Laigang
    Hong Kong (CN)
  • GUO, Daoyan
    Hong Kong (CN)
  • ZHANG, Jianyong
    Hong Kong (CN)
  • CAI, Xiongfeng
    Hong Kong (CN)

(74)Representative: Vossius & Partner Patentanwälte Rechtsanwälte mbB 
Siebertstrasse 3
81675 München
81675 München (DE)

  


(54)METHOD FOR DETERMINING SAFE SPEED INFORMATION OF ROAD


(57) Disclosed is a method for determining safety speed information of a road. The method comprises: acquiring first speed limit information of a current road from a navigation map (S10); acquiring second speed limit information of the current road from a high-precision map (S12); capturing an image of at least one indication sign on the current road by means of an image capturing device, and identifying the image to determine third speed limit information of the current road (S14); determining a curvature of at least one lane of the current road (S16); and determining a safety speed associated with a corresponding road segment of the current road on the basis of the first speed limit information, the second speed limit information, the third speed limit information, and the curvature (S18). The method facilitates improving the driving experience and driving safety of users, and can also reduce a degree of involvement for a driver when driving.




Description

Technical Field



[0001] The invention relates to the technical field of road safety, and more particularly, to a method for determining safety speed information of a road.

Background Art



[0002] When a vehicle is driving on a road (especially on a highway), a driver needs to well combine a personal driving intention with speed limit information of the current road, and drive as fast as possible under the premise of ensuring safe driving and not violating traffic rules.

[0003] Traditional vehicle navigation applications have integrated speed limit information for most road segments, but the speed limit information is relatively rough and lacks speed limit information for a single lane. For example, for a road with 4 parallel lanes in the same direction, there may be a significant difference in speed limit between the first lane and the fourth lane. When the driver changes lanes, he or she almost certainly needs to pay attention to the change in corresponding speed limit information. In autonomous driving technology, however, this change in speed limit information is also an important factor that should be considered.

[0004] In addition, the safety speed in a straight road segment will be higher than that in a curved road segment, and in the navigation application of the prior art, the safety speeds for different road segments and real-time road conditions are not accurately expressed, which may cause the driver and occupants to feel a strong centrifugal effect when entering a curved road segment from a straight road segment.

Summary of the Invention



[0005] An object of the invention is to provide a method that can more accurately determine safety speed information of a road to improve the driving experience.

[0006] To achieve the above object, the invention provides a technical solution as follows:
a method for determining safety speed information of a road, comprising: a) acquiring first speed limit information of a current road from a navigation map; b) acquiring second speed limit information of the current road from a high-precision map; c) capturing an image of at least one indication sign on the current road by means of an image capturing device, and identifying the image to determine third speed limit information of the current road; d) determining a curvature of at least one lane of the current road; and e) determining a safety speed associated with a corresponding road segment of the current road on the basis of the first speed limit information, the second speed limit information, the third speed limit information, and the curvature.

[0007] Preferably, the second speed limit information comprises speed limit information of each lane on the current road.

[0008] Preferably, the third speed limit information comprises at least speed limit information of a lane where a vehicle is located.

[0009] Preferably, the curvature is acquired from the navigation map or the high-precision map.

[0010] Preferably, the method further comprises: capturing an image of a lane where a vehicle is located to extract lane line information therefrom, and determining the curvature on the basis of the lane line information.

[0011] Preferably, the curvature of the lane is negatively correlated with the safety speed of the corresponding road segment.

[0012] The invention further discloses a driving assistance system based on road speed limit information, comprising: a navigation module for acquiring first speed limit information of a current road; a high-precision map module for determining second speed limit information of the current road; an image capture and identification module for capturing an image of at least one indication sign on the current road, and identifying the image to determine third speed limit information of the current road; a curvature calculation module for determining the curvature of at least one lane of the current road on the basis of a first input from the navigation module and a second input from the high-precision map module; and a safety speed determination module for determining a safety speed associated with a corresponding road segment of the current road on the basis of the first speed limit information, the second speed limit information, the third speed limit information, and the curvature; wherein the driving assistance system assists in driving a vehicle based on the safety speed.

[0013] Preferably, the image capture and identification module further captures a lane line image of the lane where the vehicle is located, to help the curvature calculation module determine the curvature.

[0014] Preferably, the system is deployed as a distributed system.

[0015] The method for determining safety speed information of a road provided by the embodiments of the invention can more accurately determine the speed limit information of the current lane, and then can determine different safety speed information for different road segments and real-time road conditions, and recommending this safety speed to the user can avoid the user's distraction, which is conducive to improving the user's driving experience and driving safety. The driving assistance system can reduce a degree of involvement for a driver when driving, and also make the occupants feel smooth and comfortable throughout the journey, thereby improving the riding experience.

Brief Description of the Drawings



[0016] 

Fig. 1 shows a schematic flow chart of a method for determining safety speed information of a road provided by a first embodiment of the invention.

Fig. 2 shows a structural schematic diagram of modules of a driving assistance system based on road speed limit information provided by a second embodiment of the invention.


Detailed Description of Embodiments



[0017] Specific details are presented in the following description in order to provide a thorough understanding of the invention. However, those skilled in the art will clearly know that embodiments of the invention can be implemented even without these specific details. In the invention, specific numerical references may be made, such as "first element", "second device" and so on. However, specific numerical references should not be understood as having to obey their literal order, but rather as "first element" and "second element" being different.

[0018] The specific details proposed by the invention are only exemplary, and the specific details may vary, but still fall within the spirit and scope of the invention. The term "coupled" is defined to mean being directly connected to a component or indirectly connected to a component via another component.

[0019] The preferred embodiments of a method, a system and a device suitable for implementing the invention are described below with reference to the accompanying drawings. Although the embodiments are described for a single combination of elements, it should be understood that the invention includes all possible combinations of the disclosed elements. Therefore, if one embodiment includes elements A, B and C, and a second embodiment includes elements B and D, the invention should also be considered to include other remaining combinations of A, B, C or D, even if not explicitly described.

[0020] As shown in Fig. 1, the first embodiment of the invention provides a method for determining safety speed information of a road. The following example will be described by taking this method running in a vehicle as an example. The method for determining safety speed information of a road comprises the following steps.

[0021] Step S10, first speed limit information of a current road is acquired.

[0022] Illustratively, a navigation map can be queried by a navigation software that comes with the vehicle, and the first speed limit information of the current road can be acquired from the navigation map, which may be the maximum speed limit or the minimum speed limit of the current road or include the two if they both exist. Optionally, the first speed limit information of the current road may also be acquired through a navigation map provided by a non-vehicle-equipped device (an external device). In this example, the non-vehicle-equipped device may be a mobile terminal such as a mobile phone, and the mobile terminal may communicate with a device for running the method for determining safety speed information of a road, such that the latter acquires the first speed limit information from map information provided by the mobile terminal. In a case where the method for determining safety speed information of a road is performed by a vehicle's driving assistance system, etc., the mobile terminal can communicate with the vehicle, and then transmit the information to the driving assistance system.

[0023] Step S12, second speed limit information of the current road is acquired from a high-precision map.

[0024] The high-precision map is described relative to an ordinary navigation map. On the one hand, the high-precision map can provide position coordinates of a higher precision, and on the other hand, it contains richer and more detailed road traffic information. The high-precision map not only has high-precision coordinates, but also has more accurate road shapes, and even includes data for slope, curvature, heading, elevation, and roll of each lane. However, the high-precision map is usually limited in scope, for example, only provided on highways.

[0025] The high-precision map can provide speed limit information for each lane in the highway, which is called herein as "second speed limit information". In the case where the current road is not covered by the high-precision map, the "second speed limit information" is defined as blank, which means that the speed limit information included in the high-precision map cannot be acquired. Even if the speed limit information cannot be acquired, the method provided in the embodiments of the invention are still executable, except that the "second speed limit information" at this time is represented as blank.

[0026] According to an embodiment of the invention, the high-precision map can be provided to a vehicle control system in real time by an external supplier in the cloud. As an alternative, a high-precision map module, which pre-loads high-precision map information of an area of interest to a user, can be provided on a vehicle side. In the future driving process, the high-precision map module can be automatically updated to acquire the latest update information about the high-precision map, so as to acquire the second speed limit information therefrom.

[0027] Step S14, an image of an indication sign is identified to determine third speed limit information of the current road.

[0028] Specifically, images of one or more indication signs on the current road can be captured in real time by means of an image capturing device such as a camera. These indication signs generally indicate the direction information of the road, the maximum speed limit and the minimum speed limit of the lane, and other information about road traffic. The indication signs may include an indicator drop, an indication board, and an electronic screen.

[0029] According to an embodiment of the invention, through simple image processing, images of all indication signs in the field of view of an image capturing device are captured first, and then an image identification algorithm is used to identify the content of speed limit information therefrom to form the third speed limit information.

[0030] Generally, since the image capturing device will target the road indication sign above or beside the lane where the vehicle is currently located, the identified third speed limit information will include at least the speed limit information of the lane where the vehicle is located and may also include speed limit information of other lanes for use when the vehicle changes lanes.

[0031] Step S16, a curvature of at least one lane of the current road is determined.

[0032] It should be understood that the curvature or radius of curvature of the lane is different on different road segments, the curvature is relatively large in a curved road segment, and the curvature is relatively small or even 0 in a straight road segment.

[0033] It should also be understood that the safety speed may be relatively high in the straight road segment and relatively low in the curved road segment, to prevent a passenger from feeling a relatively large centrifugal force when passing through the curved road segment at a relatively high speed.

[0034] In view of this, the safety speeds of different road segments should be affected by the curvature of the lane. According to an embodiment of the invention, the curvature of the lane may be acquired by a navigation software that comes with the vehicle. Alternatively, the curvature of the lane may be directly acquired from the high-precision map information.

[0035] Preferably, another image capturing device may be used to capture a lane image of the lane where the vehicle is located, to extract lane line information therefrom to directly calculate, or to help determine, or correct the curvature previously acquired from the map information.

[0036] It should be understood that both the image capturing device for identifying the image of the indication sign and the image capturing device for capturing the lane line image of the lane where the vehicle is located may be existing image sensing devices of the vehicle, such as cameras. However, in the case where the existing vehicle camera is insufficient to realize the above operations, an image capturing device may also be added as needed.

[0037] Step S18, a safety speed associated with a corresponding road segment of the current road is determined on the basis of the first speed limit information, the second speed limit information, and the third speed limit information.

[0038] According to an embodiment of the invention, first, second and third safety speeds may be generated based on the first, second and third speed limit information, respectively, which may be different or the same. It should be understood that the first safety speed should be lower than the maximum speed limit contained in the first speed limit information and higher than the minimum speed limit contained therein (if the minimum speed limit is included). The cases for the second and third safety speeds are similar.

[0039] The "safety speed", which is different from the maximum speed limit, can be defined as the maximum speed that a driver can use under the premise of ensuring safe driving without violating traffic rules, or a conventional speed preferred by the driver or occupant. If a vehicle is driving beyond a safety speed, the occupant may experience discomfort.

[0040] According to an embodiment of the invention, one or more of the first, second and third speed limit information and the first, second and third safety speeds may be further recommended to the user in real time.

[0041] As an example, when the first, second and third safety speeds are not exactly the same, for safety reasons, the lowest speed value is extracted therefrom as the final output safety speed to remind the driver, or directly applied to the driving assistance system of the vehicle.

[0042] As another example, the mathematical intermediate value of the first, second and third safety speeds is taken as the final output safety speed to remind the driver, or directly applied to the driving assistance system.

[0043] According to a preferred embodiment of the invention, the safety speed is associated with the road segment. In other words, on road segments with different curvatures, different safety speeds will be recommended to the driver. As an example, on a curved road segment with a relatively large curvature, the safety speed recommended to the driver is 30 km/h; in a curved road segment with a relatively small curvature, the safety speed recommended to the driver is 70 km/h; and in a road segment with the curvature of 0, the safety speed is 110 km/h.

[0044] It can be derived from the above that the curvature of the lane is negatively correlated with the safety speed of the corresponding road segment. In other words, as the curvature decreases, the safety speed increases; and as the curvature increases, the safety speed decreases. Further, a correspondence relationship table can be generated for each road to record the correspondence relationship between different road segments and safety speeds, and to form historical data to store same. In future trips, if the user passes through the same road segment or a round-trip road segment (or the road segment through which the user has driven), a safety speed can be recommended to the driver based on the historical data.

[0045] According to the method of the first embodiment described above, by acquiring the speed limit information of the road from different channels, the vehicle can be driven at a high speed as much as possible on the premise of ensuring safe driving and not violating traffic rules, and the user's distraction can also be avoided. Such an improvement is conducive to improving the user's driving experience.

[0046] In addition, according to yet another embodiment of the invention, further provided is a driving assistance method, comprising: using the method provided by the first embodiment described above to determine the safety speed information, and further to recommend the safety speed to the user or to apply the safety speed to the vehicle driven by the user.

[0047] As shown in Fig. 2, the second embodiment of the invention provides a driving assistance system based on road speed limit information, the system comprising a navigation module 201, a high-precision map module 202, an image capture and identification module 203, a curvature calculation module 210, and a safety speed determination module 220. The driving assistance system can determine the safety speed of the current road segment, and then assist in driving the vehicle based on this safety speed, so as to reduce a degree of involvement for a driver when driving.

[0048] The navigation module 201 is provided on the vehicle side, and can acquire first speed limit information of the current road. The high-precision map module 202 can be directly provided on the vehicle side, or alternatively may be provided in the cloud to transmit high-precision map information to the vehicle side in near real time, which can determine second speed limit information of the current road.

[0049] The image capture and identification module 203 can continuously capture images of the indication sign on the current road, and identify these images to determine third speed limit information of the current road. Specifically, the image capture and identification module 203 may also comprise an image capturing unit and an image identification unit, and an optional image pre-processing unit. The image capturing unit continuously captures images about above or beside the road. The image pre-processing unit analyzes whether these images involve in road indication signs. If the indication signs are involved, the image is transferred to the image identification unit, and the image identification unit identifies the image to extract related speed limit information. When the image capturing unit has a large field of view and can capture and record multiple indication signs at different positions, the image identification unit can further determine the distance between the different indication signs and the vehicle, and use the indication sign closest to the vehicle as a main analysis target to determine the speed limit information of the current lane where the vehicle is located.

[0050] According to an embodiment of the present invention, the curvature calculation module 210 can determine a curvature of at least one lane of the current road on the basis of a first input from the navigation module 201 and a second input from the high-precision map module 202.

[0051] According to another improved embodiment of the invention, the curvature calculation module 210 also acquires a third input from the image capture and identification module 203, and combines the first input, the second input and the third input to synthetically calculate curvature information (curvature or radius of curvature) of the current lane.

[0052] The safety speed determination module 220, on the basis of the first speed limit information, the second speed limit information and the third speed limit information, and in further combination with the curvature information output by the curvature calculation module 210 to determine a safety speed associated with a corresponding road segment of the current road.

[0053] As a more preferred embodiment, the driving assistance system will choose to apply a relatively small safety speed on a curved road segment with a large curvature, while the driving assistance system will choose to apply a high safety speed on a road segment with a small curvature or on a straight road segment.

[0054] In some embodiments of the invention, at least part of the system may be implemented using a set of distributed computing devices connected to a communication network, or based on "cloud". In such a system, multiple computing devices operate together to provide services by using their shared resources.

[0055] As an example, the high-precision map module 202 and/or the safety speed determination module 220 may be provided at a remote end or in the cloud. The navigation module 201, the image capture and identification module 203 and the curvature calculation module 210 are provided at a vehicle local end.

[0056] "Cloud"-based implementation can provide one or more advantages, including: openness, flexibility and extensibility, central management, reliability, scalability, optimization of computing resources, the ability to aggregate and analyze information across multiple users, connecting across multiple geographic areas, and the ability of using multiple mobile or data network operators for network connectivity.

[0057] According to yet another embodiment of the invention, there is also provided a controller, which can implement, when executable instructions stored in a memory are executed, the method for determining road safety speed information provided in the first embodiment described above. Specifically, the controller can execute the steps of the method in an appropriate order by allowing different hardware to cooperate with each other.

[0058] According to yet another embodiment of the invention, there is also provided a storage medium for storing computer executable instructions, wherein the computer executable instructions, when executed by a processor, will perform the steps involved in the method for determining safety speed information of a road provided in the first embodiment described above.

[0059] The foregoing description is only provided for preferred embodiments of the invention, and is not intended to limit the scope of the invention. A person skilled in the art may make various variation designs without departing from the concept and appended claims of the invention.


Claims

1. A method for determining safety speed information of a road, characterized by comprising:

a) acquiring first speed limit information of a current road from a navigation map;

b) acquiring second speed limit information of the current road from a high-precision map;

c) capturing an image of at least one indication sign on the current road by means of an image capturing device, and identifying the image to determine third speed limit information of the current road;

d) determining a curvature of at least one lane of the current road; and

e) determining a safety speed associated with a corresponding road segment of the current road on the basis of the first speed limit information, the second speed limit information, the third speed limit information, and the curvature.


 
2. The method according to claim 1, characterized in that the second speed limit information comprises speed limit information of each lane on the current road.
 
3. The method according to claim 1, characterized in that the third speed limit information comprises at least speed limit information of a lane where a vehicle is located.
 
4. The method according to claim 1, characterized in that the curvature is acquired from the navigation map or the high-precision map.
 
5. The method according to claim 4, characterized by further comprising:
capturing an image of a lane where a vehicle is located to extract lane line information therefrom, and determining the curvature on the basis of the lane line information.
 
6. The method according to claim 1, characterized in that the curvature of the lane is negatively correlated with the safety speed of the corresponding road segment.
 
7. The method according to any one of claims 1 to 6, characterized by further comprising:
recommending to a user in real time at least one of the first speed limit information, the second speed limit information, the third speed limit information, and the safety speed.
 
8. The method according to any one of claims 1 to 6, characterized by further comprising:
recommending to a user, when the user drives through a road segment that he or she once passed, the safety speed on the basis of historical data about the safety speed of the road segment.
 
9. A driving assistance method, characterized by comprising:
using a method according to any one of claims 1 to 8 to recommend to a user the safety speed or to apply the safety speed to a vehicle driven by a user.
 
10. A driving assistance system based on road speed limit information, characterized by comprising:

a navigation module for acquiring first speed limit information of a current road;

a high-precision map module for determining second speed limit information of the current road;

an image capture and identification module for capturing an image of at least one indication sign on the current road, and identifying the image to determine third speed limit information of the current road;

a curvature calculation module for determining a curvature of at least one lane of the current road on the basis of a first input from the navigation module and a second input from the high-precision map module; and

a safety speed determination module for determining a safety speed associated with a corresponding road segment of the current road on the basis of the first speed limit information, the second speed limit information, the third speed limit information, and the curvature;

wherein the driving assistance system assists in driving a vehicle based on the safety speed.


 
11. The system according to claim 10, characterized in that the image capture and identification module further captures a lane line image of the lane where the vehicle is located, to help the curvature calculation module determine the curvature.
 
12. The system according to claim 10, characterized in that the curvature of the lane is negatively correlated with the safety speed of the corresponding road segment.
 
13. The system according to any one of claims 10 to 12, characterized in that the system is deployed as a distributed system.
 
14. A controller, characterized in that the controller implements a method according to any one of claims 1 to 8 when executing executable instructions stored in a memory.
 
15. A storage medium for storing computer executable instructions, characterized in that the computer executable instructions, when executed by a processor, perform the steps of the method according to any one of claims 1 to 8.
 




Drawing







Search report