(19)
(11) EP 4 459 593 A1

(12) EUROPEAN PATENT APPLICATION

(43) Date of publication:
06.11.2024 Bulletin 2024/45

(21) Application number: 23171928.7

(22) Date of filing: 05.05.2023
(51) International Patent Classification (IPC): 
G08G 1/16(2006.01)
G08G 1/01(2006.01)
G08G 1/0967(2006.01)
(52) Cooperative Patent Classification (CPC):
G08G 1/166; G08G 1/167; G08G 1/096758; G08G 1/096791; G08G 1/096775; G08G 1/0112
(84) Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated Extension States:
BA
Designated Validation States:
KH MA MD TN

(71) Applicant: Volvo Car Corporation
405 31 Göteborg (SE)

(72) Inventors:
  • PEREZ BARRERA, Oswaldo
    40531 Göteborg (SE)
  • LENNARTSSON, Anders
    40531 Göteborg (SE)

(74) Representative: Maiwald GmbH 
Engineering Elisenhof Elisenstrasse 3
80335 München
80335 München (DE)

 
Remarks:
Amended claims in accordance with Rule 137(2) EPC.
 


(54) METHOD FOR DETERMINING LOSS OF CONTROL OF A SURROUNDING VEHICLE


(57) The disclosure relates to a method (100) for determining loss of control (LOC) of a surrounding vehicle (20), a computer program product associated therewith and a vehicle (10) comprising detection means (12) for detecting objects in its surrounding (S) and processing means (14) for processing the data relating to the detected objects, the vehicle (10) being configured to carry out the method (100).




Description


[0001] The present disclosure relates to a method for determining loss of control of a surrounding vehicle, a computer program product and a vehicle.

[0002] A loss of control of vehicles driving on the road may lead to accidents involving other road users. Drivers losing control of their vehicle may invade other lanes. Other road users may not be aware that a driver has lost control of his vehicle until it is too late and an accident is inevitable. Even if other road users, such as drivers of other vehicles, take note of an unusual driving behavior of one or more surrounding vehicles, they may incorrectly assume that the driver of the vehicle is still in control, e.g., is only about to switch lanes or perform another drive action not posing any danger to other road users.

[0003] The above problem is at least partially solved or alleviated by the subject matter of the independent claims of the present disclosure, wherein further examples are incorporated in the dependent claims.

[0004] According to a first aspect of this disclosure, there is provided a method for determining loss of control of a surrounding vehicle, the method comprising:
  • receiving object information of a surrounding, the object information comprising information about detected objects in the surrounding, the objects including the surrounding vehicle and a road being travelled by the surrounding vehicle,
  • determining a steering correction behavior of the surrounding vehicle, the steering correction behavior comprising at least one steering correction of the surrounding vehicle and comprising at least one steering correction parameter defining the at least one steering correction,
  • comparing the at least one steering correction parameter to at least one predefined steering correction parameter threshold, and
  • predicting or identifying loss of control of the surrounding vehicle based on the comparison.


[0005] The method according to the first aspect of this disclosure thereby provides for a reliable determination of loss of control of a surrounding vehicle, which can aid road users in their driving behavior in order to prevent being involved in an accident. Also, as will be explained further below, the method may include informing other road users of the danger involved with a vehicle for which a loss of control was determined.

[0006] The vehicle for which loss of control is determined is herein referred to as a surrounding vehicle because it is being located in the surrounding, for which the object information is received. The object information may include information such as the presence of an object in the surrounding and/or an absolute or relative position of the object in the surrounding. Further, specific information about the object, in particular the surrounding vehicle, may be included such as size and/or type of surrounding vehicle, e.g., motorbike, car or truck. Such specific information may be taken into consideration for determination of loss of control. For example, the at least one steering correction parameter threshold may be predefined based at least on the specific information. For example, when the surrounding vehicle is large, such as a truck, the predefined threshold may be lower such that loss of control may be determined more reliably. Also, such specific information about the object may be considered for determining possible drive actions, when loss of control of a surrounding vehicle is determined and as will be explained further below.

[0007] A determination of loss of control of a surrounding vehicle may be understood herein as a prediction or identification. This means that the method may either identify the loss of control, meaning that the method came to the result that it is certain or almost certain that control of a surrounding vehicle by the driver or any possible autonomous system of that vehicle is lost. But it may also predict a loss of control meaning that it can give an indication that a loss of control in a surrounding vehicle may be happening but this must not be certain or almost certain. For example, based on the determined steering correction behavior and the comparison, the method may also indicate a likelihood of loss of control, e.g., 50%, 60%, etc. Depending on the likelihood, a road user may be informed of the possible loss of control of the surrounding vehicle or not. For example, a threshold value for the likelihood may be set to increase sensitivity for a possible alert raising to other road users.

[0008] The method may be partially or entirely carried out by an ego vehicle, in particular one or more computers or computing units of the ego vehicle. However, other devices, such as smartphones of pedestrians, vehicle infrastructure devices, etc. may also be considered for carrying out the method partially or entirely.

[0009] In the case of the ego vehicle, the ego vehicle may detect objects in its surrounding by any detection means of the vehicle, such as sensors and/or cameras, for example. The object information thereby generated includes the information about detected objects in the surrounding. The surrounding of the vehicle may be defined by the environment of the ego vehicle that is being detectable through the detection means. Accordingly, the surrounding may change during driving of the ego vehicle. The objects detected may be one or more surrounding vehicles and the road that is being travelled by the surrounding vehicle and possibly by the ego vehicle. The road may be detected by means of detecting road lane marks, traffic barriers, etc., which are also referred to herein as road objects.

[0010] The steering correction behavior of the surrounding vehicle may comprise one or more steering corrections, which the surrounding vehicle may take in the course of its driving. A steering correction may be understood as a drive action taken by the surrounding vehicle to bring the surrounding vehicle back onto the travelled road, in particular road lane. In other words, the steering correction behavior describes all the steering corrections taken by the surrounding vehicle in the course of a certain time period, which may be predefined such that it may be assigned to one driving situation of the surrounding vehicle, for which it can be assessed whether a loss of control occurred. Such a predefined time period may be provided by means of a determination timer as will be explained later in more detail. The steering corrections may be defined by at least one steering correction parameter such that they can be processed by the method. Examples of steering correction parameters will be explained further below.

[0011] In order to determine, e.g., predict or identify, loss of control of a surrounding vehicle, the one or more steering correction parameter defining the steering corrections of the surrounding vehicle are being compared to one or more respective predefined steering correction parameter thresholds. These thresholds may be based on experience or simulation, for example. Further, they may be configured such that, when the thresholds are met, the method may identify loss of control or at least based on the one or more thresholds give a prediction of a loss of control, e.g., when there are multiple steering correction parameters but not all thresholds are exceeded.

[0012] The method of the first aspect may in particular be a computer implemented method. This means that at least one, multiple or all of the steps of the method may be carried out by one or more computers or computing units, which may be included in the ego vehicle. Different steps may be carried out by the same or by different computers. A computer is herein understood as a data processing system or apparatus, which can carry out the steps as defined by the method. The one or more computers may be configured as or provided inside of one more control units of the ego vehicle. These control units may also be configured to carry out other control operations than described by the method according to the first aspect of this disclosure.

[0013] The detected objects in the surrounding may include at least one road object of the road. The method may further include calculating at least one distance of the surrounding vehicle or a bounding box fitted on the surrounding vehicle from the at least one road object, the calculated distance being used for determining the steering correction behavior. By calculating distances of the surrounding vehicle from road objects such as, for example, traffic barriers, the method may determine the steering correction behavior relative to the road objects and thereby with high reliability. The at least one distance may be calculated at the beginning of the steering correction. In this way, the measured distance(s) indicate the steering correction that needs to be performed in order to bring the surrounding vehicle back onto its travelled road lane. The road objects used for this may be repetitive road objects. Repetitive road objects along the road may be placed along the entire or part of the road such that the steering correction behavior may be determined with respect to the same type of road object along the road while the surrounding vehicle is travelling that road.

[0014] The at least one road object may be at least one road lane mark, in particular repetitive road lane marks, of a road lane of the road being travelled by the surrounding vehicle. Such one or more road lane marks may be interrupted and repeated along the road lane or a continuous road lane mark. Having road lane marks as road objects makes the method particularly reliable because these may be reliably detected and are widely provided on roads.

[0015] The object information may be based on surrounding images of the objects in the surrounding captured by a camera and said surrounding images processed by an image processor to detect the relative position of the surrounding vehicle on the road. In particular, the ego vehicle may comprise such camera and/or image processor. Accordingly, the ego vehicle may capture the surrounding images and process them so as to detect the relative position of the surrounding vehicle on the road. The detected relative position may be relative or, in other words, with respect to the road objects. Images are reliable sources to detect the relative position of the objects in the surrounding of the ego vehicle. Processing them as a source for detection makes the method particularly reliable.

[0016] The determining of the steering correction behavior may comprise determining a first steering correction and setting a determination timer for determination of further steering corrections within a time frame set by the determination timer. The steering correction behavior being determined based on multiple steering corrections and only within a set time frame has the advantage that the likelihood for false identification and poor predictions is decreased. For example, it may be required that the method determines at least two, three or more steering corrections within a narrow, specified time frame. This time frame may be specified such that it is a typical or maximum time frame, in which a loss of control may occur based on experience from recorded data or simulation. When the determination timer runs out without having determined the required number of steering corrections and/or steering corrections of a magnitude, which based on the comparison indicate loss of control, within the set time frame, the determination timer may be reset. The determination timer may then be set once again if another steering correction is determined such that the previous steering corrections from the previous determination timer do not count towards the determination of the newly determined steering correction behavior because previously it was not determined that there may be a loss of control of that particular surrounding vehicle.

[0017] The determination timer may be set if at least one steering correction parameter of the first steering correction is meeting at least one steering correction parameter threshold configured for setting the determination timer. This means that if a steering correction parameter threshold of a certain steering correction parameter of a steering correction is not met, the determination timer may not be set. By requiring that the steering correction parameter meets a certain threshold, it may be avoided that the method is triggered with the setting of a determination timer if based on the steering corrections it can be excluded or most-likely be excluded that a loss of control may occur, i.e., when the steering corrections are based on controlled driving operations, such as switching lanes, for example. Accordingly, a computer carrying out the method is not loaded heavily and thereby usage of computing resources may be optimized.

[0018] At least one steering correction parameter may be a steering correction magnitude parameter indicating the magnitude of the steering correction behavior. The steering correction magnitude may define the severity of the taken steering correction in terms of how much the surrounding vehicle is moving for that steering correction. This may indicate whether the steering correction is only minor in terms of magnitude, e.g., the driver of the surrounding vehicle has only briefly not performed a steering action to follow a curve of the road and corrected it, or if the steering correction is huge, e.g., the driver has for a longer period of time not paid attention to the traffic or road and performed a significant steering action to bring the surrounding vehicle back on the road lane to be travelled.

[0019] The at least one steering correction magnitude parameter may be determined based on a magnitude of change of the at least one distance during travel of the surrounding vehicle. Using the distance between the surrounding vehicle or its bounding box and a road object allows for an easy and reliable determination of the steering correction magnitude.

[0020] The at least one steering correction parameter may be a number of steering corrections parameter indicating a number of steering corrections per time. The number of steering corrections per time may be easily detected and is very reliable towards determining whether the surrounding vehicle has lost control. For example, when the number of steering corrections per time is big, this implies that the driver of the surrounding vehicle has difficulties controlling the vehicle indicating that he has lost control or may be losing control of the vehicle.

[0021] The at least one steering correction parameter may be a steering correction duration parameter indicating the duration of at least one single steering correction. The duration of the single steering corrections is a further easily detectable and reliable determinant for the determination of loss of control of the surrounding vehicle. For example, very short or long steering corrections may indicate that the driver of the surrounding vehicle has difficulties in controlling the vehicle.

[0022] The method may further comprise determining at least one drive action based on the predicted or identified loss of control to prevent collision with the surrounding vehicle. Such drive action may be communicated to the driver of the ego vehicle, e.g., displayed as text, symbol etc., or announced acoustically, such that the driver may take corresponding action. For example, the determined drive action may be to slow down, brake, accelerate and/or switch lanes depending on the determined position of the surrounding vehicle with determined loss of control. The ego vehicle may be provided with autonomous driving capabilities. The autonomous driving capabilities may be partial, such as holding its travelled road lane and distance towards a vehicle ahead of it, or full, meaning fully autonomous driving capabilities, in which a passenger is not required to take any action to drive the ego vehicle. In such a case, the ego vehicle may autonomously perform the determined at least one drive action to prevent collision.

[0023] The objects detected in the surroundings may further include at least one road object in the form of a road barrier, the detected road barrier being used for determining the drive action. The ego vehicle may thus consider the safest drive action given the position and possibly the likelihood of the loss of control of a surrounding vehicle as well as the position of road barriers on the road.

[0024] The method may further comprise receiving weather information for the surrounding and predefining the at least one predefined steering correction parameter threshold according to the received weather information. Such weather information may be determined based on sensors on an ego vehicle, such as a temperature sensor, and include the temperature in the environment. The weather information may alternatively or additionally include weather forecasts, which may be received wirelessly, e.g., via the internet. Thereby, the accuracy of the method in detecting loss of control of a surrounding vehicle may be further increased. For example, when snowy and/or icy road conditions are assumed based on the received weather information, the threshold may be lower because it is more likely that the driver of a surrounding vehicle loses control of the vehicle.

[0025] The method may further comprise providing broadcasting instructions about the predicted or identified loss of control of the surrounding vehicle for other road users in the area. Other road users may be vehicles or passengers, for example. The broadcasting may be performed via wireless electronic communication, in particular via a cellular network. Such communication may be performed as Car2X or Car2Car communication, for example. Alternatively, or additionally, the broadcasting may include also using the horn of the ego vehicle as communication means such that alert is raised to other road users acoustically.

[0026] The method may further include receiving a measured speed of the surrounding vehicle, identifying whether the surrounding vehicle has stopped or not based on the measured speed, and providing broadcasting information about whether the surrounding vehicle has stopped or not for other road users in the area. Accordingly, the method may be performed further after a loss of control has been determined or not such that other road users may be informed of a potential accident or an occurred accident.

[0027] According to a second aspect of this disclosure, there is provided a method for determining loss of control of a surrounding vehicle, the method according to the second aspect comprising the steps of the method according to the first aspect of this disclosure and at least one further step performed by an ego vehicle. Such a step may be, for example, the capturing of surrounding images of the objects in the surrounding by means of at least one camera of the ego vehicle. Also, the processing of said surrounding images by an image processor of the ego vehicle may be a further step in the method of the second aspect of this disclosure. Moreover, performing a determined drive action may be a step in the method of the second aspect. Another step of the method of the second aspect may be the broadcasting to other road users based on the provided broadcasting instructions, which may include information about the predicted or detected loss of control of the surrounding vehicle for other road users in the area. Also, measuring the speed of the surrounding vehicle and correspondingly broadcasting whether the vehicle has stopped or not to other road users based on the provided broadcasting information may be performed by the ego vehicle.

[0028] In contrast to the method of the first aspect of this disclosure, which may be computer implemented, the method of the second aspect of this disclosure may be carried out partially or entirely by the ego vehicle. For example, a computer or control unit in the ego vehicle may carry out the method of the first aspect, while the other steps of the method of the second aspect are carried out by a corresponding camera for taking surrounding images in the surrounding, an autonomous driving control system for performing a drive action, a wireless communication system for broadcasting and/or a measuring unit for measuring the speed of the surrounding vehicle.

[0029] According to a third aspect of this disclosure, there is provided a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method according to the first aspect of this disclosure.

[0030] The computer program product may be a computer program as such, meaning a computer program consisting of or comprising a program code to be executed by the computer. Alternatively, the computer program product may be a product such as a data storage, on which the computer program is temporarily or permanently stored.

[0031] According to a fourth aspect of this disclosure, there is provided a data processing apparatus comprising means for carrying out the method according to the first aspect of this disclosure. In particular, the data processing apparatus may execute or comprise the computer program product according to the third aspect of this disclosure.

[0032] According to a fifth aspect of this disclosure, there is provided a vehicle comprising detection means for detecting objects in its surrounding and processing means for processing the data relating to the detected objects, the vehicle being configured to carry out the method according to the first aspect and/or the second aspect of this disclosure.

[0033] The vehicle being configured to carry out the method according to the first and/or second aspect of this disclosure in particular means that the respective components of the vehicle are configured to carry out the respective steps of the method according to the first and/or second aspect of this disclosure. For example, for carrying out the method according to the first aspect of this disclosure, the vehicle may comprise the data processing apparatus according to the fourth aspect of this disclosure or a computer or computing unit, which may be part of or formed by a control unit of the vehicle. For example, for carrying out the method according to the second aspect of this disclosure, the method may include further components such as mentioned above, e.g., a camera as detection means, an image processor as or included in the processing means, an autonomous driving control system, a wireless communication system, a measuring unit, etc.

[0034] It is noted that the above aspects, examples and features may be combined with each other irrespective of the aspect involved.

[0035] The above and other aspects of the present disclosure will become apparent from and elucidated with reference to the examples described hereinafter.

[0036] Examples of the disclosure will be described in the following with reference to the following drawings illustrating representations of:
Fig. 1
a method for determining loss of control of a surrounding vehicle,
Fig. 2
further steps of the method of Fig. 1,
Fig. 3
an ego vehicle,
Fig. 4
steps of the method of Fig. 1,
Fig. 5
further steps of the method of Fig. 1,
Fig. 6
further steps of the method of Fig. 1,
Fig. 7
a driving scenario, in which a surrounding vehicle has lost control, and for which the method of Fig. 1 may be carried out,
Fig. 8
steering corrections in the driving scenario of Fig. 7, and
Fig. 9-16
further driving scenarios, for which the method of Fig. 1 is being carried out.


[0037] The figures are merely schematic representations and serve only to illustrate examples of the disclosure. Identical or equivalent elements are in principle provided with the same reference signs.

[0038] The designation of methods and steps as first, second, etc. as provided herein is merely intended to make the methods and their steps referenceable and distinguishable from one another. By no means does the designation of methods and steps constitute a limitation of the scope of this disclosure. For example, when this disclosure describes a third step of a method, a first or second step of the method do not need to be present yet alone be performed before the third step unless they are explicitly referred to as being required per se or before the third step. Moreover, the presentation of methods or steps in a certain order is merely intended to facilitate one example of this disclosure and by no means constitutes a limitation of the scope of this disclosure. Generally, unless no explicitly required order is being mentioned, the methods and steps may be carried out in any feasible order.

[0039] Figure 1 illustrates a method 100 for determining loss of control LOC of a surrounding vehicle 20, such as the one shown in Fig. 7. Loss of control LOC may occur when the driver or an autonomous driving system of the surrounding vehicle 20 is not able to fully control the surrounding vehicle 20 anymore, in particular without a risk that an accident may happen, e.g., due to the driver being under influence or the surrounding vehicle 20 swerving because of slippery roads, for example.

[0040] The method 100 of this example is computer-implemented. This means that the method 100 may be carried out entirely or at least partially by one or more computers, which may in particular be included in an ego vehicle 10 (see Fig. 9, for example), which may thereby carry out the method 100. However, the method 100 may include further steps performed by other means of the ego vehicle 10 as will be explained below.

[0041] In a first step 102 of the method 100, object information OI of a surrounding S of the ego vehicle 10 is being received (see Fig. 9, for example). The surrounding S is represented here by a detection area of the ego vehicle 10, in which the ego vehicle 10 may detect objects. The object information OI comprises information about detected objects in the surrounding S, which includes the surrounding vehicle 20 and the road 30 being travelled by the surrounding vehicle 20 and the ego vehicle 10. The road 30 may be detected through one or more road objects 34 of the road 30, in particular at least one road lane mark of a road lane 32 of the road 30 being travelled by the surrounding vehicle 20 as being shown in Fig. 9, for example. The information of the detected objects may comprise location information, in particular the absolute position or relative position of the surrounding vehicle 20 and the road 30 with respect to the ego vehicle 10 and/or to each other and/or to other objects in the surrounding S.

[0042] For detection of the objects in the surrounding S, the ego vehicle 10 may comprise corresponding detection means 12, such as one or more cameras, and processing means 14, such as an image processor, for processing the detection data recorded by the detection means 12, as may be taken from Fig. 3 schematically illustrating an ego vehicle 10 with its components. The detection of the objects in the surrounding S by means of the detection means 12 and/or the processing means 14 may be a step in the method 100.

[0043] In a second step 104 of the method 100, at least one distance D is being calculated between the surrounding vehicle 20 or a bounding box BB fitted on the surrounding vehicle 20 from the at least one road object 34. This distance D represents a deviation of the surrounding vehicle 20 from the road lane 32 and thereby a required steering correction SC to bring the surrounding vehicle 20 back onto its travelled road lane 32. This is exemplary illustrated in Figs. 4 to 6, further illustrating further steps of the method 100 as explained below. In the examples of Figs. 4 to 6, the left and right distances D of the bounding box BB fitted on the surrounding vehicle 20 from a road lane mark of the travelled lane 32 is being calculated.

[0044] The calculated distances D are now being used to determine a steering correction behavior SCB of the surrounding vehicle 20 in a third step 106 of the method 100. The steering correction behavior SCB may comprise one or more steering corrections SC, SC1, SC2, SC3 performed by the surrounding vehicle 20 and as exemplary illustrated in Figs. 7 and 8, where Fig. 8 shows the start points of the performed steering corrections SC, SC 1, SC2, SC3, for which the above explained distances D from the road objects 34 may be determined to determine the steering correction magnitude parameters SCMP of each steering correction SC, SC1, SC2, SC3.

[0045] In Fig. 7, a surrounding vehicle 20 with loss of control LOC is illustrated with its drive path along road 30, invading the opposite road lane 32 as indicated by the arrows illustrating the given direction of travel for each road lane 32. It can be seen that the surrounding vehicle 20 during travelling takes four steering actions SC1, SC2, SC3, SC4 in order to control the surrounding vehicle 20. These four steering actions SC1, SC2, SC3, SC4 are illustrated in Fig. 8 from the front and similar to Figs. 4 to 6. As shown in Figs. 4 to 6, for each start of one of the steering actions SC1, SC2, SC3, SC4, distances D of the surrounding vehicle 20 may be calculated from the respective road objects 34 of the travelled road lane 32, in this case in the form of road lane markings.

[0046] The respective steering actions SC1, SC2, SC3, SC4 are included in the steering correction behavior SCB by means of steering correction parameters SCP, which are defining the respective steering actions SC1, SC2, SC3, SC4. Such steering correction parameters SCP may be a steering correction magnitude parameter SCMP, a number of steering corrections parameter NSCP and a steering correction duration parameter SCDP, for example.

[0047] Figs. 5 and 6 illustrate the determination of the steering correction behavior SCB in the third step 106 of the method 100 by determining a steering correction magnitude parameter SCMP as steering correction parameter SCP for the different steering corrections shown in Figs. 5 and 6 having different distances D. In this case, since one of the distances D in Fig. 6 is larger than the distances D in Fig. 5, a higher steering correction magnitude parameter SCMP for Fig. 6 will be determined than for Fig. 5, for example.

[0048] When the steering correction behavior SCB was determined in terms of its steering correction parameters SCP, in a fourth step 108 of the method 100, the steering correction parameters SCP are being compared to at least one predefined steering correction parameter threshold SCPT. For example, the predefined steering correction parameter threshold SCPT may require at least one or a number of steering corrections SC1, SC2, SC3, SC4 of a certain magnitude to determine a loss of control LOC.

[0049] In a fifth step 110 of the method 100, based on the comparison, a loss of control LOC of the surrounding vehicle 20 is determined by means of prediction or identification. For example, loss of control LOC of the surrounding vehicle 20 may be predicted with a certain likelihood.

[0050] In a sixth step 112 of the method 100, a drive action DA may be determined for the ego vehicle 10 based on the predicted or identified loss of control LOC such that when the drive action DA is performed by the ego vehicle 10, a collision with the surrounding vehicle 20 may be avoided. For example, the ego vehicle 10 may have an autonomous driving system 16 as depicted in Fig. 3 to perform the drive action DA.

[0051] A further, non-depicted step of the method 100 may be to provide broadcasting instructions about the predicted or identified loss of control LOC of the surrounding vehicle 20 for other road users 40 (see Figs. 11, 12) in the area. Such broadcasting instructions may be carried out by a broadcasting system 18 of the ego vehicle 10 as depicted in Fig. 3, such that it broadcasts the location of the surrounding vehicle 20 having the loss of control LOC and/or information about the loss of control LOC to the other road users 40 in the area.

[0052] Each or single steps of the method 100 of Fig. 1 may be carried out for each determined steering correction SC1, SC2, SC3, SC4 of the surrounding vehicle 20. Determining steering corrections SC1, SC2, SC3, SC4 and carrying out the method 100 for every surrounding vehicle 20 in the surrounding S may put a high load onto a corresponding computer or computing unit of the ego vehicle 10. To limit the load imposed on a corresponding computer or computing unit of the ego vehicle 10 carrying out the method 100, the steps shown in Fig. 2 may be carried out within method 100.

[0053] First, in the third step 106, a first steering correction SC1 of a surrounding vehicle 20 is determined. Then, in the fourth step 108, the comparison of the steering correction parameter SCP for that first steering correction SC 1 with the at least one predefined steering correction parameter threshold SCPT is performed. Then, in an additional step 107 of the method 100, a determination timer DT is set if the predefined steering correction parameter threshold SCPT is met by the steering correction parameter SCP of the first steering correction SC1. In this case, the third step 106 and the fourth step 108 are continued for further steering corrections SC2, SC3, SC4 for a time frame set by the determination timer DT. Accordingly, the method 100 is only carried out for a large part or in its entirety for surrounding vehicles 20, which by virtue of their first and further steering corrections SC1, SC2, etc. are considered to be significant enough that a loss of control LOC may occur and justifies carrying out method 100.

[0054] Fig. 9 illustrates a driving scenario with a surrounding vehicle 20 losing control behind an ego vehicle 10 determining the loss of control LOC of the surrounding vehicle 20 in its surrounding S. For this particular case, the determined drive action DA may be to accelerate the ego vehicle 10 to gain distance from the surrounding vehicle 20.

[0055] Fig. 10 illustrates a driving scenario with a surrounding vehicle 20 losing control in front of an ego vehicle 10 determining the loss of control LOC of the surrounding vehicle 20 in its surrounding S. For this particular case, the determined drive action DA may be to slow down the ego vehicle 10 to gain distance from the surrounding vehicle 20.

[0056] Figs. 11 and 12 illustrate the same driving scenarios as Figs. 9 and 10 but with another road user 40 in form of another vehicle travelling on one of the oppositely directed road lanes 32 of the road 30. In both cases, the ego vehicle 10 may broadcast the determined loss of control LOC to the other road user 40 such that he may take an action to avoid collision with the surrounding vehicle 20. In both examples, the other road user 40 is switching the road lane 32 to gain distance from the surrounding vehicle 20.

[0057] Figs. 13 and 14 illustrate different driving scenarios in which the ego vehicle 10 is measuring the speed V of the surrounding vehicle 20 to identify whether the surrounding vehicle 20 has stopped or not. In the example of Fig. 13, the surrounding vehicle 20 has stopped and the ego vehicle 10 may include this information in its broadcasting. For example, the ego vehicle 10 may broadcast this information to other road users 40 and/or call an ambulance based on the assumption that the surrounding vehicle 20 crashed. In the example of Fig. 14, the surrounding vehicle 20 is continuing controlled driving.

[0058] Figs. 15 and 16 show different driving scenarios, in which a surrounding vehicle 20 has lost control. Using different steering correction parameters SCP to define the individual steering corrections SC may be advantageous in these cases to better determine the steering correction behavior SCB. In the case of Fig. 15, the steering corrections SC are smoother, taking a longer time to be performed. In the case of Fig. 16, the steering corrections SC are aggressive because they are performed quickly. These steering corrections SC, while having similar magnitudes, have a different duration and thus may be defined best when including the mentioned steering correction duration parameter SCDP.

[0059] Other variations to the disclosed examples can be understood and effected by those skilled in the art in practicing the claimed disclosure, from the study of the drawings, the disclosure, and the appended claims. In the claims the word "comprising" or "having" does not exclude other elements or steps and the indefinite article "a" or "an" does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope of the claims.

LIST OF REFERENCE SIGNS



[0060] 
10
ego vehicle
12
detection means
14
processing means
16
autonomous driving system
18
broadcasting system
20
surrounding vehicle
30
road
32
road lane
34
road object
40
road user
100
method
102-112
steps
D
distance
DA
drive action
DT
determination timer
LOC
loss of control
S
surrounding
SC
steering correction
SCB
steering correction behavior
SCP
steering correction parameter
SCMP
steering correction magnitude parameter
NSCP
number of steering corrections parameter
SCDP
steering correction duration parameter
SCPT
steering correction parameter threshold
V
speed
OI
object information



Claims

1. A method (100) for determining loss of control (LOC) of a surrounding vehicle (20), the method (100) comprising:

- receiving object information (OI) of a surrounding (S), the object information (OI) comprising information about detected objects in the surrounding (S), the objects including the surrounding vehicle (20) and a road (30) being travelled by the surrounding vehicle (20),

- determining a steering correction behavior (SCB) of the surrounding vehicle (20), the steering correction behavior (SCB) comprising at least one steering correction (SC, SC1, SC2, SC3, SC4) of the surrounding vehicle (20) and comprising at least one steering correction parameter (SCP) defining the at least one steering correction (SC, SC1, SC2, SC3, SC4),

- comparing the at least one steering correction parameter (SCP) to at least one predefined steering correction parameter threshold (SCPT), and

- predicting or identifying loss of control (LOC) of the surrounding vehicle (20) based on the comparison.


 
2. The method (100) according to claim 1, the detected objects in the surrounding (S) including at least one road object (34) of the road (30) and the method (100) including calculating at least one distance (D) of the surrounding vehicle (20) or a bounding box (BB) fitted on the surrounding vehicle (20) from the at least one road object (34), the calculated distance (D) being used for determining the steering correction behavior (SCB).
 
3. The method (100) according to claim 2, the at least one road object (34) being at least one road lane mark of a road lane (32) of the road (30) being travelled by the surrounding vehicle (20).
 
4. The method (100) according to any of the previous claims, the object information (OI) being based on surrounding images of the objects in the surrounding (S) captured by a camera and said surrounding images processed by an image processor to detect the relative position of the surrounding vehicle (20) on the road (30).
 
5. The method (100) according to any of the previous claims, the determining of the steering correction behavior (SCB) comprising determining a first steering correction (SC1) and setting a determination timer (DT) for determination of further steering corrections (SC2, SC3) within a time frame set by the determination timer (DT).
 
6. The method (100) according to claim 5, the determination timer (DT) being set if at least one steering correction parameter (SCP) of the first steering correction (SC1) is meeting at least one steering correction parameter threshold (SCPT) configured for setting the determination timer (DT).
 
7. The method (100) according to any of the previous claims, at least one steering correction parameter (SCP) being a steering correction magnitude parameter (SCMP) indicating the magnitude of the steering correction behavior (SCB).
 
8. The method (100) according to claim 2 or 3 and according to claim 7, the at least one steering correction magnitude parameter (SCMP) being determined based on a magnitude of change of the at least one distance (D) during travel of the surrounding vehicle (20).
 
9. The method (100) according to any of the previous claims, at least one steering correction parameter (SCP) being a number of steering corrections parameter (NSCP) indicating a number of steering corrections (SC, SC1, SC2, SC3) per time and/or a steering correction duration parameter (SCDP) indicating the duration of at least one single steering correction (SC, SC1, SC2, SC3).
 
10. The method (100) according to any of the previous claims, the method (100) further comprising determining at least one drive action (DA) based on the predicted or identified loss of control (LOC) to prevent collision with the surrounding vehicle (20).
 
11. The method (100) according to any of the previous claims, the method (100) further comprising receiving weather information for the surrounding (S) and predefining the at least one predefined steering correction parameter threshold (SCPT) according to the received weather information.
 
12. The method (100) according to any of the previous claims, the method (100) further comprising providing broadcasting instructions about the predicted or identified loss of control (LOS) of the surrounding vehicle (20) for other road users (30) in the area.
 
13. The method (100) according to claim 12, the method (100) further including receiving a measured speed (V) of the surrounding vehicle (20), identifying whether the surrounding vehicle (20) has stopped or not based on the measured speed (V), and providing broadcasting information about whether the surrounding vehicle (20) has stopped or not for other road users (40) in the area.
 
14. A computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method (100) according to any of the previous claims.
 
15. A vehicle (10) comprising detection means (12) for detecting objects in its surrounding (S) and processing means (14) for processing the data relating to the detected objects, the vehicle (10) being configured to carry out the method (100) according to any of claims 1 to 13.
 


Amended claims in accordance with Rule 137(2) EPC.


1. A method (100) for determining loss of control (LOC) of a surrounding vehicle (20), the method (100) comprising:

- receiving object information (OI) of a surrounding (S), the object information (OI) comprising information about detected objects in the surrounding (S) and specific information about the size and/or type of the surrounding vehicle (20), the objects including the surrounding vehicle (20) and a road (30) being travelled by the surrounding vehicle (20),

- determining a steering correction behavior (SCB) of the surrounding vehicle (20), the steering correction behavior (SCB) comprising at least one steering correction (SC, SC1, SC2, SC3, SC4) of the surrounding vehicle (20) and comprising at least one steering correction parameter (SCP) defining the at least one steering correction (SC, SC1, SC2, SC3, SC4),

- comparing the at least one steering correction parameter (SCP) to at least one predefined steering correction parameter threshold (SCPT), wherein the at least one predefined steering correction parameter threshold (SCPT) is predefined based on at least the specific information about the size and/or type of the surrounding vehicle (20), and

- predicting or identifying loss of control (LOC) of the surrounding vehicle (20) based on the comparison.


 
2. The method (100) according to claim 1, the detected objects in the surrounding (S) including at least one road object (34) of the road (30) and the method (100) including calculating at least one distance (D) of the surrounding vehicle (20) or a bounding box (BB) fitted on the surrounding vehicle (20) from the at least one road object (34), the calculated distance (D) being used for determining the steering correction behavior (SCB).
 
3. The method (100) according to claim 2, the at least one road object (34) being at least one road lane mark of a road lane (32) of the road (30) being travelled by the surrounding vehicle (20).
 
4. The method (100) according to any of the previous claims, the object information (OI) being based on surrounding images of the objects in the surrounding (S) captured by a camera and said surrounding images processed by an image processor to detect the relative position of the surrounding vehicle (20) on the road (30).
 
5. The method (100) according to any of the previous claims, the determining of the steering correction behavior (SCB) comprising determining a first steering correction (SC1) and setting a determination timer (DT) for determination of further steering corrections (SC2, SC3) within a time frame set by the determination timer (DT).
 
6. The method (100) according to claim 5, the determination timer (DT) being set if at least one steering correction parameter (SCP) of the first steering correction (SC1) is meeting at least one steering correction parameter threshold (SCPT) configured for setting the determination timer (DT).
 
7. The method (100) according to any of the previous claims, at least one steering correction parameter (SCP) being a steering correction magnitude parameter (SCMP) indicating the magnitude of the steering correction behavior (SCB).
 
8. The method (100) according to claim 2 or 3 and according to claim 7, the at least one steering correction magnitude parameter (SCMP) being determined based on a magnitude of change of the at least one distance (D) during travel of the surrounding vehicle (20).
 
9. The method (100) according to any of the previous claims, at least one steering correction parameter (SCP) being a number of steering corrections parameter (NSCP) indicating a number of steering corrections (SC, SC1, SC2, SC3) per time and/or a steering correction duration parameter (SCDP) indicating the duration of at least one single steering correction (SC, SC1, SC2, SC3).
 
10. The method (100) according to any of the previous claims, the method (100) further comprising determining at least one drive action (DA) based on the predicted or identified loss of control (LOC) to prevent collision with the surrounding vehicle (20).
 
11. The method (100) according to any of the previous claims, the method (100) further comprising receiving weather information for the surrounding (S) and predefining the at least one predefined steering correction parameter threshold (SCPT) according to the received weather information.
 
12. The method (100) according to any of the previous claims, the method (100) further comprising providing broadcasting instructions about the predicted or identified loss of control (LOS) of the surrounding vehicle (20) for other road users (30) in the area.
 
13. The method (100) according to claim 12, the method (100) further including receiving a measured speed (V) of the surrounding vehicle (20), identifying whether the surrounding vehicle (20) has stopped or not based on the measured speed (V), and providing broadcasting information about whether the surrounding vehicle (20) has stopped or not for other road users (40) in the area.
 
14. A computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method (100) according to any of the previous claims.
 
15. A vehicle (10) comprising detection means (12) for detecting objects in its surrounding (S) and processing means (14) for processing the data relating to the detected objects, the vehicle (10) being configured to carry out the method (100) according to any of claims 1 to 13.
 




Drawing

























Search report









Search report