Technical Field
[0001] The present invention relates to a management system that manages a plurality of
work machines.
Background Art
[0002] Patent Literature 1 discloses a management system of industrial vehicles that displays
a map image on a display device. In the map image, symbols indicating the positions
of a plurality of industrial vehicles are superimposed and displayed. A display aspect
of the symbol is set to be different according to operating time of the industrial
vehicle.
Citation List
Patent Literature
[0004] With the management system of Patent Literature 1, the position and the operating
time of each of the plurality of work machines are known, but the motion situation
of each of the plurality of work machines cannot be grasped.
Summary of Invention
[0005] An object of the present invention is to provide a management system that makes it
possible to grasp a motion situation of each of a plurality of work machines.
[0006] The present invention provides a management system. The management system includes
a reception device that receives information regarding a motion situation of each
of a plurality of work machines, a display device that displays an image according
to a command signal to be input, and a display control unit that inputs, to the display
device, the command signal corresponding to the motion situation of each of the plurality
of work machines based on the information received by the reception device.
Brief Description of Drawings
[0007]
FIG. 1 is a view illustrating a management system according to one embodiment of the
present invention.
FIG. 2 is a view illustrating a display group of the management system according to
the embodiment of the present invention.
FIG. 3 is a block diagram of the management system according to the embodiment of
the present invention.
FIG. 4 is a view illustrating an example of a display image displaying a motion situation
of a work machine being automatically driven.
FIG. 5 is a view illustrating an example of a display image displaying a motion situation
of a work machine being remotely controlled.
FIG. 6 is a view illustrating an example of a display image displaying a motion situation
of a work machine, and is a view illustrating a state in which a warning image is
superimposed and displayed.
FIG. 7 is a view illustrating a scene in which a target trajectory of a tip end of
a bucket and an actual trajectory of the tip end of the bucket are superimposed and
displayed on the display device.
FIG. 8 is a view illustrating an example of a display image displaying a motion situation
of a work machine, and is a view illustrating a state in which a notification image
for notifying of motion stop of the work machine is superimposed and displayed.
FIG. 9 is a view illustrating an example of a display image displaying a motion situation
of a work machine, and is a view illustrating a state in which a notification image
for notifying that the work machine is in a state of stopping motion soon is superimposed
and displayed.
Description of Embodiments
[0008] Hereinafter, a preferred embodiment of the present invention will be described with
reference to the drawings.
(Configuration of Management System)
[0009] FIG. 1 is a view illustrating a management system 100 according to the present embodiment.
As illustrated in FIG. 1, the management system 100 is a system for managing a plurality
of work machines 20. The management system 100 includes the plurality of work machines
20 and a management room 1. The management room 1 is a cockpit, for example. An operator
in the management room 1 remotely teaches motion to each of the several work machines
20. The teaching is also called direct teaching, is a teaching method in which an
operator operates an operation device described later to teach motion, and is also
called a direct instruction method. Then, the operator can remotely control the other
work machine 20 while the work machine 20 having been taught is performing automatic
drive.
[0010] The management room 1 includes a display group 2. FIG. 2 is a view illustrating the
display group 2 of the management system 100. The display group 2 includes a plurality
of displays, and these displays include a display device 3 and a remote control display
device 4. These display devices display images corresponding to command signals to
be input.
(Configuration of Work Machine)
[0011] As illustrated in FIG. 1, the work machine 20 is a hydraulic excavator, and the work
machine 20 includes a machine body 25 including a lower travelling body 21 and an
upper slewing body 22, an attachment 30, and a work drive device 40.
[0012] The lower travelling body 21 includes a pair of crawlers, and can travel on the ground
by the pair of crawlers moving. The upper slewing body 22 is slewably attached to
the lower travelling body 21 via a slewing device 24. The slewing device 24 is a slewing
drive device that slews the upper slewing body 22. The upper slewing body 22 includes
a cab (operator's room) 23 positioned at a front part thereof.
[0013] The attachment 30 is a work device and is attached to the upper slewing body 22 so
as to be able to perform work motion including vertical rotation. The attachment 30
includes a boom 31, an arm 32, and a bucket 33. The boom 31 has a base end part attached
to the upper slewing body 22 so as to be vertically rotatable (capable of being raised
and lowered) and a tip end part on the opposite side. The arm 32 has a base end part
attached to the tip end part of the boom 31 so as to be vertically rotatable with
respect to the boom 31, and a tip end part on the opposite side. The bucket 33 is
attached to the tip end part of the arm 32 so as to be rotatable in the front-rear
direction with respect to the arm 32. The bucket 33 is a tip end attachment that is
a tip end part of the attachment 30, and is a part that performs work such as excavation,
leveling, and scooping of soil. Note that the work target object held by the bucket
33 is not limited to soil, may be stones, and may be waste (industrial waste or the
like). The tip end attachment is not limited to the bucket 33, and may be a grapple,
a lifting magnet, or the like.
[0014] The work drive device 40 hydraulically moves the attachment 30 to causes the work
motion to be performed. In the present embodiment, the work drive device 40 includes
a plurality of hydraulic cylinders each of which is extendable and contractable, and
the plurality of cylinders include a boom cylinder 41, an arm cylinder 42, and a bucket
cylinder 43.
[0015] The boom cylinder 41 rotates the boom 31 with respect to the upper slewing body 22.
The boom cylinder 41 has a base end part rotatably coupled to the upper slewing body
22 and a tip end part rotatably coupled to the boom 31.
[0016] The arm cylinder 42 rotates the arm 32 with respect to the boom 31. The arm cylinder
42 has a base end part rotatably coupled to the boom 31 and a tip end part rotatably
coupled to the arm 32.
[0017] The bucket cylinder 43 rotates the bucket 33 with respect to the arm 32. The bucket
cylinder 43 has a base end part rotatably coupled to the arm 32 and a tip end part
rotatably coupled to a link member 34. The link member 34 is rotatably coupled to
the bucket 33, and couples the bucket cylinder 43 and the bucket 33 to each other.
[0018] The work machine 20 further includes a slewing angle sensor 52, which is a slewing
angle detector, and a work posture detector 60.
[0019] The slewing angle sensor 52 detects a slewing angle of the upper slewing body 22
with respect to the lower travelling body 21. The slewing angle sensor 52 is, for
example, an encoder, a resolver, or a gyro sensor. In the present embodiment, the
slewing angle of the upper slewing body 22 when the front of the upper slewing body
22 coincides with the front of the lower travelling body 21 is 0°.
[0020] The work posture detector 60 detects a work posture of the attachment 30. The work
posture detector 60 includes a boom inclination angle sensor 61, an arm inclination
angle sensor 62, and a bucket inclination angle sensor 63.
[0021] The boom inclination angle sensor 61 is attached to the boom 31 and detects a posture
of the boom 31. The boom inclination angle sensor 61 acquires an inclination angle
of the boom 31 with respect to a horizon. The boom inclination angle sensor 61 is
an inclination (acceleration) sensor, for example. Note that the work posture detector
60 may include, in place of the boom inclination angle sensor 61, a rotation angle
sensor that detects a rotation angle of a boom foot pin (boom base end) or a stroke
sensor that detects a stroke amount of the boom cylinder 41.
[0022] The arm inclination angle sensor 62 is attached to the arm 32 and detects the posture
of the arm 32. The arm inclination angle sensor 62 acquires an inclination angle of
the arm 32 with respect to a horizon. The arm inclination angle sensor 62 is an inclination
(acceleration) sensor, for example. Note that the work posture detector 60 may include,
in place of the arm inclination angle sensor 62, a rotation angle sensor that detects
a rotation angle of an arm coupling pin (arm base end) or a stroke sensor that detects
a stroke amount of the arm cylinder 42.
[0023] The bucket inclination angle sensor 63 is attached to the link member 34 and detects
the posture of the bucket 33. The bucket inclination angle sensor 63 acquires an inclination
angle of the bucket 33 with respect to a horizon. The bucket inclination angle sensor
63 is an inclination (acceleration) sensor, for example. Note that the work posture
detector 60 may include, in place of the bucket inclination angle sensor 63, a rotation
angle sensor that detects a rotation angle of a bucket coupling pin (bucket base end)
or a stroke sensor that detects a stroke amount of the bucket cylinder 43.
[0024] The work machine 20 includes a camera (image capturing device) 55. In the present
embodiment, the camera 55 is attached to the boom 31. Note that the camera 55 may
be attached to the upper slewing body 22. The camera 55 captures an image of the front
or the like of the upper slewing body 22 from the same viewpoint as or a viewpoint
close to the operator positioned in the cab 23.
(Configuration of Management System)
[0025] FIG. 3 is a block diagram of the management system 100. As illustrated in FIG. 3,
the work machine 20 includes a work machine side control unit 11, a work machine side
communication device 12, and a storage device 13.
[0026] Information regarding the slewing angle (posture) of the upper slewing body 22 with
respect to the lower travelling body 21 detected by the slewing angle sensor 52 is
input to the work machine side control unit 11. Information regarding the posture
of the boom 31 detected by the boom inclination angle sensor 61 is input to the work
machine side control unit 11. Information regarding the posture of the arm 32 detected
by the arm inclination angle sensor 62 is input to the work machine side control unit
11. Information regarding the posture of the bucket 33 detected by the bucket inclination
angle sensor 63 is input to the work machine side control unit 11.
[0027] Image data captured by the camera 55 is input to the work machine side control unit
11.
[0028] When the work machine 20 is automatically driven, the work machine side control unit
11 automatically controls the work machine 20. The work machine side control unit
11 controls the upper slewing body 22 and the attachment 30 so that the upper slewing
body 22 and the attachment 30 perform a series of motions. The work machine side control
unit 11 automatically moves the slewing device 24 and the attachment 30 based on detection
values of the slewing angle sensor 52 and the work posture detector 60. In the present
embodiment, the series of motions is a motion of excavating soil and removing the
soil.
[0029] On the other hand, when the work machine 20 is remotely controlled, the work machine
side control unit 11 controls the movement of each of the upper slewing body 22 and
the attachment 30 in accordance with an instruction from the management room 1.
[0030] The work machine side communication device 12 can communicate with a management room
side communication device 9 described later of the management room 1. The storage
device 13 stores work content remotely taught from the management room 1. Specifically,
the storage device 13 stores a target trajectory of the tip end of the bucket 33.
The target trajectory of the tip end of the bucket 33 will be described later.
[0031] The management room 1 includes a management room side control unit 7, an operation
device 8, and the management room side communication device 9.
[0032] The operation device 8 includes a device necessary for remotely operating the work
machine 20 such as an operation lever and an operation button. The operation device
8 receives an input of an operation for remotely controlling the work machine 20.
Note that the operator remotely operates at least one work machine 20 of the plurality
of work machines 20 using the operation device 8. The management room side communication
device 9 can communicate with the work machine side communication device 12 of the
work machine 20.
[0033] When teaching is performed from the management room 1, the work machine 20 is set
to a teaching mode by a remote operation from the management room 1. When the work
machine 20 is set to the teaching mode, the operator remotely controls the work machine
20 by operating the operation device 8. When the work machine 20 is remotely controlled,
a landscape captured by the camera 55 is displayed on the display group 2. The operation
content by the remote control is stored in the storage device 13. Thereafter, the
work machine 20 is set to an automatic drive mode by a remote operation from the management
room 1. When the work machine 20 is set to the automatic drive mode, the work machine
20 performs automatic drive in accordance with a movement taught in advance.
[0034] Here, the management room side control unit (target trajectory setting unit) 7 sets
the target trajectory of the tip end of the bucket 33 by teaching. During automatic
drive, a series of motions is performed by moving the upper slewing body 22 and the
attachment 30 such that the tip end of the bucket 33 draws a preset target trajectory.
Note that in the present embodiment, the target trajectory is set with the tip end
of the bucket 33 as a specific site of the attachment 30, but the specific site of
the attachment 30 is not limited to the tip end of the bucket 33.
[0035] In the present embodiment, a series of motions performed by the work machine 20 is
to repeat motions such as excavating (excavate) soil from a soil pit (not illustrated)
with the bucket 33, slewing (lift slewing) the upper slewing body 22 toward a dump
truck (not illustrated) while holding the soil, removing (soil removal) soil to a
loading platform (not illustrated) of the dump truck, and slewing (return slewing)
the upper slewing body 22 toward the soil pit.
[0036] A series of motions by automatic drive has a plurality of motion phases (motion content).
As described above, in a series of motions from soil excavation to soil removal, the
plurality of motion phases include excavation, lift slewing, soil removal, and return
slewing.
[0037] While automatic drive is performed in each of the plurality of work machines 20,
the operator in the management room 1 can remotely control the other work machines
20 by operating the operation device 8. At this time, the management room side control
unit 7 causes the remote control display device 4 to display an image captured by
the camera 55 mounted on the work machine 20 to be remotely controlled. The operator
in the management room 1 can suitably control the work machine 20 to be remotely controlled
while viewing the remote control display device 4.
[0038] While automatic drive is performed in each of the plurality of work machines 20,
the management room side communication device (reception device) 9 receives information
(signal) regarding the motion situation from each of the work machines 20. Here, the
motion situation includes a plurality of items. The plurality of items include current
work content, a motion phase, and a work progress situation (remaining number of times
and the like).
[0039] The management room side communication device 9 receives information regarding the
motion situation also from the work machine 20 remotely controlled by the operator
in the management room 1. Note that the management room side communication device
9 may receive information regarding the motion situation from the work machine 20
controlled by an operator, on board in the cab 23, different from the operator in
the management room 1, the work machine 20 remotely controlled by an operator different
from the operator in the management room 1 from another management room 1, or the
like.
[0040] Here, from detection values of the slewing angle sensor 52 and the work posture detector
60, the work machine side control unit 11 determines as to which of excavation, lift
slewing, soil removal, and return slewing the motion phase is. Note that the work
machine side control unit 11 may determine the motion phase from operation pressure
of the work drive device 40.
[0041] By inputting, to the display device 3, a command signal corresponding to an image
indicating the motion situation of each of the plurality of work machines 20, the
management room side control unit (display control unit) 7 displays the image on the
display device 3. This enables the operator in the management room 1 to grasp the
motion situation of each of the plurality of work machines 20. Note that also in subsequent
image display, similarly to the above, the image is displayed by inputting, to each
display device, a command signal corresponding to a display image from each control
unit.
[0042] Here, the management room side control unit 7 changes the item of the motion situation
to be displayed on the display device 3 in accordance with whether or not the work
machine 20 is being automatically driven. FIGS. 4 and 5 are views illustrating a display
image 70. When the work machine 20 is being automatically driven, as illustrated in
FIG. 4, the management room side control unit 7 displays, on the display device 3,
the display image 70 displaying each of the current work content, the motion phase,
and the work progress situation. On the other hand, when the work machine 20 is not
being automatically driven (when remotely controlled), the management room side control
unit 7 displays, on the display device 3, a display image 71 displaying only the current
work content as illustrated in FIG. 5. The display images 70 and 71 illustrated in
FIGS. 4 and 5 are displayed on the display device 3 for each of the plurality of work
machines 20.
[0043] Since the operator in the management room 1 performs remote control by himself, he
can grasp the motion phase of the work machine 20 being remotely controlled and the
progress situation of the work even if the information is not displayed on the display
device 3. Therefore, for the work machine 20 not being automatically driven (being
remotely controlled), by decreasing the number of items displayed on the display device
3 as compared with the work machine 20 being automatically driven, it is possible
to cause the operator to visually recognize information excluding unnecessary information.
On the other hand, for the work machine 20 being automatically driven, by increasing
the number of items displayed on the display device 3 as compared with the work machine
20 not being automatically driven, it is possible to cause the operator to grasp the
motion situation of the work machine 20 being automatically driven in detail.
[0044] In particular, in the present embodiment, when the work machine 20 is being automatically
driven, the motion phase of the work machine 20 is displayed on the display device
3, and therefore, the operator can grasp whether or not the work machine 20 being
automatically driven normally moves by recognizing whether or not the motion phase
is normally switched.
[0045] Returning to FIG. 3, the management room side control unit (abnormality detection
unit) 7 detects a motion abnormality of the work machine 20 being automatically driven.
For example, when the motion phase is not switched for a certain period of time (e.g.,
10 seconds), the management room side control unit 7 determines that the work machine
20 being automatically driven is stopped as an example of the motion abnormality.
When the work progress situation (remaining number of times and the like) does not
change for a certain period of time (e.g., 10 seconds), the management room side control
unit 7 determines that the work machine 20 being automatically driven is stopped as
an example of the motion abnormality.
[0046] When detecting a motion abnormality, the management room side control unit (abnormality
notification unit) 7 notifies the detection result. Specifically, the management room
side control unit 7 displays, on the display device 3, the detection result of the
motion abnormality or emits a sound from a speaker provided in the management room
1. FIG. 6 is a view illustrating the display image 70. As illustrated in FIG. 6, the
management room side control unit 7 superimposes and displays a warning image 80 onto
the display image 70. Note that the management room side control unit 7 may display
the display image 70 surrounded with a frame in red or the like, or may use a different
background color of a corresponding part (motion phase, progress situation of work,
or the like) of the display image 70.
[0047] As a result, by viewing the display device 3, the operator can grasp an abnormality
having occurred in the motion of the work machine 20 being automatically driven. Therefore,
by switching the work machine 20 to remote operation, the operator can solve the abnormality
by himself.
[0048] For example, when an abnormality occurs in the motion of the work machine 20 being
automatically driven, the operator having viewed the display device 3 and recognized
the abnormality first safely stops the work machine 20 remotely controlled by the
operator himself. Then, the operator switches from the work machine 20 in which the
remote control target is stopped to the work machine 20 in which the abnormality has
occurred. Then, by remotely controlling the work machine 20 in which the abnormality
has occurred, the operator can solve the abnormality.
[0049] Note that when an abnormality occurs in the motion of the work machine 20 being automatically
driven, the management room side control unit 7 may switch the image displayed on
the remote control display device 4 in FIG. 2 from the image captured by the camera
55 of the work machine 20 to be remotely controlled to the image captured by the camera
55 of the work machine 20 in which the abnormality has occurred. As an example, the
remote control display device 4 has an image region larger than that of the display
device 3, and therefore an image captured by the camera 55 of the work machine 20
in which an abnormality has occurred is displayed on the remote control display device
4, whereby the operator can grasp details of the abnormality content.
[0050] The motion situation received by the management room side communication device 9
includes an actual trajectory of the tip end of the bucket 33. The management room
side control unit 7 acquires the target trajectory of the tip end of the bucket 33
stored in advance by the storage device 13 of the work machine 20 via the management
room side communication device 9. Then, the management room side control unit 7 superimposes
and displays, on the display device 3, the target trajectory of the tip end of the
bucket 33 and the actual trajectory of the tip end of the bucket 33.
[0051] FIG. 7 illustrates a screen on which a target trajectory 75 of the tip end of the
bucket 33 and an actual trajectory 76 of the tip end of the bucket 33 that are superimposed
and displayed on, for example, the display device 3 or the remote control display
device 4. The operator can grasp whether or not an abnormality has occurred in the
motion of the work machine 20 by comparing the target trajectory 75 with the actual
trajectory 76. When the work machine 20 in which the abnormality has occurred is being
automatically driven, the abnormality can be solved by switching this work machine
20 to remote operation or the like.
[0052] Returning to FIG. 3, the management room side control unit (stop detection unit)
7 detects motion stop of the work machine 20 being automatically driven. The work
machine side control unit 11 of the work machine 20 being automatically driven stops
the motion of the work machine 20 when a predetermined end condition is established.
This information is transmitted to the management room side control unit 7 of the
management room 1, whereby the motion stop of the work machine 20 being automatically
driven is detected.
[0053] FIG. 8 is a view illustrating the display image 70. As illustrated in FIG. 8, when
the remaining number of times, which is a progress situation of work, becomes "0",
the work machine side control unit 11 stops the motion of the work machine 20 being
automatically driven. Note that when a designated work time has elapsed or when excavation
of a designated amount of soil is finished, the work machine side control unit 11
may stop the motion of the work machine 20 being automatically driven. Note that the
total amount of excavated soil may be calculated by capturing an image of the soil
in the bucket 33 with the camera 55, predicting the amount of soil excavated by the
bucket 33, and accumulating the amount, or may be calculated from a change amount
(decrease amount) from the time of work start of the soil amount inside the soil pit
captured by the camera 55.
[0054] When the inside of the soil pit is captured by LiDAR or the like and it is detected
that the excavation target soil no longer exists, the work machine side control unit
11 may stop the motion of the work machine 20 being automatically driven. The work
machine side control unit 11 may capture an image of the inside of the soil pit with
the camera 55 or the like, and stop the motion of the work machine 20 being automatically
driven when the soil accumulates at a position (position not included in teaching)
where excavation cannot be performed by automatic drive. The work machine side control
unit 11 may capture an image of a soil removal location with the camera 55 or the
like, and stop the motion of the work machine 20 being automatically driven when the
soil accumulates to a height at which the soil can no longer discharged.
[0055] When detecting the motion stop of the work machine 20 being automatically driven,
the management room side control unit (stop notification unit) 7 notifies the detection
result. Specifically, the management room side control unit 7 displays, on the display
device 3, the detection result of the motion stop or emits a sound from the speaker
provided in the management room 1. In the present embodiment, as illustrated in FIG.
8, the management room side control unit 7 superimposes and displays a notification
image 81 on the display image 70. Note that the management room side control unit
7 may display the display image 70 surrounded with a frame in red or the like, or
may use a different background color of a corresponding part (progress situation of
work or the like) of the display image 70.
[0056] By viewing the display device 3, the operator can grasp the motion of the work machine
20 being automatically driven having been stopped. Therefore, it is possible to resume
the motion of the work machine 20 by switching to the remote operation. As a result,
idle time of the work machine 20 being automatically driven can be shortened as compared
with the case where the motion stop of the work machine 20 being automatically driven
is not notified.
[0057] Note that when detecting the motion stop of the work machine 20 being automatically
driven, the management room side control unit 7 may switch the image displayed on
the remote control display device 4 of FIG. 2 from the image captured by the camera
55 of the work machine 20 to be remotely controlled to the image captured by the camera
55 of the work machine 20 whose motion has been stopped. Also in this case, the image
captured by the camera 55 of the work machine 20 whose motion has been stopped is
displayed on the remote control display device 4, whereby the operator can grasp the
work situation in detail at the time of motion stop.
[0058] When resuming the motion of the work machine 20 being automatically driven, the operator
supports the resumption of the motion by remotely operating this work machine 20.
Specifically, the operator shapes the soil for easy excavation, moves the soil to
a position where excavation is easy, and levels the soil at the soil removal location.
The operator causes the work machine 20 to travel to a position where work is easy.
Note that also in this case, it is desirable for the operator to first safely stop
the work machine 20 remotely controlled by the operator himself before supporting
the resumption of the motion.
[0059] Here, when the motion stop of another work machine 20 being automatically driven
is notified at a timing when the operator is performing some motion of one work machine
20 by remote control, there is a risk of troubling the remote control by the operator
because the operator is surprised or the concentration of the operator on the operation
is disturbed. Therefore, at the timing when the motion of the work machine 20 remotely
controlled by the operation device 8 is interrupted, the management room side control
unit 7 notifies the detection result of the motion stop. This can suppress a trouble
from occurring in the remote control by the operator.
[0060] Here, the timing at which the motion of the work machine 20 remotely controlled is
interrupted is a timing at which the operation lever becomes neutral, a timing at
which lock of the operation lever is on, a timing at which the work machine 20 is
in an idling state, or the like.
[0061] After the motion of the work machine 20 being automatically driven is stopped and
when the operator is notified of that effect, the idle time until the motion of the
work machine 20 is resumed becomes long, and there is a possibility that the work
efficiency deteriorates.
[0062] Therefore, the management room side control unit (pre-stop state detection unit)
7 may detect that the work machine 20 being automatically driven is in a state of
stopping the motion soon, not after the motion stop. In this case, when the predetermined
end condition is established soon, the work machine side control unit 11 of the work
machine 20 being automatically driven transmits the information to the management
room side control unit 7 of the management room 1. This enables the management room
side control unit 7 to detect that the work machine 20 being automatically driven
is in a state of stopping the motion soon.
[0063] FIG. 9 is a view illustrating the display image 70. As illustrated in FIG. 9, when
the remaining number of times, which is the progress situation of work, becomes, for
example, "3", the work machine side control unit 11 determines that the work machine
20 being automatically driven is in a state of stopping motion soon, and notifies
the management room side control unit 7 of the management room 1 of the information.
Note that when the designated work time has the remaining 1 minute, for example, or
when 95%, for example, of the designated amount of soil has been excavated, the work
machine side control unit 11 may determine that the work machine 20 being automatically
driven is in a state of stopping the motion soon and notify the management room side
control unit 7 of the management room 1 of the information.
[0064] When capturing the inside of the soil pit by LiDAR or the like and detecting that
the excavation target soil no longer exists soon, the work machine side control unit
11 may determine that the work machine 20 being automatically driven is in a state
of stopping the motion soon and notify the management room side control unit 7 of
the management room 1 of the information. When the soil removal location is captured
with the camera 55 or the like, and the soil accumulates to, for example, 90% of the
height at which soil can be no longer removed, the work machine side control unit
11 may determine that the work machine 20 being automatically driven is in a state
of stopping the motion soon and notify the management room side control unit 7 of
the management room 1 of the information.
[0065] When detecting that the work machine 20 being automatically driven is in a state
of stopping motion soon, the management room side control unit (pre-stop notification
unit) 7 notifies the detection result. Specifically, the management room side control
unit 7 displays, on the display device 3, a detection result indicating that the work
machine 20 being automatically driven is in a state of stopping motion soon or emits
a sound from the speaker provided in the management room 1. In the present embodiment,
as illustrated in FIG. 9, the management room side control unit 7 superimposes and
displays a notification image 82 on the display image 70. Note that the management
room side control unit 7 may display the display image 70 surrounded with a frame
in red or the like, or may use a different background color of a corresponding part
(progress situation of work or the like) of the display image 70.
[0066] By viewing the display device 3, the operator can grasp that the motion of the work
machine 20 being automatically driven is stopped soon. Therefore, it is possible to
perform, in advance, preparation for remote control of this work machine 20 so that
the motion can be resumed soon after this work machine 20 stops the motion. As a result,
it is possible to shorten the idle time of the work machine 20 being automatically
driven as compared with a case where it is not notified that the work machine 20 being
automatically driven is in a state of stopping motion soon.
[0067] Note that when detecting that the work machine 20 being automatically driven is in
a state of stopping motion soon, the management room side control unit 7 may switch
the image displayed on the remote control display device 4 from the image captured
by the camera 55 of the work machine 20 being remotely controlled to the image captured
by the camera 55 of the work machine 20 in the state of stopping motion soon. The
image captured by the camera 55 of the work machine 20 in the state of stopping motion
soon is displayed on the remote control display device 4, whereby the operator can
grasp the work situation in detail in a state where the motion is stopped soon.
[0068] Here, when it is notified that another work machine 20 being automatically driven
is in a state of stopping the motion soon at a timing when the operator is performing
some motion of one work machine 20 by remote control, there is a risk of troubling
the remote control by the operator because the operator is surprised or the concentration
of the operator on the operation is disturbed. Therefore, at the timing when the motion
of the work machine 20 remotely controlled by the operation device 8 is interrupted,
the management room side control unit 7 notifies the detection result that the work
machine 20 being automatically driven is in a state of stopping the motion soon. This
can suppress a trouble from occurring in the remote control by the operator.
<Modifications>
[0069] In the above description, when an abnormality occurs in the motion of the work machine
20 being automatically driven, the management room side control unit 7 switches the
remote control target to the work machine 20 in which the abnormality has occurred,
and may switch the remote control target also in the following cases. For example,
the work machine 20 that automatically performs a series of motions from excavation
to soil removal waits for a dump truck while the dump truck to serve as a soil removal
destination is absent. If the dump truck approaches when the work machine 20 being
automatically driven is waiting for the dump truck, the work machine side control
unit 11 having recognized the approaching dump truck from the image of the camera
55 transmits, to the management room 1, a signal indicating that the dump truck has
arrived. Upon recognizing the signal, the operator in the management room 1 safely
stops the work machine 20 remotely controlled by the operator himself, and switches
the work machine 20 of the remote control target to the work machine 20 that has transmitted
the signal. Then, by remotely controlling the work machine 20 that has transmitted
the signal, the operator starts the automatic drive including soil removal to the
dump truck having arrived.
[0070] In the above description, an aspect in which displaying the display images 70 and
71 on the display device 3 causes the operator to grasp the motion situation of each
of the plurality of work machines 20 has been described as illustrated in FIGS. 4
and 5, but the management room side control unit 7 may display a map image on the
display device 3, superimpose and display an icon indicating the work machine 20 on
the map image, and display an image representing the motion situation in the vicinity
of this icon. The icon indicating the work machine 20 is displayed in the position
of the work machine 20 on the map image. The position of the work machine 20 may be
acquired by mounting a GNSS or the like on the work machine 20.
[0071] In the present embodiment, an aspect in which the management system includes the
work machine side control unit 11 and the management room side control unit 7 has
been described as illustrated in FIG. 3, but the function executed by one of the control
units may be executed by the other control unit.
[0072] As described above, according to the management system 100 according to the present
embodiment, the motion situation of each of the plurality of work machines 20 is displayed
on the display device 3. This enables the operator in the management room 1 to grasp
the motion situation of each of the plurality of work machines 20. Therefore, after
remotely teaching motion to each of the several work machines 20, the operator in
the management room 1 can further remotely operate the other work machines 20 while
these work machines 20 perform automatic drive. At this time, the operator in the
management room 1 or the like can grasp the motion situation of the work machine 20
performing automatic drive.
[0073] In the present embodiment, the item to be displayed on the display device 3 is changed
in accordance with whether or not the work machine 20 is being automatically driven.
For example, in a case where the work machine 20 is automatically driven, the number
of items to be displayed on the display device 3 is increased as compared with a case
where the work machine 20 is not automatically driven, whereby it is possible to cause
the operator to grasp the motion situation in detail of the work machine 20 being
automatically driven. For example, when the work machine 20 is not automatically driven,
in other words, when the operator remotely operates the work machine 20 by himself,
the number of items to be displayed on the display device 3 is reduced as compared
with a case where the work machine 20 is being automatically driven, whereby it is
possible to cause the operator to grasp information excluding unnecessary information.
[0074] In the present embodiment, when the work machine 20 is being automatically driven,
the motion phase (motion content) of the work machine 20 is displayed on the display
device 3. For example, when the work machine 20 being automatically driven performs
a series of motions from excavation to soil removal, the operator can grasp whether
or not the work machine 20 being automatically driven is normally moving by recognizing
whether or not the motion phase is normally switched based on the display of the display
device 3.
[0075] In the present embodiment, when a motion abnormality of the work machine 20 being
automatically driven is detected, the detection result is notified. This enables the
operator to grasp an abnormality having occurred in the motion of the work machine
20 being automatically driven. Therefore, it is possible to solve the abnormality
by remotely operating this work machine 20.
[0076] When the motion stop of the work machine 20 being automatically driven is detected,
the detection result is notified. This enables the operator to grasp the motion of
the work machine 20 being automatically driven having been stopped. Therefore, the
motion can be resumed by remotely operating this work machine 20. As a result, idle
time of the work machine 20 being automatically driven can be shortened as compared
with the case where the motion stop of the work machine 20 being automatically driven
is not notified.
[0077] In the present embodiment, at the timing when the motion of the work machine 20 remotely
controlled by the operation device 8 is interrupted, the motion stop of the work machine
20 being automatically driven is notified. When the motion stop of the work machine
20 being automatically driven is notified at a timing when the operator is performing
some motion of the work machine 20 by remote control, there is a risk of troubling
the remote control by the operator because the operator is surprised or the concentration
of the operator on the operation is disturbed. Therefore, at the timing when the motion
of the work machine 20 being remotely controlled is interrupted, the motion stop of
the work machine 20 being automatically driven is notified, whereby it is possible
to suppress a trouble from occurring in the remote control by the operator.
[0078] When detecting that the work machine 20 being automatically driven is in a state
of stopping motion soon, the detection result is notified. This enables the operator
to grasp the motion of the work machine 20 being automatically driven stopping soon.
Therefore, it is possible to perform, in advance, preparation for remote control of
this work machine 20 so that the motion can be resumed soon after this work machine
20 stops the motion. As a result, it is possible to shorten the idle time of the work
machine 20 being automatically driven as compared with a case where it is not notified
that the work machine 20 being automatically driven is in a state of stopping motion
soon.
[0079] At the timing when the motion of the work machine 20 remotely controlled by the operation
device 8 is interrupted, it is notified that the work machine 20 being automatically
driven is in a state of stopping the motion soon. When it is notified that the work
machine 20 being automatically driven is in a state of stopping the motion soon at
a timing when the operator is performing some motion of the work machine 20 by remote
control, there is a risk of troubling the remote control by the operator because the
operator is surprised or the concentration of the operator on the operation is disturbed.
Therefore, at the timing when the motion of the work machine 20 remotely controlled
is interrupted, it is notified that the work machine 20 being automatically driven
is in a state of stopping the motion soon, whereby it is possible to suppress a trouble
from occurring in the remote control by the operator.
[0080] In the present embodiment, the target trajectory 75 of the tip end of the bucket
33 and the actual trajectory 76 of the tip end of the bucket 33 are superimposed and
displayed on the display device 3. This enables the operator to grasp whether or not
an abnormality has occurred in the motion of the work machine 20 by comparing the
target trajectory 75 with the actual trajectory 76. When the work machine 20 in which
the abnormality has occurred is being automatically driven, the abnormality can be
solved by switching this work machine 20 to remote operation or the like.
[0081] An image captured by the camera 55 mounted on the work machine 20 to be remotely
controlled is displayed on the remote control display device 4. The operator in the
management room 1 can suitably control the work machine 20 to be remotely controlled
while viewing the remote control display device 4.
[0082] Although the embodiment of the present invention has been described above, only specific
example has been described, and the present invention is not particularly limited
to the embodiment, and a specific configuration and the like can be modified in design
as appropriate. The actions and effects described in the embodiment of the invention
merely recite the most suitable actions and effects resulting from the present invention,
and the actions and effects according to the present invention are not limited to
those described in the embodiment of the present invention.
[0083] The present invention provides a management system. The management system includes
a reception device that receives information regarding a motion situation of each
of a plurality of work machines, a display device that displays an image according
to a command signal to be input, and a display control unit that inputs, to the display
device, the command signal corresponding to the motion situation of each of the plurality
of work machines based on the information received by the reception device.
[0084] In the above configuration, the motion situation may include a plurality of items,
and the display control unit may change the item to be displayed on the display device
according to whether or not the work machine is automatically driven.
[0085] In the above configuration, the motion situation may include motion content of the
work machine, and the display control unit may display the motion content on the display
device when the work machine is being automatically driven.
[0086] The above configuration may further include an abnormality detection unit that detects
a motion abnormality of the work machine being automatically driven among the plurality
of work machines, and an abnormality notification unit that notifies a detection result
of the abnormality detection unit when the abnormality detection unit detects the
motion abnormality of the work machine.
[0087] The above configuration may further include a stop detection unit that detects a
motion stop of the work machine being automatically driven among the plurality of
work machines, and a stop notification unit that notifies a detection result of the
stop detection unit when the stop detection unit detects the motion stop of the work
machine.
[0088] The above configuration may further include an operation device that receives an
input of an operation for remotely controlling at least one work machine among the
plurality of work machines, and the stop notification unit may notify a detection
result of the stop detection unit at a timing when a motion of the at least one work
machine remotely controlled by the operation device is interrupted.
[0089] The above configuration may further include a pre-stop state detection unit that
detects that the work machine being automatically driven among the plurality of work
machines is in a state of stopping motion soon, and a pre-stop notification unit that
notifies a detection result of the pre-stop state detection unit when the pre-stop
state detection unit detects that the work machine is in a state of stopping motion
soon.
[0090] The above configuration may further include an operation device that receives an
input of an operation for remotely controlling at least one work machine among the
plurality of work machines, and the pre-stop notification unit may notify a detection
result of the pre-stop state detection unit at a timing when a motion of the at least
one work machine remotely controlled by the operation device is interrupted.
[0091] In the above configuration, the work machine may include a lower travelling body,
an upper slewing body slewably attached on the lower travelling body, and an attachment
rotatably attached to the upper slewing body, a target trajectory setting unit that
sets a target trajectory of a specific site of the attachment is further included,
the motion situation includes an actual trajectory of the specific site, and the display
control unit superimposes and displays, on the display device, a target trajectory
of the specific site and an actual trajectory of the specific site.
[0092] The above configuration may further include an operation device that receives an
input of an operation for remotely controlling at least one work machine among the
plurality of work machines, and a remote control display unit that displays an image
captured by an image capturing device mounted on the work machine remotely controlled
by the operation device.
[0093] According to the present invention, the motion situation of each of the plurality
of work machines is displayed on the display device. This enables the operator of
the management system to grasp the motion situation of each of the plurality of work
machines.