Field of the Invention
[0001] The present invention belongs to the field of maintenance and overhaul of power system
equipment, relates to the field of transmission line inspection of unmanned aerial
vehicles, and particularly relates to a centralized monitoring system and monitoring
method for transmission line inspection of unmanned aerial vehicles.
Background of the Invention
[0002] Unmanned aerial vehicle line inspection plays an increasingly important role in transmission
line inspection. An unmanned aerial vehicle line inspection system can partially replace
a line inspection worker and a manned aerial vehicle line inspection system, can inspect
a transmission and transformation line at the right time, find faults and hidden troubles
of the line in time, and transmit back the onsite condition to a ground control center
in time, in order to make right judgments and remove the line faults in time. The
workload of power service personnel can be greatly relieved to reduce the probability
of personnel risks that may occur, reduce the maintenance cost of power equipment
and improve the safety and reliability of a power grid.
[0003] There is a certain risk for adopting the unmanned aerial vehicle in the transmission
line inspection, particularly in the transmission line inspection of mountain areas,
plateaus and other areas with harsh natural environments and varied climates. The
transmission line inspection of the unmanned aerial vehicle at home and abroad is
in a pilot and assessment stage, and operation parameters of unmanned aerial vehicle
inspection, especially the flight state information of the unmanned aerial vehicle,
the pod state information, the inspection result data of the unmanned aerial vehicle
and the like need to be collected and stored at this stage, in order to achieve effective
monitoring of the unmanned aerial vehicle inspection. In order to comprehensively
assess and analyze the technical economy and reliability of the existing unmanned
aerial vehicle line inspection, provide supports for improving the operation management
of the unmanned aerial vehicle line inspection and achieve the safe and reliable operation
of the unmanned aerial vehicle line inspection, centralized monitoring needs to be
carried out on the unmanned aerial vehicle inspection by modem technical means and
management methods.
[0004] At present, monitoring systems for unmanned aerial vehicle line inspection are few
at home, the majority of various provided methods are in the testing stage, and are
used for monitoring a single unmanned aerial vehicle instead of carrying out centralized
monitoring on a plurality of inspection unmanned aerial vehicles. The monitored objects
are generally image data of the unmanned aerial vehicle inspection, the monitoring
on the state information of the unmanned aerial vehicle inspection, the pod information
and the meteorological information is little, and the informatization and automation
degrees on the inspection result data processing are low.
[0005] The patent "unmanned aerial vehicle monitoring system for power line inspection"
with an application number
201120477071.2 is proposed to carry out real-time video monitoring on the unmanned aerial vehicle
by a ground monitoring system. The patent "wireless video monitoring system for unmanned
aerial vehicle" with an application number
201120186312.8 is proposed to carry out real-time remote video monitoring on the unmanned aerial
vehicle in a WCDMA communication mode. The monitoring means and monitored objects
of both the patents are single, and the state information of the unmanned aerial vehicle
inspection, particularly the flight state information of the unmanned aerial vehicle,
the pod state information, the ground mobile substation station and the like cannot
be comprehensively reflected by the video monitoring.
[0006] In the patent "real-time positioning and monitoring management system for unmanned
aerial vehicles" with an application number
201020519831.7, the GPS positioning information of the unmanned aerial vehicles is uploaded to the
monitoring system in real time by wireless communication for positioning and monitoring
a plurality of unmanned aerial vehicles. The monitoring of the system is only directed
to the GPS information of the unmanned aerial vehicles, so the real-time flight state
information of the unmanned aerial vehicles cannot be effectively monitored, and the
patent is not applied to a power system.
[0007] In the patent "real-time unmanned aerial vehicle line inspection system" with an
application number
201010595330.1, the real-time monitoring of unmanned aerial vehicle line inspection data is achieved
by a ground control station, and the inspection image information is uploaded to the
internet through a 3G channel, so that only remote image monitoring can be achieved,
but effective remote monitoring of the state information of the unmanned aerial vehicle,
the pod state information and the ground mobile substation information cannot be achieved.
The system involved in the patent does not carry out subsequent automatic processing
on the inspection result data, and particularly, only one-to-one monitoring can be
achieved between the monitoring system and the unmanned aerial vehicle, so the inspection
information of a plurality of unmanned aerial vehicles cannot be effectively monitored
at the same time.
[0008] In summary, the effects of the existing monitoring methods of the unmanned aerial
vehicle inspection are not satisfactory, and there are a lot of problems to be solved.
Summary of the Invention
[0009] The objective of the present invention is to overcome the shortcomings in the prior
art and provide a centralized monitoring system and monitoring method for transmission
line inspection of unmanned aerial vehicles. In a manner of combining remote centralized
monitoring and local monitoring, centralized monitoring is carried out on flight states,
pod states, transmission lines, inspection results and other information of more than
one accessed unmanned aerial vehicle for line inspection, so as to reinforce the informatization
and automation degrees of the unmanned aerial vehicle inspection process and inspection
result processing, improve the unmanned aerial vehicle inspection efficiency, and
provide technical supports for achieving safe and reliable operation of unmanned aerial
vehicle line inspection.
[0010] To achieve the above objective, the present invention adopts the following technical
solutions.
[0011] A centralized monitoring system for transmission line inspection of unmanned aerial
vehicles includes a centralized monitoring subsystem, mobile substations and unmanned
aerial vehicle flight platforms. The centralized monitoring subsystem is connected
with the mobile substations in a one-to-many mode, and the mobile substations are
connected with the unmanned aerial vehicle flight platforms in a one-to-one mode.
[0012] Wherein, the centralized monitoring subsystem is used for accessing the state information
and inspection data of the mobile substation and the unmanned aerial vehicle flight
platform, planning and synchronizing an unmanned aerial vehicle inspection task, carrying
out real-time remote monitoring on the mobile substation and the unmanned aerial vehicle
flight platform for the unmanned aerial vehicle inspection, carrying out defect diagnosis,
statistics, analysis and display on the inspection data, and describing a real-time
state scene and a power environment of the inspection of the current unmanned aerial
vehicle;
wherein, the mobile substation is used for planning and releasing a flight task, carrying
out local monitoring on the inspection state information and the inspection data,
preprocessing inspection image data and carrying out defect pre-diagnosis on the inspection
result data.
[0013] Wherein, the unmanned aerial vehicle flight platform includes a pod module serving
as a line detection terminal, a flight control module for carrying out flight control
on the unmanned aerial vehicle flight platform, a GPS module for carrying out GPS
positioning, a communication module for communicating with the mobile substation and
an unmanned aerial vehicle airframe. The flight control module, the pod module and
the GPS module respectively communicate with the mobile substation through data transmission
communication links; and the pod module sends detection image information into the
mobile substation through an image transmission communication link. The pod module
includes a visible light camera and/or an infrared thermal imaging camera and/or an
ultraviolet imaging camera, etc.
[0014] The centralized monitoring subsystem includes a human-computer interaction module,
an inspection task planning module, an inspection equipment management module, an
inspection personnel management module, a GIS module, a transmission line management
module, an inspection defect diagnosis module, an inspection report management module,
a data storage module, an inspection result management module, a defect elimination
module, an inspection task monitoring module and a communication module.
[0015] The human-computer interaction module is used for obtaining and analyzing an external
command, sending the analyzed external command to a corresponding data processing
module for processing, and displaying a corresponding processing result; the human-computer
interaction module adopts the current unmanned aerial vehicle manipulation equipment
or is selected from a remote controller, a keyboard, a mouse, audio equipment, a display
and a multichannel circular-screen stereo projection system, is used for obtaining
and analyzing the external command, sending the analyzed external command to the corresponding
data processing module, and displaying the processing result in audio, video, image
and other modes.
[0016] The inspection task planning module is used for carrying out task division on a transmission
line inspected by the unmanned aerial vehicle, determining the transmission line sections
inspected by the inspection machine sets, the necessary inspection equipment and the
inspection crew and specifying the planned inspection time and the like according
to the reliability of the inspection equipment, the inspection records of the personnel,
the inspection geographical environment, the meteorological environment and other
influence factors, carrying out query, new construction, edition, audit, notification,
release and other operations on the planned inspection task to accomplish the plan
of the inspection task; and the inspection task planning module includes an inspection
task planning unit, an inspection task management unit and an inspection task information
synchronization unit. The inspection task planning unit is connected with the inspection
equipment management module, the inspection personnel management module, the GIS module
and the transmission line management module, and is used for planning the inspected
transmission line, the equipment, the personnel and the unmanned aerial vehicle on
a GIS map, and determining the inspected transmission line, the equipment, the personnel
and the time and other factors according to the reliability of the equipment, the
skill mastery of the personnel, the complexity of the inspection geographical environment,
the importance of the line, the seasonal factor, the economical efficiency and other
influence factors; the inspection task management unit is connected with the inspection
task planning unit and is used for carrying out query, new construction, edition,
audit and other managements on the planed inspection task; and the inspection task
information synchronization unit is connected with the inspection task management
unit and is used for synchronizing the selected unmanned aerial vehicle inspection
task information to the corresponding mobile substation.
[0017] The inspection task monitoring module is used for monitoring the meteorological environment
information of an unmanned aerial vehicle inspection site, the flight state information
of the unmanned aerial vehicle, the state information of the mobile substation, the
GPS position information, the pod control information and other real-time state information
and power environment information, and describing the real-time state scene and the
power environment of the current inspection of the unmanned aerial vehicle in video
and image modes; and the inspection task monitoring module includes a mobile substation
monitoring unit, a flight state monitoring unit, a pod monitoring unit and a meteorological
environment monitoring unit, is used for monitoring the real-time state information
and the power environment information of the inspection site of the unmanned aerial
vehicle, is connected with the communication module and the human-computer interaction
module, and is used for describing the real-time state scene and the power environment
of the current inspection of the unmanned aerial vehicle in the video and image modes.
Wherein, the mobile substation monitoring unit is used for monitoring the GPS information
of the mobile substation, recording the motion track of the mobile substation on the
GIS map and recording its historical motion tracks; the flight state monitoring unit
is used for monitoring the flight GPS coordinates, the speed, the height, the rotating
speed, the total distance, the cylinder temperature, the battery voltage, the battery
current, the battery power and other state information of the unmanned aerial vehicle;
the pod monitoring unit is used for monitoring the flight pod angle, the shooting
time, the shooting GPS position information and the like of the unmanned aerial vehicle;
and the meteorological environment monitoring unit is used for displaying the temperature,
the humidity, the wind speed, the air density (air pressure), the altitude information
and other meteorological environment information.
[0018] The inspection result management module is used for managing the inspection result
data of the unmanned aerial vehicle, is connected with the communication module and
the data storage module for achieving synchronization, browse, play, comparison, analysis
and report management of the inspection result data, and accomplishing the management
of the inspection result data.
[0019] The inspection defect diagnosis module is used for carrying out screening, preprocessing
and defect diagnosis on the inspection result data that includes image and video information,
marking a defect position on an inspection image, illustrating the defect in characters,
storing the inspection defect in a database, and carrying out identification, modification,
deletion, query, browse and other operations on the corresponding inspection defect
image to accomplish the defect diagnosis of the inspection result; the inspection
defect diagnosis module includes a defect expert database, a defect diagnosis unit,
an image preprocessing unit and a defect management unit, wherein the image preprocessing
unit is used for preprocessing the image information, carrying out definition and
scene selection accuracy identification on an original inspection image, deleting
images with insufficient definition and inaccurate scene selection, and splicing and
editing diagnostic images; the defect expert database is used for integrating feature
libraries of transmission line defects, is connected with the defect diagnosis unit,
and is used for carrying out comparative analysis on a preprocessed image and the
defect expert database, analyzing the transmission line defects and identifying corresponding
defects on the image in the mode of position identification and character illustration;
the defect diagnosis unit is used for storing the diagnosed defects in the data storage
module; and the defect management unit is used for achieving identification, modification,
deletion, query, browse and the like of the inspection defect image.
[0020] The inspection report management module is used for generating an inspection task
report of the unmanned aerial vehicle inspection task, describing the transmission
line, the equipment, the personnel, the time, the flight task report and the flight
log information of the corresponding inspection task and the found defect information,
and carrying out browse, edition, deletion, audit and other operations on the inspection
report to accomplish the management of the inspection report; and
the defect elimination module is used for processing the inspection defect information
in the inspection report, triggering a defect elimination flow by the inspected transmission
line defects, and carrying out release, allocation, notification, elimination, elimination
confirmation and other operations on a defect elimination task to accomplish an elimination
operation of the inspection defects found by the unmanned aerial vehicle inspection;
and the defect elimination module includes a defect task release unit, a defect task
push unit and a defect elimination confirmation unit. The defect task release unit
is used for releasing an inspection defect task and can allocate the inspection defect
task; the defect task push unit is used for sending the defect task information to
operation and maintenance defect elimination personnel of the transmission line section
to which the defects belong in a form of a message, a mail and a short message, and
the operation and maintenance defect elimination personnel execute a defect elimination
task; and the defect elimination confirmation unit is used by the operation and maintenance
defect elimination personnel for accomplishing the defect elimination task, and confirming
the accomplishment of the defect elimination task after submitting a corresponding
defect elimination proof image.
[0021] The GIS module is used for importing and exporting transmission line information,
the transmission line information is displayed in the GIS module, section division,
selection, frame selection and other operations of the transmission line are provided,
and the GIS module can be used for browsing, editing and deleting corresponding line
information on the GIS map, as well as displaying the flight route information of
the unmanned aerial vehicle on the GIS map; and the GIS module includes a GIS line
information import and export unit, a line information display unit and a line information
maintenance unit. Wherein, the GIS line information import and export unit is used
for importing and exporting the transmission line information inspected by the unmanned
aerial vehicle in the GIS map, and the import and export format includes, but not
limited to, text, XML, CSV, EXCEL, WORD, PDF and other formats; the line information
display unit is used for displaying the transmission line information on the GIS map;
and the line information maintenance unit is used for browsing, editing and deleting
corresponding line information on the GIS map.
[0022] The communication module is used for reading the real-time state information of the
mobile substation, responding to a remote instruction of the human-computer interaction
module, releasing the inspection task information to the mobile substation, obtaining
the inspection information of the mobile substation and the unmanned aerial vehicle
flight platform in real time, and accomplishing the information interaction and the
communication of the centralized monitoring subsystem and the mobile substation; and
the communication module can access the mobile substation through a GPRS wireless
communication module and read the real-time state information of the mobile substation,
and is used for responding to the remote instruction of the human-computer interaction
module and obtaining the inspection information of the mobile substation and the unmanned
aerial vehicle flight platform in real time. The communication module includes, but
not limited to, wireless mobile communication of the current GSM, GPRS, CDMA, WCDMA,
TD-SCDMA and LTE communication systems, wifi wireless communication, and local area
network and internet communication.
[0023] The transmission line management module is used for carrying out import, export,
query, browse, deletion, edition and other operations on a tower GPS position, a tower
model number, a tower height, a starting tower serial number, tower serial numbers
and other information of the transmission line to accomplish the management of the
transmission line information; and the transmission line management module includes
a line information import and export unit, a line information query unit and a line
information maintenance unit. Wherein, the line information import and export unit
is used for importing and exporting the tower GPS position, the tower model number,
the tower height, the starting tower serial number, the tower serial numbers and other
information of the transmission line, and the import and export format includes, but
not limited to, text, XML, CSV, EXCEL, word, pdf, etc. The line information query
unit can query the transmission line information through the line serial number, the
tower position, the tower serial numbers, the GPS position and the like, and can also
be connected with the GIS module to query corresponding line information on the GIS
map; and the line information maintenance unit is used for browsing, deleting and
editing the line information.
[0024] The inspection personnel management module is used for carrying out query, maintenance,
registration and deletion management on basic personnel information of the inspection
crew and an inspection task manager through identity card information, achieving automatic
query and display of the personnel information through an identity card reader, and
carrying out query, browse, edition and deletion operations on the inspection record
information of the inspection crew to accomplish the management of the inspection
personnel information; and the inspection personnel management module includes the
identity card reader, a personnel information management unit and an inspection record
management unit. Wherein, the identity card reader is used for reading the identity
card number information of the inspection personnel, and is connected with the personnel
information management unit by a serial port; the personnel information management
unit is used for carrying on query, maintenance, registration and deletion on the
basic information of the inspection personnel, and the personnel information management
unit is connected with the identity card reader for achieving automatic query and
display of the personnel information; and the inspection record management unit is
used for carrying on query, browse, edition and deletion on the inspection records
of the inspection personnel.
[0025] The inspection equipment management module is used for managing inspection equipment
information, carrying out import, export, query, browse, registration, maintenance
and deletion operations on the equipment information, maintaining the state information
of the inspection equipment, including idle, inspection use, maintenance, servicing
or other states, and achieving effective management and use of the inspection equipment;
and the inspection equipment management module includes an equipment information import
and export unit, an equipment information query unit and an equipment information
management unit. Wherein, the equipment information import and export unit is used
for importing and exporting the equipment information, and the import and export format
includes, but not limited to, text, XML, EXCEL, word, pdf and other formats; the equipment
information query unit is used for querying the equipment information, and can query
the equipment information by an equipment name, a serial number, a category tree,
a fuzzy query and other modes; and the equipment information management unit is used
for registering, maintaining and deleting the equipment information.
[0026] The data storage module is used for storing system data in a database, a file and
other modes, the data storage module is used for storing basic system data of a centralized
management subsystem, the inspection process data, the inspection result data, the
inspection monitoring data and the like, wherein inspection video data is stored in
a file, and a storage file path is stored in the database.
[0027] The mobile substation includes a human-computer interaction module, an inspection
task synchronization module, a pod control module, a GIS module, a flight control
module, a flight task planning module, a defect pre-diagnosis module, an image preprocessing
module, a meteorological monitoring module, a flight task monitoring module, a data
storage module, a GPS module and a communication module.
[0028] The human-computer interaction module is used for obtaining and analyzing an external
command, sending the analyzed external command to a corresponding data processing
module for processing, displaying a corresponding processing result, inputting and
outputting system data, and accomplishing human-system interaction; and the human-computer
interaction module adopts the current unmanned aerial vehicle manipulation equipment
or is selected from a remote controller, displacement tracking equipment, a motion
platform with six degrees of freedom, a keyboard, a mouse, audio equipment, a display
and a multichannel circular-screen stereo projection system.
[0029] The inspection task synchronization module is used for synchronizing the inspection
task information in the centralized monitoring subsystem to the local, carrying out
query and state maintenance on the inspection task that is synchronized to the local,
setting a current inspection task and carrying out other operations to accomplish
the synchronization and the management of the inspection task information; and the
inspection task synchronization module includes an inspection task information synchronization
unit, an inspection task query unit and a current inspection task setting unit, and
is used for synchronizing the inspection task information in the centralized monitoring
subsystem to the local. The inspection task information synchronization unit is used
for synchronizing the inspection task information; the inspection task query unit
is used for querying the inspection task information on the mobile substation; and
the current inspection task setting unit is used for setting a current default inspection
task.
[0030] The pod control module is used for monitoring and controlling a pod on the unmanned
aerial vehicle flight platform, reading pod information which includes, but not limited
to, the pod angle, the battery power, the battery voltage, the battery current, the
shooting time, the shooting GPS value and the like in real time, as well as releasing
a control instruction according to the external instruction, controlling the pod angle,
executing a shooting action and stopping the shooting action, so as to monitor the
pod on the unmanned aerial vehicle flight platform.
[0031] The GIS module is used for importing, exporting and displaying the transmission line
information of the inspection task, providing frame selection, GPS position positioning
and other operations of the GIS map, and providing calibration operation and other
operations of a GPS position point on the GIS map. The GIS module includes a GIS line
information import unit and a line information display unit. The GIS line information
import unit is used for importing the GIS line information, wherein the import file
format includes, but not limited to, text, XML, CSV, EXCEL, WORD, PDF and the like;
and the line information display unit is used for displaying the transmission line
information on the GIS map.
[0032] The flight control module is used for monitoring and controlling the state information
of the unmanned aerial vehicle flight platform, reading the GPS information, the speed,
the height, the rotating speed, the total distance, the cylinder temperature, the
battery voltage, the battery current, the battery power and other information of the
unmanned aerial vehicle flight platform in real time, and releasing a command to the
unmanned aerial vehicle flight platform according to the external instruction to control
the unmanned aerial vehicle flight platform. The flight control module includes a
flight monitoring unit and a flight control unit. Wherein, the flight monitoring unit
is connected with the communication module and is used for monitoring the information
of the unmanned aerial vehicle flight platform in real time, and the information includes,
but not limited to, the GPS information, the speed, the height, the rotating speed,
the total distance, the cylinder temperature, the battery voltage, the battery current,
the battery power and the like; and the flight control unit is connected with the
communication module and is used for releasing the command to the unmanned aerial
vehicle flight platform according to the external instruction to control the unmanned
aerial vehicle flight platform.
[0033] The flight task planning module is used for planning takeoff/landing points, a suspension
point, track points, a corresponding flight height, a flight speed, a line distance
and the like of unmanned aerial vehicle inspection on the GIS map according to the
transmission line information, the geographical environment information, the meteorological
environment information and the like of the unmanned aerial vehicle inspection, generating
a corresponding flight route, and carrying out query, browse, deletion, import, export
and other operations on the flight task information of the unmanned aerial vehicle
to accomplish the management and the plan of the flight task. The flight task planning
module includes a flight planning unit, a flight task information import and export
unit and a flight task information management unit. Wherein, the flight planning unit
is used for planning the takeoff/landing points, the suspension point, the track points,
the corresponding flight height, the flight speed, the line distance and the like
of inspection unmanned aerial vehicle with the transmission line information, the
GIS geographical information, the meteorological information and the like of the inspected
line section as constraint factors. The flight task information management unit is
used for querying, browsing and deleting the flight task information. The flight task
import and export unit can import and export a corresponding flight task file, and
the import and export file format includes, but not limited to, a flight task description
file, or text, XML, CSV, EXCEL, WORD, BMP, JPEG, GIF, TIFF, TGA, EXIF, etc.
[0034] The defect pre-diagnosis module is used for editing and splicing images, screening
out images with potential defect possibility, identifying the defect information and
the defect position information in image information, and carrying out identification,
modification, deletion, query, browse and other operations on the corresponding defect
information to accomplish the defect diagnosis and management of the inspection result.
[0035] The image preprocessing module is used for preprocessing and managing the inspected
image information, carrying out browse, edition, screening and preprocessing operations
on the corresponding defect information, screening out images with insufficient shooting
definition, inaccurate shooting angle and inaccurate scene selection among shot images,
carrying out denoising processing on the images, and adjusting the definition and
the contrast of the images to achieve the preprocessing of the image information.
The image preprocessing module includes an image browsing unit, an image editing unit,
an image screening unit and an image preprocessing unit. Wherein, the image browsing
unit is used for browsing the image information; the image editing unit is used for
carrying out manual edition and deletion operation on the image; the image screening
unit is used for screening out the image information with insufficient definition
and accuracy from the image information; and the image preprocessing unit is used
for carrying out the denoising processing on the image, and adjusting the definition
and the contrast of the image to achieve the preprocessing of the image information.
[0036] The meteorological monitoring module is used for monitoring the meteorological information
of an inspection site of the unmanned aerial vehicle in real time, and is connected
with the flight task monitoring module by a matching interface to send the monitored
meteorological information to the centralized monitoring subsystem; the meteorological
monitoring module includes, but not limited to, an integrated meteorological monitoring
instrument or a temperature sensor, a humidity sensor, a wind speed sensor, an air
density (air pressure) sensor, an altitude tester and the like, and is used for monitoring
the temperature, the humidity, the wind speed, the air density (air pressure), the
altitude information and the like of the inspection site of the unmanned aerial vehicle
in real time, and the equipment is connected with the flight task monitoring module
by the matching interface.
[0037] The flight task monitoring module is used for monitoring the flight state information,
the meteorological information of the inspection site, the GPS position information
and the like, and displaying the same in the human-computer interaction module; and
the flight task monitoring module can also be used for sending the corresponding flight
task monitoring information to the centralized monitoring subsystem by the communication
module.
[0038] The data storage module is used for storing the system data, and storing the basic
system data of the centralized management subsystem, the inspection process data,
the inspection result data, the inspection monitoring data and the like through the
data, wherein the inspection video data is stored in the file, and the storage file
path is stored in the database.
[0039] The GPS module is used for achieving GPS positioning of the mobile substation, and
is connected with the flight task monitoring module through a serial port to send
the GPS information of the mobile substation to the centralized monitoring subsystem;
and
the communication module is used for realizing the data interaction with the centralized
monitoring subsystem, synchronizing the inspection task information from the centralized
monitoring subsystem and sending the inspection data and the inspection monitoring
data to the centralized monitoring subsystem; and the communication module can also
be used for reading the unmanned aerial vehicle state information and the inspection
video information of the unmanned aerial vehicle flight platform through a data transmission
module and an image transmission module. The communication module includes a wireless
communication unit, a wired communication unit, a data transmission unit and an image
transmission unit. The wireless communication unit adopts communication modules, including,
but not limited to, wireless mobile communication of the current GSM, GPRS, CDMA,
WCDMA, TD-SCDMA and LTE communication systems, and wifi wireless communication; the
wired communication unit communicates through the Ethernet to achieve information
interaction; the data transmission unit achieves the data communication with the unmanned
aerial vehicle flight platform through a data transmission radio; and the image transmission
unit receives the video information sent by the unmanned aerial vehicle flight platform
through an image transmission antenna.
[0040] The present invention further provides a centralized monitoring method for transmission
line inspection of unmanned aerial vehicles, including three parts: inspection task
execution, inspection result processing and inspection task monitoring. The specific
flow is as follows:
first step, inspection task allocation: inspection tasks are allocated according to
the information of inspected transmission lines and the monitored state information
of the mobile substation, a transmission line section, an inspection time, an inspection
type, an inspection target and other information corresponding to each inspection
task are determined, and inspection personnel and equipment are configured for each
inspection task. The monitoring on the state information of the mobile substation
in the stage is monitoring the GPS position information of the mobile substation,
the integrity of mobile substation equipment, the full extent of crew and the like,
so as to allocate the corresponding inspection task.
Second step, inspection task execution: corresponding inspection task information
is audited, and the audited inspection task information is released to the corresponding
mobile substation to execute the corresponding inspection task. In the inspection
task execution stage, the execution condition of the inspection task is monitored
in a wireless communication mode, and the equipment state of the mobile substation,
the GPS position information and the meteorological environmental information of the
mobile substation site are monitored.
Third step, new construction of a flight task: the mobile substation plans the flight
task corresponding to the inspection task according to the released inspection task
information, and determines that the inspection task accomplishes the necessary flight
task and one flight task corresponds to one takeoff/landing flight inspection of the
airplane; and in the new construction of the flight task, the inspection tower and
the transmission line section corresponding to the flight task, and monitoring equipment
(infrared, ultraviolet or visible light) corresponding to the flight task should be
determined, a corresponding flight route is planned, and if the flight route is present,
it is directly imported.
Fourth step, flight task execution: the mobile substation sends the flight route information
in the flight task to be executed to the flight control module, and the unmanned aerial
vehicle is started to carry out flight inspection. In the inspection process, the
flight task is monitored, and the flight state, the pod state, the flight track and
the meteorological information are mainly monitored.
Fifth step, flight task accomplishment: corresponding inspection result data should
be imported in the mobile substation, the inspection image information is preprocessed,
a flight report is generated in combination with flight process information, the flight
report, the flight result data, the flight process data and the flight monitoring
data are sent to the centralized monitoring subsystem, and the flight monitoring data
needs to be transmitted to the centralized monitoring subsystem in real time.
Sixth step, inspection task accomplishment: the centralized monitoring subsystem carries
out inspection defect diagnosis on the inspection result data and the main inspection
image information to determine the inspection defects; verifies and diagnoses the
defects primarily provided in the flight report; checks the completion degree of the
inspection task, and ensures that the completion degree of the inspection task is
100%. The check method is as follows: 1) a transmission line length inspected in the
flight task is the inspection transmission line length regulated in the inspection
task; and 2) flight inspection is carried out on line towers involved in the inspection
task.
Seventh step, inspection result processing.
Eighth step, inspection task closure: the centralized management subsystem generates
a corresponding inspection report according to inspection process information, result
information and defect information, and provides inspection process description and
inspection result description; and the centralized management subsystem carries out
defect elimination on the inspection defects in the corresponding inspection report
and reflects a defect elimination result in the inspection report.
[0041] The inspection result processing flow is as follows:
first step, image preprocessing: shot image copy information in the inspection result
is preprocessed, images with insufficient shooting definition, inaccurate shooting
angle and inaccurate scene selection among the shot images are screened out, denoising
processing is carried out on the images, and the definition and the contrast of the
images are adjusted;
second step, defect diagnosis: a defect sample that is provided according to the defect
expert database is diagnosed, whether the information in the images has defects is
determined, a defect layer is added on the image, the defects are identified on a
new image layer by squares or circles and character illustration, and a diagnosis
result is saved in the database; and
third step, manual defect processing: manual confirmation is carried out on the defect
information saved in the database to determine whether the defects are diagnosed,
and re-identification, deletion, modification and browse operations can be carried
out on corresponding defects; and image management can be carried out to browse the
original image information and identify the manually found defects.
[0042] The present invention has the beneficial effects that, according to the present invention,
effective centralized monitoring of the accessed unmanned aerial vehicle inspection
can be achieved, and statistical analysis can be carried out on the state data of
the accessed unmanned aerial vehicle inspection, so as to improve the security and
the reliability of the line inspection of the unmanned aerial vehicle.
[0043] Unified monitoring of the unmanned aerial vehicle inspection can be achieved in a
centralized monitoring mode, which is conducive to analyzing the technical economy
and the reliability of the unmanned aerial vehicle inspection and providing supports
for the operation management of the unmanned aerial vehicle line inspection.
[0044] The real-time state information of the unmanned aerial vehicle line inspection and
the shot image information are transmitted to the centralized monitoring subsystem
in a GPRS communication mode in real time, and the inspection result data is automatically
processed to improve the automation and informatization degrees of the line inspection,
improve the line inspection efficiency and reduce the line inspection cost.
[0045] By means of the centralized monitoring of the state information of the unmanned aerial
vehicle inspection, the scheduling personnel of the unmanned aerial vehicle inspection
can effectively master the overall unmanned aerial vehicle inspection and can flexibly
schedule the line inspection of the unmanned aerial vehicles, so as to improve the
use efficiency of the unmanned aerial vehicles for line inspection, balance the used
unmanned aerial vehicles for line inspection, prolong the service life of the unmanned
aerial vehicles and reduce the use cost.
Brief Description of the Drawings
[0046]
Fig.1 is an architecture diagram of a centralized monitoring system for unmanned aerial
vehicle inspection.
Fig.2 is a structural diagram of a centralized monitoring subsystem.
Fig.3 is a structural diagram of a mobile substation system.
Fig.4 is a flowchart of a monitoring method of the present invention.
Fig.5 is a flowchart of inspection result processing of the present invention.
Fig.6 is a flowchart of an unmanned aerial vehicle inspection task of the present
invention.
Fig.7 is a flowchart of an unmanned aerial vehicle flight task of the present invention.
[0047] In the drawings:
1, centralized monitoring subsystem; 2, mobile substation; 3, unmanned aerial vehicle
flight platform; 4, pod module; 5, flight control module; 6, first GPS module; 7,
first communication module; 8, first human-computer interaction module; 9, inspection
task planning module; 10, inspection equipment management module; 11, inspection personnel
management module; 12, first GIS module; 13, transmission line management module;
14, inspection result management module; 15, inspection defect diagnosis module; 16,
inspection report management module; 17, first data storage module; 18, inspection
result management module; 18, defect elimination module; 19, inspection task monitoring
module; 20, second communication module; 21, second human-computer interaction module;
22, inspection task synchronization module; 23, pod control module; 24, second GIS
module; 25, flight control module; 26, flight task planning module; 27, defect pre-diagnosis
module; 28, image preprocessing module; 29, meteorological monitoring module; 30,
flight task monitoring module; 31, second data storage module; 32, second GPS module;
33, third communication module.
Detailed Description of the Embodiments
[0048] In order that the technical problems to be solved, technical solutions and beneficial
effects in the present invention are clearer, a further detailed description of the
present invention will be given below in combination with accompanying drawings and
embodiments. It should be understood that the specific embodiments described herein
are merely used for explaining the present invention, rather than limiting the present
invention.
[0049] As shown in Fig.1, it is a centralized monitoring system for unmanned aerial vehicle
inspection. The system includes:
a centralized monitoring subsystem 1, mobile substations 2 and unmanned aerial vehicle
flight platforms 3.
[0050] Wherein, the centralized monitoring subsystem 1 is simultaneously accessed and activated
online with a plurality of mobile substations 2.
[0051] In the centralized monitoring subsystem 1, a human-computer interaction module 8
can select unmanned aerial vehicle manipulation equipment as basic human-computer
interaction equipment, and meanwhile can also select or combine a remote controller,
a keyboard, a mouse, audio equipment, a display and a multichannel circular-screen
stereo projection system, which are configured according to demand;
an inspection task planning module 9 is connected with an inspection equipment management
module 10, an inspection personnel management module 11, a first GIS module 12 and
a transmission line management module 13, and is used for planning the inspected transmission
line, the equipment, the personnel and the unmanned aerial vehicle on a GIS map, and
determining the inspected transmission line, the equipment, the personnel and the
time according to the reliability of the equipment, the skill mastery of the personnel,
the complexity of the inspection geographical environment, the importance of the line,
the seasonal factor, the economical efficiency and other influence factors; the inspection
task planning module 9 is also connected with a second communication module 20 for
sending inspection task information to the mobile substation 2, and the mobile substation
2 executes a corresponding inspection task;
an inspection task monitoring module 19 is connected with the second communication
module 20 and the human-computer interaction module 8, and is used for reading real-time
state information and power environment information of an unmanned aerial vehicle
inspection site, and describing the real-time state scene and the power environment
of the current inspection of the unmanned aerial vehicle in video and image modes;
an inspection result management module 14 is connected with the second communication
module 20 and a first data storage module 17, and is used for reading and storing
the inspection state data and the inspection result data of the unmanned aerial vehicle,
and achieving browse, comparison, analysis and report management of the inspection
data; an inspection defect diagnosis module 15 is connected with the first data storage
module 17 and the inspection result management module 14, and is used for carrying
out defect diagnosis on the inspection result data that includes inspection image,
video and other information, displaying the corresponding defect diagnosis result
on the image and the video in the mode of position identification and character illustration,
as well as carrying out browse, edition and deletion on a defect processing result;
an inspection report management module 16 is connected with the inspection defect
diagnosis module 15 and the first data storage module 17, and is used for generating
an inspection task report of the unmanned aerial vehicle inspection task, describing
the inspection process and the result information of the corresponding inspection
task and the found defect information, and carrying out browse, edition, deletion
and audit operations on the inspection report;
the inspection report management module 16 is interconnected with a defect elimination
module 18 and the first communication module 20, and is used for announcing inspection
defects listed in the inspection report and pushing the same to the defect elimination
personnel in a form of a mail, a message and a short message, and the defect elimination
personnel execute defect elimination;
the first GIS module 12 is associated with the transmission line management module
13, and is used for importing, displaying, editing, deleting and saving the transmission
line information of the unmanned aerial vehicle inspection on the GIS map;
the second communication module 20 in the centralized monitoring subsystem 1 can access
the mobile substation through GPRS wireless communication to read the real-time state
information of the mobile substation, and is used for responding to a remote instruction
of the human-computer interaction module, and obtaining the inspection information
of the mobile substation and the unmanned aerial vehicle flight platform in real time.
The second communication module 20 can also select wireless mobile communication of
GSM, CDMA, WCDMA, TD-SCDMA and LTE communication systems, wifi wireless communication,
and local area network and internet communication modes for communication;
the inspection defect diagnosis module 15 in the centralized monitoring subsystem
1 includes a defect expert database, a defect diagnosis unit, an image preprocessing
unit and a defect management unit, wherein the image preprocessing unit is connected
with the first data storage module 17 and is used for preprocessing an original image,
and screening out images with insufficient definition and inaccurate scene selection;
the defect expert database is connected with the defect diagnosis unit and is used
for carrying out defect diagnosis according to the image information and identifying
corresponding defects on the image in the form of position identification and character
illustration;
the defect elimination module 18 in the centralized monitoring subsystem 1 includes
a defect task release module, a defect task push module and a defect elimination confirmation
module. Wherein, the defect task release module is connected with the defect task
push module and is used for reading the defect task information and sending the same
to operation and maintenance defect elimination personnel of the transmission line
section to which the defects belong in a form of a message, a mail and a short message,
and the operation and maintenance defect elimination personnel execute a defect elimination
task; and the defect elimination confirmation module is used by the operation and
maintenance defect elimination personnel for accomplishing the defect elimination
task, and confirming the accomplishment of the defect elimination task after submitting
a corresponding defect elimination proof image.
[0052] In the centralized monitoring subsystem 1, the transmission line management module
13 includes a line information import and export unit, a line information query unit
and a line information maintenance unit. Wherein, the line information import and
export unit is used for importing and exporting the transmission line information,
and the import and export format can select an XML file format, as well as text, CSV,
EXCEL, word, pdf, etc.
[0053] In the centralized monitoring subsystem 1, the inspection equipment management module
10 includes an equipment information import and export unit, an equipment information
query unit and an equipment information management unit. Wherein, the equipment information
import and export unit is used for importing and exporting the equipment information,
and the import and export format can select an XML file format, as well as text, EXCEL,
word, pdf, etc.
[0054] In the centralized monitoring subsystem 1, the first GIS module 12 includes a GIS
line information import and export unit, a line information display unit and a line
information maintenance unit. The GIS line information import and export file format
can adopt an XML file, as well as text, CSV, EXCEL, WORD, PDF, etc.
[0055] As shown in Fig.3, the mobile substation 2 includes a second human-computer interaction
module 21, an inspection task synchronization module 22, a pod control module 23,
a second GIS module 24, a flight control module 25, a flight task planning module
26, a defect pre-diagnosis module 27, an image preprocessing module 28, a meteorological
monitoring module 29, a flight task monitoring module 30, a second data storage module
31, a second GPS module 32 and a third communication module 33.
[0056] The second human-computer interaction module 21 adopts unmanned aerial vehicle manipulation
equipment to achieve the human-computer interaction, and can also select or combine
a remote controller, displacement tracking equipment, a motion platform with six degrees
of freedom, a keyboard, a mouse, audio equipment, a display and a multichannel circular-screen
stereo projection system.
[0057] The flight task planning module 26 is connected with the inspection task synchronization
module 22, the pod control module 23, the flight control module 25 and the second
GIS module 24, and is used for planning an unmanned aerial vehicle flight task.
[0058] The flight task planning module 26 includes a flight planning unit, a flight task
information import and export unit and a flight task information management unit.
[0059] The flight task import and export unit can import and export a corresponding flight
task file, and the import and export file format adopts an XML file format, and can
also select or combine text, XML, CSV, EXCEL, WORD, BMP, JPEG, GIF, TIFF, TGA, EXIF,
etc.
[0060] The defect pre-diagnosis module 27 is connected with the image preprocessing module
28 and the second data storage module 31, and is used for accomplishing the pre-diagnosis
of the inspection result data in the mobile substation 2 and primarily filtering useless
image information.
[0061] The flight task monitoring module 30 is associated with the meteorological monitoring
module 29, the second GIS module 24 and the third communication module 33, and is
used for monitoring the inspection task information and the inspection result data
of the unmanned aerial vehicle flight platform 3.
[0062] The flight task monitoring module 30 is associated with the third communication module
33, and can send the read inspection task information and the inspection result data
of the unmanned aerial vehicle and the mobile substation 2 to the centralized monitoring
subsystem 1.
[0063] The meteorological monitoring module 29 can adopt an integrated meteorological monitoring
instrument, and can also select or combine a temperature sensor, a humidity sensor,
a wind speed sensor, an air density (air pressure) sensor, an altitude tester, etc.
[0064] The second GIS module 24 includes a GIS line information import unit and a line information
display unit. The GIS line information import unit is used for importing the GIS line
information, and the import file format can adopt XML, and can also select text, CSV,
EXCEL, WORD, PDF and the like; and
the third communication module 33 includes a wireless communication unit, a wired
communication unit, a data transmission unit and an image transmission unit. The wireless
communication unit adopts the GPRS communication mode, and can also select or combine
communication modules of wireless mobile communication of GSM, GPRS, CDMA, WCDMA,
TD-SCDMA and LTE communication systems, and wifi wireless communication.
[0065] The unmanned aerial vehicle flight platform 3 mainly includes a pod module 4, a flight
control module 5, a first GPS module 6, a first communication module 7 and an unmanned
aerial vehicle airframe. The pod module 4, the flight control module 5 and the first
GPS module 6 communicate with the mobile substation 2 through the first communication
module 7. The first communication module 7 includes a data transmission unit and an
image transmission unit, and can adopt a digital radio, as well as an analog radio.
The pod module 4 adopts a visible light camera, and can also select or combine a camera,
an infrared thermal imaging camera, an ultraviolet imaging camera and the like. The
unmanned aerial vehicle airframe can adopt a rotor unmanned aerial vehicle, and can
also adopt a multi-rotor or a fixed-wing unmanned aerial vehicle.
[0066] As shown in Fig.4, the centralized monitoring flow of the unmanned aerial vehicle
inspection of the present invention is divided into three large basic flows: an inspection
task execution flow, an inspection result processing flow and an inspection task monitoring
flow. The interaction flow of the centralized monitoring of the unmanned aerial vehicle
inspection is as follows:
first step, inspection task allocation: inspection tasks are allocated according to
the information of inspected transmission lines and the monitored state information
of the mobile substation, a transmission line section, an inspection time, an inspection
type, an inspection target and other information corresponding to each inspection
task are determined, and inspection personnel and equipment are configured for each
inspection task. The monitoring on the state information of the mobile substation
2 in the stage is monitoring the GPS position information of the mobile substation
2, the integrity of mobile substation 2 equipment, the full extent of crew and the
like, so as to allocate the corresponding inspection task.
Second step, inspection task execution: corresponding inspection task information
is audited, and the audited inspection task information is released to the corresponding
mobile substation 2 to execute the corresponding inspection task. In the inspection
task execution stage, the execution condition of the inspection task is monitored
in a wireless communication mode, and the equipment state of the mobile substation
2, the GPS position information and the meteorological environmental information of
the mobile substation 2 site are monitored.
Third step, new construction of a flight task: the mobile substation 2 plans the flight
task corresponding to the inspection task according to the released inspection task
information, and determines that the inspection task accomplishes the necessary flight
task and one flight task corresponds to one takeoff/landing flight inspection of the
airplane; and in the new construction of the flight task, the inspection tower and
the transmission line section corresponding to the flight task, and monitoring equipment
(infrared, ultraviolet or visible light) corresponding to the flight task should be
determined, a corresponding flight route is planned, and if the flight route is present,
it is directly imported.
Fourth step, flight task execution: the mobile substation 2 sends the flight route
information in the flight task to be executed to the flight control module, and the
unmanned aerial vehicle is started to carry out flight inspection. In the inspection
process, the flight task is monitored, and a flight state, a pod state, a flight track
and the meteorological information are mainly monitored.
Fifth step, flight task accomplishment: corresponding inspection result data should
be imported in the mobile substation 2, the inspection image information is preprocessed,
a flight report is generated in combination with flight process information, the flight
report, the flight result data, the flight process data and the flight monitoring
data are sent to the centralized monitoring subsystem 1, and the flight monitoring
data needs to be transmitted to the centralized monitoring subsystem 1 in real time.
Sixth step, inspection task accomplishment: the centralized monitoring subsystem 1
carries out inspection defect diagnosis on the inspection result data and the main
inspection image information to determine the inspection defects; verifies and diagnoses
the defects primarily provided in the flight report; checks the completion degree
of the inspection task, and ensures that the completion degree of the inspection task
is 100%. The check method is as follows: 1) a transmission line length inspected in
the flight task is the inspection transmission line length regulated in the inspection
task; and 2) flight inspection is carried out on line towers involved in the inspection
task.
[0067] As shown in Fig.5, seventh step, the inspection result processing flow is as follows:
step 1, image preprocessing: shot image copy information in the inspection result
is preprocessed, images with insufficient shooting definition, inaccurate shooting
angle and inaccurate scene selection among the shot images are screened out, denoising
processing is carried out on the images, and the definition and the contrast of the
images are adjusted;
step 2, defect diagnosis: a defect sample that is provided according to the defect
expert database is diagnosed, whether the information in the images has defects is
determined, a defect layer is added on the image, the defects are identified on a
new image layer by squares or circles and character illustration, and a diagnosis
result is saved in the database; and
step 3, manual defect processing: manual confirmation is carried out on the defect
information saved in the database to determine whether the defects are diagnosed,
and re-identification, deletion, modification and browse operations can be carried
out on corresponding defects; and image management can be carried out to browse the
original image information and identify the manually found defects.
[0068] Eighth step, inspection task closure: the centralized management subsystem 1 generates
a corresponding inspection report according to inspection process information, result
information and defect information, and provides inspection process description and
inspection result description; and the centralized management subsystem carries out
defect elimination on the inspection defects in the corresponding inspection report
and reflects a defect elimination result in the inspection report.
[0069] As shown in Fig.6, the flow of the unmanned aerial vehicle inspection task can be
executed in the following 8 steps:
first step, new construction of the inspection task: in a transmission line on a GIS
map, according to the existing transmission line information and defect conditions
inspected on the corresponding line section, the transmission line section of the
inspection task is determined, and the inspection time, the inspection type, the inspection
target and other information are specified; in the new construction of the inspection
task, the new construction of the inspection task can also be accomplished by cloning,
and the cloning requires the modification of the execution time and other parameters
of the inspection task. The currently determined inspection task information includes
a task name, a line name, a voltage grade, starting and ending tower numbers, towers
(bases), a line length, the inspection type, the inspection target, a planned start
time, a planned end time, the person in charge and other information.
Second step, inspection task configuration: the types of a detection terminal and
the unmanned aerial vehicle are determined according to the type of the inspection
task and the inspection target; and the idle inspection crew and inspection equipment
within the time period according to the planned time period of the inspection task
and the machine set type.
Third step, inspection task audit: a transmission line inspection manager audits the
inspection task, and the fourth step can be executed if the audit is passed; and otherwise,
if the task configuration does not pass the audit, the second step is executed to
configure the corresponding inspection task again; and if the audit on the inspection
line plan is not passed, the first step is executed to adjust the inspected transmission
line section.
Fourth step, inspection task notification: an inspection task notification is released
for the audited inspection task in the form of a message, a short message and a mail.
Fifth step, inspection task release: the corresponding inspection task is sent to
the corresponding mobile substation 2 through the Ethernet or in a wireless network
form to release the inspection task.
Sixth step, inspection task execution: in the mobile substation 2, a corresponding
flight task is established according to the corresponding inspection task, unmanned
aerial vehicle inspection is executed, and inspection process information and result
information are sent to the centralized monitoring subsystem 1.
Seventh step, inspection task accomplishment: after checking that the completion degree
of the inspection task reaches 100%, all inspection task process information, the
result information, the flight report and the flight log information are sent to the
centralized monitoring subsystem 1.
Eighth step, inspection task closure: defect identification processing is carried
out on the inspection result according to the inspection process information, the
result information, the flight log and the flight report, and an inspection defect
list is provided; corresponding inspection defects are sent to the inspection defect
elimination module to eliminate the defects; and a corresponding inspection report
is generated according to the inspection process information, the result information
and the defect information, and the inspection task is closed.
[0070] After the inspection task is accomplished, the final inspection result forms the
inspection report, and the inspection report contains the inspection process information,
the flight state information, the meteorological information, the flight log, the
inspected defect information, the inspection task information and other contents.
[0071] As shown in Fig.7, the execution flow of the unmanned aerial vehicle flight task
in the mobile substation can be divided into the following 6 steps:
first step, new construction of the flight task: the flight task of the flight inspection
of the unmanned aerial vehicle is established according to the inspection task information
of the unmanned aerial vehicle that is synchronized to the mobile substation 2. The
transmission line information to be inspected is displayed in the GIS map, the tower
line section of the flight inspection is selected, the GPS position information of
the inspection tower and the airplane takeoff/landing points is written in the XML
file, and a GPS satellite map for inspection can be automatically selected by a frame
to serve as the inspection map.
Second step, flight route planning: if a corresponding flight route is available for
the corresponding inspection tower transmission line section, the corresponding flight
route is selected; and otherwise, the flight route of the unmanned aerial vehicle
is planned according to the inspection tower transmission line section determined
in the flight task, and the flight route point, the inspection suspension point, the
return route, the takeoff/landing points and the like of the unmanned aerial vehicle
are planned.
Third step, flight task audit: the determined inspection transmission line and the
corresponding flight route for the unmanned aerial vehicle flight task are audited,
and the fourth step is executed if the audit is passed; and if the audit is not passed,
the second step is executed to replan the flight route.
Fourth step, flight task execution: the flight route information, the GPS position
information of the suspension point and the flight map determined for the flight task
are released to the flight control module, the unmanned aerial vehicle is started
to carry out transmission line inspection flight, and the flight control module interacts
with the unmanned aerial vehicle in a flight process to control the flight of the
unmanned aerial vehicle; and the detection pod of the unmanned aerial vehicle is controlled
by the pod control module 23 to shoot and photograph
Fifth step, flight accomplishment: the unmanned aerial vehicle sends corresponding
flight state information to the mobile substation 2 in the flight process, and sends
the flight inspection result data (images, videos) to the mobile substation 2.
Sixth step, task accomplishment: the flight log is imported in the mobile substation
2, primary defect diagnosis analysis is carried out according to the flight process
data and the flight result data to generate a corresponding flight report, and the
generated flight report is sent to the centralized monitoring management subsystem
1. Although the present invention has been described above in detail by the specific
and preferred embodiments, those skilled in the art should understand that the present
invention is not limited to the above embodiments, and any modifications, equivalent
substitutions and the like, made within the spirit and principle of the present invention,
shall all fall into the protection scope of the present invention.
1. A centralized monitoring system for transmission line inspection of unmanned aerial
vehicles, comprising a centralized monitoring subsystem, mobile substations and unmanned
aerial vehicle flight platforms; the centralized monitoring subsystem is connected
with the mobile substations in a one-to-many mode, and the mobile substations are
connected with the unmanned aerial vehicle flight platforms in a one-to-one mode;
the centralized monitoring subsystem is used for accessing the state information and
inspection data of the mobile substation and the unmanned aerial vehicle flight platform,
planning and synchronizing an unmanned aerial vehicle inspection task, carrying out
real-time remote monitoring on the mobile substation and the unmanned aerial vehicle
flight platform for the unmanned aerial vehicle inspection, carrying out defect diagnosis,
statistics, analysis and display on the inspection data, and describing a real-time
state scene and a power environment of the inspection of the current unmanned aerial
vehicle;
the mobile substation is used for planning and releasing a flight task, carrying out
local monitoring on the inspection state information and the inspection data, preprocessing
inspection image data and carrying out defect pre-diagnosis on the inspection result
data; and
the unmanned aerial vehicle flight platform comprises a pod module serving as a line
detection terminal, a flight control module for carrying out flight control on the
unmanned aerial vehicle flight platform, a GPS module for carrying out GPS positioning,
a communication module for communicating with the mobile substation and an unmanned
aerial vehicle airframe; the flight control module, the pod module and the GPS module
respectively communicate with the mobile substation through data transmission communication
links; and the pod module sends detection image information into the mobile substation
through an image transmission communication link.
2. The centralized monitoring system for transmission line inspection of unmanned aerial
vehicles of claim 1, wherein the centralized monitoring subsystem comprises:
a human-computer interaction module, used for obtaining and analyzing an external
command, sending the analyzed external command to a corresponding data processing
module for processing, and displaying a corresponding processing result;
an inspection task planning module, used for carrying out task division on a transmission
line inspected by the unmanned aerial vehicle, determining the transmission line sections
inspected by the inspection machine sets, the necessary inspection equipment and the
inspection crew and specifying the planned inspection time according to influence
factors, comprising the reliability of the inspection equipment, the inspection records
of the personnel, the inspection geographical environment and the meteorological environment,
carrying out query, new construction, edition, audit, notification and release operations
on the planned inspection task to accomplish the plan of the inspection task;
an inspection task monitoring module, used for monitoring the meteorological environment
information of an unmanned aerial vehicle inspection site, the flight state information
of the unmanned aerial vehicle, the state information of the mobile substation, the
GPS position information, the pod control information and other real-time state information
and power environment information, and describing the real-time state scene and the
power environment of the current inspection of the unmanned aerial vehicle in video
and image modes;
an inspection result management module, which is used for managing the inspection
result data of the unmanned aerial vehicle, is connected with a communication module
and a data storage module for achieving synchronization, browse, play, comparison,
analysis and report management of the inspection result data, and accomplishing the
management of the inspection result data;
an inspection defect diagnosis module, used for carrying out screening, preprocessing
and defect diagnosis on the inspection result data that comprises image and video
information, marking a defect position on an inspection image, illustrating the defect
in characters, storing the inspection defect in a database, and carrying out identification,
modification, deletion, query and browse operations on the corresponding inspection
defect image to accomplish the defect diagnosis of the inspection result;
an inspection report management module, used for generating an inspection task report
of the unmanned aerial vehicle inspection task, describing the transmission line,
the equipment, the personnel, the time, the flight task report and the flight log
information of the corresponding inspection task and the found defect information,
and carrying out browse, edition, deletion and audit operations on the inspection
report to accomplish the management of the inspection report;
a defect elimination module, used for processing the inspection defect information
in the inspection report, triggering a defect elimination flow by the inspected transmission
line defects, and carrying out release, allocation, notification, elimination and
elimination confirmation operations on a defect elimination task to accomplish an
elimination operation of the inspection defects found by the unmanned aerial vehicle
inspection;
a GIS module, used for importing and exporting transmission line information, wherein
the transmission line information is displayed in the GIS module, section division,
selection and frame selection operations of the transmission line are provided, and
the GIS module can be used for browsing, editing and deleting corresponding line information
on the GIS map, as well as displaying the flight route information of the unmanned
aerial vehicle on the GIS map;
the communication module, used for reading the real-time state information of the
mobile substation, responding to a remote instruction of the human-computer interaction
module, releasing the inspection task information to the mobile substation, obtaining
the inspection information of the mobile substation and the unmanned aerial vehicle
flight platform in real time, and accomplishing the information interaction and the
communication of the centralized monitoring subsystem and the mobile substation;
a transmission line management module, used for carrying out import, export, query,
browse, deletion and edition operations on a tower GPS position, a tower model number,
a tower height, a starting tower serial number, tower serial numbers and other information
of the transmission line to accomplish the management of the transmission line information;
an inspection personnel management module, used for carrying out query, maintenance,
registration and deletion management on basic personnel information of the inspection
crew and an inspection task manager through identity card information, achieving automatic
query and display of the personnel information through an identity card reader, and
carrying out query, browse, edition and deletion operations on the inspection record
information of the inspection crew to accomplish the management of the inspection
personnel information;
an inspection equipment management module, used for managing inspection equipment
information, carrying out import, export, query, browse, registration, maintenance
and deletion operations on the equipment information, maintaining the state information
of the inspection equipment, comprising idle, inspection use, maintenance or servicing
state, and achieving effective management and use of the inspection equipment; and
the data storage module, used for storing system data in the mode of a database and
a file, wherein the data storage module is used for storing basic system data of a
centralized management subsystem, the inspection process data, the inspection result
data and the inspection monitoring data, and inspection video data is stored in a
file, and a storage file path is stored in the database.
3. The centralized monitoring system for transmission line inspection of unmanned aerial
vehicles of claim 2, wherein,
the inspection task planning module comprises an inspection task planning unit, an
inspection task management unit and an inspection task information synchronization
unit; the inspection task planning unit is connected with the inspection equipment
management module, the inspection personnel management module, the GIS module and
the transmission line management module, and is used for planning the inspected transmission
line, the equipment, the personnel and the unmanned aerial vehicle on a GIS map, and
determining the inspection factors; the inspection task management unit is connected
with the inspection task planning unit and is used for managing the planed inspection
task; and the inspection task information synchronization unit is connected with the
inspection task management unit and is used for synchronizing the selected unmanned
aerial vehicle inspection task information to the corresponding mobile substation.
4. The centralized monitoring system for transmission line inspection of unmanned aerial
vehicles of claim 2, wherein the inspection task monitoring module comprises a mobile
substation monitoring unit, a flight state monitoring unit, a pod monitoring unit
and a meteorological environment monitoring unit, the mobile substation monitoring
unit is used for monitoring the GPS information of the mobile substation, recording
the motion track of the mobile substation on the GIS map and recording its historical
motion tracks; the flight state monitoring unit is used for monitoring the state information
of the unmanned aerial vehicle, comprising the flight GPS coordinates, the speed,
the height, the rotating speed, the total distance, the cylinder temperature, the
battery voltage, the battery current and the battery power; the pod monitoring unit
is used for monitoring the flight pod angle, the shooting time and the shooting GPS
position information of the unmanned aerial vehicle; and the meteorological environment
monitoring unit is used for displaying the meteorological environment information,
comprising the temperature, the humidity, the wind speed, the air density and the
altitude information.
5. The centralized monitoring system for transmission line inspection of unmanned aerial
vehicles of claim 2, wherein the inspection defect diagnosis module comprises a defect
expert database, a defect diagnosis unit, an image preprocessing unit and a defect
management unit, wherein the image preprocessing unit is used for preprocessing the
image information, carrying out definition and scene selection accuracy identification
on an original inspection image, deleting images with insufficient definition and
inaccurate scene selection, and splicing and editing diagnostic images; the defect
expert database is used for integrating feature libraries of transmission line defects,
is connected with the defect diagnosis unit, and is used for carrying out comparative
analysis on a preprocessed image and the defect expert database, analyzing the transmission
line defects and identifying corresponding defects on the image in the mode of position
identification and character illustration; the defect diagnosis unit is used for storing
the diagnosed defects in the data storage module; and the defect management unit is
used for achieving identification, modification, deletion, query and browse of the
inspection defect image.
6. The centralized monitoring system for transmission line inspection of unmanned aerial
vehicles of claim 1 or 2, wherein the mobile substation comprises:
a human-computer interaction module, used for obtaining and analyzing an external
command, sending the analyzed external command to a corresponding data processing
module for processing, displaying a corresponding processing result, inputting and
outputting system data, and accomplishing human-system interaction;
an inspection task synchronization module, used for synchronizing the inspection task
information in the centralized monitoring subsystem to the local, carrying out query
and state maintenance on the inspection task that is synchronized to the local, and
setting a current inspection task to accomplish the synchronization and the management
of the inspection task information;
a pod control module, used for monitoring and controlling a pod on the unmanned aerial
vehicle flight platform, reading pod information which comprises, but not limited
to, the pod angle, the battery power, the battery voltage, the battery current, the
shooting time and the shooting GPS value in real time, as well as releasing a control
instruction according to the external instruction, controlling the pod angle, executing
a shooting action and stopping the shooting action, so as to monitor the pod on the
unmanned aerial vehicle flight platform;
a GIS module, used for importing, exporting and displaying the transmission line information
of the inspection task, providing frame selection and GPS position positioning operations
of the GIS map, and providing a calibration operation function of a GPS position point
on the GIS map;
a flight control module, used for monitoring and controlling the state information
of the unmanned aerial vehicle flight platform, reading the GPS information, the speed,
the height, the rotating speed, the total distance, the cylinder temperature, the
battery voltage, the battery current and the battery power information of the unmanned
aerial vehicle flight platform in real time, and releasing a command to the unmanned
aerial vehicle flight platform according to the external instruction to control the
unmanned aerial vehicle flight platform;
a flight task planning module, used for planning takeoff/landing points, a suspension
point, track points, a corresponding flight height, a flight speed and a line distance
of unmanned aerial vehicle inspection on the GIS map according to the transmission
line information, the geographical environment information and the meteorological
environment information of the unmanned aerial vehicle inspection, generating a corresponding
flight route, and carrying out query, browse, deletion, import and export operations
on the flight task information of the unmanned aerial vehicle to accomplish the management
and the plan of the flight task;
a defect pre-diagnosis module, used for editing and splicing images, screening out
images with potential defect possibility, identifying the defect information and the
defect position information in image information, and carrying out identification,
modification, deletion, query and browse operations on the corresponding defect information
to accomplish the defect diagnosis and management of the inspection result;
an image preprocessing module, used for preprocessing and managing the inspected image
information, carrying out browse, edition, screening and preprocessing operations
on the corresponding defect information, screening out images with insufficient shooting
definition, inaccurate shooting angle and inaccurate scene selection among shot images,
carrying out denoising processing on the images, and adjusting the definition and
the contrast of the images to achieve the preprocessing of the image information;
a meteorological monitoring module, which is used for monitoring the meteorological
information of an inspection site of the unmanned aerial vehicle in real time, and
is connected with the flight task monitoring module by a matching interface to send
the monitored meteorological information to the centralized monitoring subsystem;
a flight task monitoring module, used for monitoring the flight state information,
the meteorological information of the inspection site and the GPS position information,
and displaying the same in the human-computer interaction module, as well as sending
the corresponding flight task monitoring information to the centralized monitoring
subsystem by a communication module;
a data storage module, used for storing the system data, and storing the basic system
data of the centralized management subsystem, the inspection process data, the inspection
result data and the inspection monitoring data through the data, wherein the inspection
video data is stored in the file, and the storage file path is stored in the database;
a GPS module, which is used for achieving GPS positioning of the mobile substation,
and is connected with the flight task monitoring module through a serial port to send
the GPS information of the mobile substation to the centralized monitoring subsystem;
and
the communication module, used for realizing the data interaction with the centralized
monitoring subsystem, synchronizing the inspection task information from the centralized
monitoring subsystem and sending the inspection data and the inspection monitoring
data to the centralized monitoring subsystem, wherein the communication module can
also be used for reading the unmanned aerial vehicle state information and the inspection
video information of the unmanned aerial vehicle flight platform through a data transmission
module and an image transmission module.
7. The centralized monitoring system for transmission line inspection of unmanned aerial
vehicles of claim 6, wherein the inspection task synchronization module comprises
an inspection task information synchronization unit, an inspection task query unit
and a current inspection task setting unit; the inspection task information synchronization
unit is used for synchronizing the inspection task information; the inspection task
query unit is used for querying the inspection task information on the mobile substation;
and the current inspection task setting unit is used for setting a current default
inspection task.
8. The centralized monitoring system for transmission line inspection of unmanned aerial
vehicles of claim 6, wherein the flight task planning module comprises a flight planning
unit, a flight task information import and export unit and a flight task information
management unit; the flight planning unit is used for planning the takeoff/landing
points, the suspension point, the track points, the corresponding flight height, the
flight speed and the line distance of the inspection unmanned aerial vehicle; the
flight task information management unit is used for querying, browsing and deleting
the flight task information; and the flight task import and export unit is used for
importing and exporting a corresponding flight task file.
9. A centralized monitoring method for transmission line inspection of unmanned aerial
vehicles of claim 1, wherein the specific flow is as follows:
first step, inspection task allocation: inspection tasks are allocated according to
the information of inspected transmission lines and the monitored state information
of the mobile substation, a transmission line section, an inspection time, an inspection
type and an inspection target corresponding to each inspection task are determined,
and inspection personnel and equipment are configured for each inspection task. The
monitoring on the state information of the mobile substation in the stage is monitoring
the GPS position information of the mobile substation, the integrity of mobile substation
equipment, the full extent of crew and the like, so as to allocate the corresponding
inspection task;
second step, inspection task execution: corresponding inspection task information
is audited, and the audited inspection task information is released to the corresponding
mobile substation to execute the corresponding inspection task; in the inspection
task execution stage, the execution condition of the inspection task is monitored
in a wireless communication mode, and the equipment state of the mobile substation,
the GPS position information and the meteorological environmental information of the
mobile substation site are monitored;
third step, new construction of a flight task: the mobile substation plans the flight
task corresponding to the inspection task according to the released inspection task
information, and determines that the inspection task accomplishes the necessary flight
task and one flight task corresponds to one takeoff/landing flight inspection of the
airplane; and in the new construction of the flight task, the inspection tower and
the transmission line section corresponding to the flight task, and monitoring equipment
corresponding to the flight task should be determined, a corresponding flight route
is planned, and if the flight route is present, it is directly imported;
fourth step, flight task execution: the mobile substation sends the flight route information
in the flight task to be executed to the flight control module, and the unmanned aerial
vehicle is started to carry out flight inspection; in the inspection process, the
flight task is monitored, and the flight state, the pod state, the flight track and
the meteorological information are mainly monitored;
fifth step, flight task accomplishment: corresponding inspection result data is imported
in the mobile substation, the inspection image information is preprocessed, a flight
report is generated in combination with flight process information, the flight report,
the flight result data, the flight process data and the flight monitoring data are
sent to the centralized monitoring subsystem, and the flight monitoring data is transmitted
to the centralized monitoring subsystem in real time;
sixth step, inspection task accomplishment: the centralized monitoring subsystem carries
out inspection defect diagnosis on the inspection result data and the main inspection
image information to determine the inspection defects; verifies and diagnoses the
defects primarily provided in the flight report; checks the completion degree of the
inspection task, and ensures that the completion degree of the inspection task is
100%;
seventh step, inspection result processing; and
eighth step, inspection task closure: the centralized management subsystem generates
a corresponding inspection report according to inspection process information, result
information and defect information, and provides inspection process description and
inspection result description; and the centralized management subsystem carries out
defect elimination on the inspection defects in the corresponding inspection report
and reflects a defect elimination result in the inspection report.
10. The centralized monitoring method for transmission line inspection of unmanned aerial
vehicles of claim 9, wherein the inspection result processing flow is as follows:
first step, image preprocessing: shot image copy information in the inspection result
is preprocessed, images with insufficient shooting definition, inaccurate shooting
angle and inaccurate scene selection among the shot images are screened out, denoising
processing is carried out on the images, and the definition and the contrast of the
images are adjusted;
second step, defect diagnosis: a defect sample that is provided according to the defect
expert database is diagnosed, whether the information in the images has defects is
determined, a defect layer is added on the image, the defects are identified on a
new image layer by squares or circles and character illustration, and a diagnosis
result is saved in the database; and
third step, manual defect processing: manual confirmation is carried out on the defect
information saved in the database to determine whether the defects are diagnosed,
and re-identification, deletion, modification and browse operations are carried out
on corresponding defects; and image management is carried out to browse the original
image information and identify the manually found defects.