|
(11) | EP 3 115 858 A1 |
| (12) | EUROPEAN PATENT APPLICATION |
| published in accordance with Art. 153(4) EPC |
|
|
|
|
|||||||||||||||||||||||
| (54) | CENTRALIZED MONITORING SYSTEM AND MONITORING METHOD FOR UNMANNED AERIAL VEHICLE TO PATROL POWER TRANSMISSION LINE |
| (57) The present invention discloses a centralized monitoring system for transmission
line inspection of unmanned aerial vehicles, including a centralized monitoring subsystem,
mobile substations and unmanned aerial vehicle flight platforms. The centralized monitoring
subsystem is connected with the mobile substations in a one-to-many mode, the mobile
substations are connected with the unmanned aerial vehicle flight platforms in a one-to-one
mode, in a manner of combining remote centralized monitoring with local monitoring,
centralized monitoring is carried out on the flight states, pod states, transmission
lines, inspection results and other information of more than one accessed unmanned
aerial vehicle for line inspection, personnel, equipment and inspection lines involved
in an unmanned aerial vehicle inspection task are planned and managed, and centralized
management and defect diagnosis are carried out on the inspection results, so as to
reinforce the informatization and automation degrees of the unmanned aerial vehicle
inspection process and inspection result processing, improve the unmanned aerial vehicle
inspection efficiency, and provide technical supports for achieving safe and reliable
operation of unmanned aerial vehicle line inspection. |
Field of the Invention
[0001] The present invention belongs to the field of maintenance and overhaul of power system equipment, relates to the field of transmission line inspection of unmanned aerial vehicles, and particularly relates to a centralized monitoring system and monitoring method for transmission line inspection of unmanned aerial vehicles.
Background of the Invention
[0002] Unmanned aerial vehicle line inspection plays an increasingly important role in transmission line inspection. An unmanned aerial vehicle line inspection system can partially replace a line inspection worker and a manned aerial vehicle line inspection system, can inspect a transmission and transformation line at the right time, find faults and hidden troubles of the line in time, and transmit back the onsite condition to a ground control center in time, in order to make right judgments and remove the line faults in time. The workload of power service personnel can be greatly relieved to reduce the probability of personnel risks that may occur, reduce the maintenance cost of power equipment and improve the safety and reliability of a power grid.
[0003] There is a certain risk for adopting the unmanned aerial vehicle in the transmission line inspection, particularly in the transmission line inspection of mountain areas, plateaus and other areas with harsh natural environments and varied climates. The transmission line inspection of the unmanned aerial vehicle at home and abroad is in a pilot and assessment stage, and operation parameters of unmanned aerial vehicle inspection, especially the flight state information of the unmanned aerial vehicle, the pod state information, the inspection result data of the unmanned aerial vehicle and the like need to be collected and stored at this stage, in order to achieve effective monitoring of the unmanned aerial vehicle inspection. In order to comprehensively assess and analyze the technical economy and reliability of the existing unmanned aerial vehicle line inspection, provide supports for improving the operation management of the unmanned aerial vehicle line inspection and achieve the safe and reliable operation of the unmanned aerial vehicle line inspection, centralized monitoring needs to be carried out on the unmanned aerial vehicle inspection by modem technical means and management methods.
[0004] At present, monitoring systems for unmanned aerial vehicle line inspection are few at home, the majority of various provided methods are in the testing stage, and are used for monitoring a single unmanned aerial vehicle instead of carrying out centralized monitoring on a plurality of inspection unmanned aerial vehicles. The monitored objects are generally image data of the unmanned aerial vehicle inspection, the monitoring on the state information of the unmanned aerial vehicle inspection, the pod information and the meteorological information is little, and the informatization and automation degrees on the inspection result data processing are low.
[0005] The patent "unmanned aerial vehicle monitoring system for power line inspection" with an application number 201120477071.2 is proposed to carry out real-time video monitoring on the unmanned aerial vehicle by a ground monitoring system. The patent "wireless video monitoring system for unmanned aerial vehicle" with an application number 201120186312.8 is proposed to carry out real-time remote video monitoring on the unmanned aerial vehicle in a WCDMA communication mode. The monitoring means and monitored objects of both the patents are single, and the state information of the unmanned aerial vehicle inspection, particularly the flight state information of the unmanned aerial vehicle, the pod state information, the ground mobile substation station and the like cannot be comprehensively reflected by the video monitoring.
[0006] In the patent "real-time positioning and monitoring management system for unmanned aerial vehicles" with an application number 201020519831.7, the GPS positioning information of the unmanned aerial vehicles is uploaded to the monitoring system in real time by wireless communication for positioning and monitoring a plurality of unmanned aerial vehicles. The monitoring of the system is only directed to the GPS information of the unmanned aerial vehicles, so the real-time flight state information of the unmanned aerial vehicles cannot be effectively monitored, and the patent is not applied to a power system.
[0007] In the patent "real-time unmanned aerial vehicle line inspection system" with an application number 201010595330.1, the real-time monitoring of unmanned aerial vehicle line inspection data is achieved by a ground control station, and the inspection image information is uploaded to the internet through a 3G channel, so that only remote image monitoring can be achieved, but effective remote monitoring of the state information of the unmanned aerial vehicle, the pod state information and the ground mobile substation information cannot be achieved. The system involved in the patent does not carry out subsequent automatic processing on the inspection result data, and particularly, only one-to-one monitoring can be achieved between the monitoring system and the unmanned aerial vehicle, so the inspection information of a plurality of unmanned aerial vehicles cannot be effectively monitored at the same time.
[0008] In summary, the effects of the existing monitoring methods of the unmanned aerial vehicle inspection are not satisfactory, and there are a lot of problems to be solved.
Summary of the Invention
[0009] The objective of the present invention is to overcome the shortcomings in the prior art and provide a centralized monitoring system and monitoring method for transmission line inspection of unmanned aerial vehicles. In a manner of combining remote centralized monitoring and local monitoring, centralized monitoring is carried out on flight states, pod states, transmission lines, inspection results and other information of more than one accessed unmanned aerial vehicle for line inspection, so as to reinforce the informatization and automation degrees of the unmanned aerial vehicle inspection process and inspection result processing, improve the unmanned aerial vehicle inspection efficiency, and provide technical supports for achieving safe and reliable operation of unmanned aerial vehicle line inspection.
[0010] To achieve the above objective, the present invention adopts the following technical solutions.
[0011] A centralized monitoring system for transmission line inspection of unmanned aerial vehicles includes a centralized monitoring subsystem, mobile substations and unmanned aerial vehicle flight platforms. The centralized monitoring subsystem is connected with the mobile substations in a one-to-many mode, and the mobile substations are connected with the unmanned aerial vehicle flight platforms in a one-to-one mode.
[0012] Wherein, the centralized monitoring subsystem is used for accessing the state information and inspection data of the mobile substation and the unmanned aerial vehicle flight platform, planning and synchronizing an unmanned aerial vehicle inspection task, carrying out real-time remote monitoring on the mobile substation and the unmanned aerial vehicle flight platform for the unmanned aerial vehicle inspection, carrying out defect diagnosis, statistics, analysis and display on the inspection data, and describing a real-time state scene and a power environment of the inspection of the current unmanned aerial vehicle;
wherein, the mobile substation is used for planning and releasing a flight task, carrying out local monitoring on the inspection state information and the inspection data, preprocessing inspection image data and carrying out defect pre-diagnosis on the inspection result data.
[0013] Wherein, the unmanned aerial vehicle flight platform includes a pod module serving as a line detection terminal, a flight control module for carrying out flight control on the unmanned aerial vehicle flight platform, a GPS module for carrying out GPS positioning, a communication module for communicating with the mobile substation and an unmanned aerial vehicle airframe. The flight control module, the pod module and the GPS module respectively communicate with the mobile substation through data transmission communication links; and the pod module sends detection image information into the mobile substation through an image transmission communication link. The pod module includes a visible light camera and/or an infrared thermal imaging camera and/or an ultraviolet imaging camera, etc.
[0014] The centralized monitoring subsystem includes a human-computer interaction module, an inspection task planning module, an inspection equipment management module, an inspection personnel management module, a GIS module, a transmission line management module, an inspection defect diagnosis module, an inspection report management module, a data storage module, an inspection result management module, a defect elimination module, an inspection task monitoring module and a communication module.
[0015] The human-computer interaction module is used for obtaining and analyzing an external command, sending the analyzed external command to a corresponding data processing module for processing, and displaying a corresponding processing result; the human-computer interaction module adopts the current unmanned aerial vehicle manipulation equipment or is selected from a remote controller, a keyboard, a mouse, audio equipment, a display and a multichannel circular-screen stereo projection system, is used for obtaining and analyzing the external command, sending the analyzed external command to the corresponding data processing module, and displaying the processing result in audio, video, image and other modes.
[0016] The inspection task planning module is used for carrying out task division on a transmission line inspected by the unmanned aerial vehicle, determining the transmission line sections inspected by the inspection machine sets, the necessary inspection equipment and the inspection crew and specifying the planned inspection time and the like according to the reliability of the inspection equipment, the inspection records of the personnel, the inspection geographical environment, the meteorological environment and other influence factors, carrying out query, new construction, edition, audit, notification, release and other operations on the planned inspection task to accomplish the plan of the inspection task; and the inspection task planning module includes an inspection task planning unit, an inspection task management unit and an inspection task information synchronization unit. The inspection task planning unit is connected with the inspection equipment management module, the inspection personnel management module, the GIS module and the transmission line management module, and is used for planning the inspected transmission line, the equipment, the personnel and the unmanned aerial vehicle on a GIS map, and determining the inspected transmission line, the equipment, the personnel and the time and other factors according to the reliability of the equipment, the skill mastery of the personnel, the complexity of the inspection geographical environment, the importance of the line, the seasonal factor, the economical efficiency and other influence factors; the inspection task management unit is connected with the inspection task planning unit and is used for carrying out query, new construction, edition, audit and other managements on the planed inspection task; and the inspection task information synchronization unit is connected with the inspection task management unit and is used for synchronizing the selected unmanned aerial vehicle inspection task information to the corresponding mobile substation.
[0017] The inspection task monitoring module is used for monitoring the meteorological environment information of an unmanned aerial vehicle inspection site, the flight state information of the unmanned aerial vehicle, the state information of the mobile substation, the GPS position information, the pod control information and other real-time state information and power environment information, and describing the real-time state scene and the power environment of the current inspection of the unmanned aerial vehicle in video and image modes; and the inspection task monitoring module includes a mobile substation monitoring unit, a flight state monitoring unit, a pod monitoring unit and a meteorological environment monitoring unit, is used for monitoring the real-time state information and the power environment information of the inspection site of the unmanned aerial vehicle, is connected with the communication module and the human-computer interaction module, and is used for describing the real-time state scene and the power environment of the current inspection of the unmanned aerial vehicle in the video and image modes. Wherein, the mobile substation monitoring unit is used for monitoring the GPS information of the mobile substation, recording the motion track of the mobile substation on the GIS map and recording its historical motion tracks; the flight state monitoring unit is used for monitoring the flight GPS coordinates, the speed, the height, the rotating speed, the total distance, the cylinder temperature, the battery voltage, the battery current, the battery power and other state information of the unmanned aerial vehicle; the pod monitoring unit is used for monitoring the flight pod angle, the shooting time, the shooting GPS position information and the like of the unmanned aerial vehicle; and the meteorological environment monitoring unit is used for displaying the temperature, the humidity, the wind speed, the air density (air pressure), the altitude information and other meteorological environment information.
[0018] The inspection result management module is used for managing the inspection result data of the unmanned aerial vehicle, is connected with the communication module and the data storage module for achieving synchronization, browse, play, comparison, analysis and report management of the inspection result data, and accomplishing the management of the inspection result data.
[0019] The inspection defect diagnosis module is used for carrying out screening, preprocessing and defect diagnosis on the inspection result data that includes image and video information, marking a defect position on an inspection image, illustrating the defect in characters, storing the inspection defect in a database, and carrying out identification, modification, deletion, query, browse and other operations on the corresponding inspection defect image to accomplish the defect diagnosis of the inspection result; the inspection defect diagnosis module includes a defect expert database, a defect diagnosis unit, an image preprocessing unit and a defect management unit, wherein the image preprocessing unit is used for preprocessing the image information, carrying out definition and scene selection accuracy identification on an original inspection image, deleting images with insufficient definition and inaccurate scene selection, and splicing and editing diagnostic images; the defect expert database is used for integrating feature libraries of transmission line defects, is connected with the defect diagnosis unit, and is used for carrying out comparative analysis on a preprocessed image and the defect expert database, analyzing the transmission line defects and identifying corresponding defects on the image in the mode of position identification and character illustration; the defect diagnosis unit is used for storing the diagnosed defects in the data storage module; and the defect management unit is used for achieving identification, modification, deletion, query, browse and the like of the inspection defect image.
[0020] The inspection report management module is used for generating an inspection task report of the unmanned aerial vehicle inspection task, describing the transmission line, the equipment, the personnel, the time, the flight task report and the flight log information of the corresponding inspection task and the found defect information, and carrying out browse, edition, deletion, audit and other operations on the inspection report to accomplish the management of the inspection report; and
the defect elimination module is used for processing the inspection defect information in the inspection report, triggering a defect elimination flow by the inspected transmission line defects, and carrying out release, allocation, notification, elimination, elimination confirmation and other operations on a defect elimination task to accomplish an elimination operation of the inspection defects found by the unmanned aerial vehicle inspection; and the defect elimination module includes a defect task release unit, a defect task push unit and a defect elimination confirmation unit. The defect task release unit is used for releasing an inspection defect task and can allocate the inspection defect task; the defect task push unit is used for sending the defect task information to operation and maintenance defect elimination personnel of the transmission line section to which the defects belong in a form of a message, a mail and a short message, and the operation and maintenance defect elimination personnel execute a defect elimination task; and the defect elimination confirmation unit is used by the operation and maintenance defect elimination personnel for accomplishing the defect elimination task, and confirming the accomplishment of the defect elimination task after submitting a corresponding defect elimination proof image.
[0021] The GIS module is used for importing and exporting transmission line information, the transmission line information is displayed in the GIS module, section division, selection, frame selection and other operations of the transmission line are provided, and the GIS module can be used for browsing, editing and deleting corresponding line information on the GIS map, as well as displaying the flight route information of the unmanned aerial vehicle on the GIS map; and the GIS module includes a GIS line information import and export unit, a line information display unit and a line information maintenance unit. Wherein, the GIS line information import and export unit is used for importing and exporting the transmission line information inspected by the unmanned aerial vehicle in the GIS map, and the import and export format includes, but not limited to, text, XML, CSV, EXCEL, WORD, PDF and other formats; the line information display unit is used for displaying the transmission line information on the GIS map; and the line information maintenance unit is used for browsing, editing and deleting corresponding line information on the GIS map.
[0022] The communication module is used for reading the real-time state information of the mobile substation, responding to a remote instruction of the human-computer interaction module, releasing the inspection task information to the mobile substation, obtaining the inspection information of the mobile substation and the unmanned aerial vehicle flight platform in real time, and accomplishing the information interaction and the communication of the centralized monitoring subsystem and the mobile substation; and the communication module can access the mobile substation through a GPRS wireless communication module and read the real-time state information of the mobile substation, and is used for responding to the remote instruction of the human-computer interaction module and obtaining the inspection information of the mobile substation and the unmanned aerial vehicle flight platform in real time. The communication module includes, but not limited to, wireless mobile communication of the current GSM, GPRS, CDMA, WCDMA, TD-SCDMA and LTE communication systems, wifi wireless communication, and local area network and internet communication.
[0023] The transmission line management module is used for carrying out import, export, query, browse, deletion, edition and other operations on a tower GPS position, a tower model number, a tower height, a starting tower serial number, tower serial numbers and other information of the transmission line to accomplish the management of the transmission line information; and the transmission line management module includes a line information import and export unit, a line information query unit and a line information maintenance unit. Wherein, the line information import and export unit is used for importing and exporting the tower GPS position, the tower model number, the tower height, the starting tower serial number, the tower serial numbers and other information of the transmission line, and the import and export format includes, but not limited to, text, XML, CSV, EXCEL, word, pdf, etc. The line information query unit can query the transmission line information through the line serial number, the tower position, the tower serial numbers, the GPS position and the like, and can also be connected with the GIS module to query corresponding line information on the GIS map; and the line information maintenance unit is used for browsing, deleting and editing the line information.
[0024] The inspection personnel management module is used for carrying out query, maintenance, registration and deletion management on basic personnel information of the inspection crew and an inspection task manager through identity card information, achieving automatic query and display of the personnel information through an identity card reader, and carrying out query, browse, edition and deletion operations on the inspection record information of the inspection crew to accomplish the management of the inspection personnel information; and the inspection personnel management module includes the identity card reader, a personnel information management unit and an inspection record management unit. Wherein, the identity card reader is used for reading the identity card number information of the inspection personnel, and is connected with the personnel information management unit by a serial port; the personnel information management unit is used for carrying on query, maintenance, registration and deletion on the basic information of the inspection personnel, and the personnel information management unit is connected with the identity card reader for achieving automatic query and display of the personnel information; and the inspection record management unit is used for carrying on query, browse, edition and deletion on the inspection records of the inspection personnel.
[0025] The inspection equipment management module is used for managing inspection equipment information, carrying out import, export, query, browse, registration, maintenance and deletion operations on the equipment information, maintaining the state information of the inspection equipment, including idle, inspection use, maintenance, servicing or other states, and achieving effective management and use of the inspection equipment; and the inspection equipment management module includes an equipment information import and export unit, an equipment information query unit and an equipment information management unit. Wherein, the equipment information import and export unit is used for importing and exporting the equipment information, and the import and export format includes, but not limited to, text, XML, EXCEL, word, pdf and other formats; the equipment information query unit is used for querying the equipment information, and can query the equipment information by an equipment name, a serial number, a category tree, a fuzzy query and other modes; and the equipment information management unit is used for registering, maintaining and deleting the equipment information.
[0026] The data storage module is used for storing system data in a database, a file and other modes, the data storage module is used for storing basic system data of a centralized management subsystem, the inspection process data, the inspection result data, the inspection monitoring data and the like, wherein inspection video data is stored in a file, and a storage file path is stored in the database.
[0027] The mobile substation includes a human-computer interaction module, an inspection task synchronization module, a pod control module, a GIS module, a flight control module, a flight task planning module, a defect pre-diagnosis module, an image preprocessing module, a meteorological monitoring module, a flight task monitoring module, a data storage module, a GPS module and a communication module.
[0028] The human-computer interaction module is used for obtaining and analyzing an external command, sending the analyzed external command to a corresponding data processing module for processing, displaying a corresponding processing result, inputting and outputting system data, and accomplishing human-system interaction; and the human-computer interaction module adopts the current unmanned aerial vehicle manipulation equipment or is selected from a remote controller, displacement tracking equipment, a motion platform with six degrees of freedom, a keyboard, a mouse, audio equipment, a display and a multichannel circular-screen stereo projection system.
[0029] The inspection task synchronization module is used for synchronizing the inspection task information in the centralized monitoring subsystem to the local, carrying out query and state maintenance on the inspection task that is synchronized to the local, setting a current inspection task and carrying out other operations to accomplish the synchronization and the management of the inspection task information; and the inspection task synchronization module includes an inspection task information synchronization unit, an inspection task query unit and a current inspection task setting unit, and is used for synchronizing the inspection task information in the centralized monitoring subsystem to the local. The inspection task information synchronization unit is used for synchronizing the inspection task information; the inspection task query unit is used for querying the inspection task information on the mobile substation; and the current inspection task setting unit is used for setting a current default inspection task.
[0030] The pod control module is used for monitoring and controlling a pod on the unmanned aerial vehicle flight platform, reading pod information which includes, but not limited to, the pod angle, the battery power, the battery voltage, the battery current, the shooting time, the shooting GPS value and the like in real time, as well as releasing a control instruction according to the external instruction, controlling the pod angle, executing a shooting action and stopping the shooting action, so as to monitor the pod on the unmanned aerial vehicle flight platform.
[0031] The GIS module is used for importing, exporting and displaying the transmission line information of the inspection task, providing frame selection, GPS position positioning and other operations of the GIS map, and providing calibration operation and other operations of a GPS position point on the GIS map. The GIS module includes a GIS line information import unit and a line information display unit. The GIS line information import unit is used for importing the GIS line information, wherein the import file format includes, but not limited to, text, XML, CSV, EXCEL, WORD, PDF and the like; and the line information display unit is used for displaying the transmission line information on the GIS map.
[0032] The flight control module is used for monitoring and controlling the state information of the unmanned aerial vehicle flight platform, reading the GPS information, the speed, the height, the rotating speed, the total distance, the cylinder temperature, the battery voltage, the battery current, the battery power and other information of the unmanned aerial vehicle flight platform in real time, and releasing a command to the unmanned aerial vehicle flight platform according to the external instruction to control the unmanned aerial vehicle flight platform. The flight control module includes a flight monitoring unit and a flight control unit. Wherein, the flight monitoring unit is connected with the communication module and is used for monitoring the information of the unmanned aerial vehicle flight platform in real time, and the information includes, but not limited to, the GPS information, the speed, the height, the rotating speed, the total distance, the cylinder temperature, the battery voltage, the battery current, the battery power and the like; and the flight control unit is connected with the communication module and is used for releasing the command to the unmanned aerial vehicle flight platform according to the external instruction to control the unmanned aerial vehicle flight platform.
[0033] The flight task planning module is used for planning takeoff/landing points, a suspension point, track points, a corresponding flight height, a flight speed, a line distance and the like of unmanned aerial vehicle inspection on the GIS map according to the transmission line information, the geographical environment information, the meteorological environment information and the like of the unmanned aerial vehicle inspection, generating a corresponding flight route, and carrying out query, browse, deletion, import, export and other operations on the flight task information of the unmanned aerial vehicle to accomplish the management and the plan of the flight task. The flight task planning module includes a flight planning unit, a flight task information import and export unit and a flight task information management unit. Wherein, the flight planning unit is used for planning the takeoff/landing points, the suspension point, the track points, the corresponding flight height, the flight speed, the line distance and the like of inspection unmanned aerial vehicle with the transmission line information, the GIS geographical information, the meteorological information and the like of the inspected line section as constraint factors. The flight task information management unit is used for querying, browsing and deleting the flight task information. The flight task import and export unit can import and export a corresponding flight task file, and the import and export file format includes, but not limited to, a flight task description file, or text, XML, CSV, EXCEL, WORD, BMP, JPEG, GIF, TIFF, TGA, EXIF, etc.
[0034] The defect pre-diagnosis module is used for editing and splicing images, screening out images with potential defect possibility, identifying the defect information and the defect position information in image information, and carrying out identification, modification, deletion, query, browse and other operations on the corresponding defect information to accomplish the defect diagnosis and management of the inspection result.
[0035] The image preprocessing module is used for preprocessing and managing the inspected image information, carrying out browse, edition, screening and preprocessing operations on the corresponding defect information, screening out images with insufficient shooting definition, inaccurate shooting angle and inaccurate scene selection among shot images, carrying out denoising processing on the images, and adjusting the definition and the contrast of the images to achieve the preprocessing of the image information. The image preprocessing module includes an image browsing unit, an image editing unit, an image screening unit and an image preprocessing unit. Wherein, the image browsing unit is used for browsing the image information; the image editing unit is used for carrying out manual edition and deletion operation on the image; the image screening unit is used for screening out the image information with insufficient definition and accuracy from the image information; and the image preprocessing unit is used for carrying out the denoising processing on the image, and adjusting the definition and the contrast of the image to achieve the preprocessing of the image information.
[0036] The meteorological monitoring module is used for monitoring the meteorological information of an inspection site of the unmanned aerial vehicle in real time, and is connected with the flight task monitoring module by a matching interface to send the monitored meteorological information to the centralized monitoring subsystem; the meteorological monitoring module includes, but not limited to, an integrated meteorological monitoring instrument or a temperature sensor, a humidity sensor, a wind speed sensor, an air density (air pressure) sensor, an altitude tester and the like, and is used for monitoring the temperature, the humidity, the wind speed, the air density (air pressure), the altitude information and the like of the inspection site of the unmanned aerial vehicle in real time, and the equipment is connected with the flight task monitoring module by the matching interface.
[0037] The flight task monitoring module is used for monitoring the flight state information, the meteorological information of the inspection site, the GPS position information and the like, and displaying the same in the human-computer interaction module; and the flight task monitoring module can also be used for sending the corresponding flight task monitoring information to the centralized monitoring subsystem by the communication module.
[0038] The data storage module is used for storing the system data, and storing the basic system data of the centralized management subsystem, the inspection process data, the inspection result data, the inspection monitoring data and the like through the data, wherein the inspection video data is stored in the file, and the storage file path is stored in the database.
[0039] The GPS module is used for achieving GPS positioning of the mobile substation, and is connected with the flight task monitoring module through a serial port to send the GPS information of the mobile substation to the centralized monitoring subsystem; and
the communication module is used for realizing the data interaction with the centralized monitoring subsystem, synchronizing the inspection task information from the centralized monitoring subsystem and sending the inspection data and the inspection monitoring data to the centralized monitoring subsystem; and the communication module can also be used for reading the unmanned aerial vehicle state information and the inspection video information of the unmanned aerial vehicle flight platform through a data transmission module and an image transmission module. The communication module includes a wireless communication unit, a wired communication unit, a data transmission unit and an image transmission unit. The wireless communication unit adopts communication modules, including, but not limited to, wireless mobile communication of the current GSM, GPRS, CDMA, WCDMA, TD-SCDMA and LTE communication systems, and wifi wireless communication; the wired communication unit communicates through the Ethernet to achieve information interaction; the data transmission unit achieves the data communication with the unmanned aerial vehicle flight platform through a data transmission radio; and the image transmission unit receives the video information sent by the unmanned aerial vehicle flight platform through an image transmission antenna.
[0040] The present invention further provides a centralized monitoring method for transmission line inspection of unmanned aerial vehicles, including three parts: inspection task execution, inspection result processing and inspection task monitoring. The specific flow is as follows:
first step, inspection task allocation: inspection tasks are allocated according to the information of inspected transmission lines and the monitored state information of the mobile substation, a transmission line section, an inspection time, an inspection type, an inspection target and other information corresponding to each inspection task are determined, and inspection personnel and equipment are configured for each inspection task. The monitoring on the state information of the mobile substation in the stage is monitoring the GPS position information of the mobile substation, the integrity of mobile substation equipment, the full extent of crew and the like, so as to allocate the corresponding inspection task.
Second step, inspection task execution: corresponding inspection task information is audited, and the audited inspection task information is released to the corresponding mobile substation to execute the corresponding inspection task. In the inspection task execution stage, the execution condition of the inspection task is monitored in a wireless communication mode, and the equipment state of the mobile substation, the GPS position information and the meteorological environmental information of the mobile substation site are monitored.
Third step, new construction of a flight task: the mobile substation plans the flight task corresponding to the inspection task according to the released inspection task information, and determines that the inspection task accomplishes the necessary flight task and one flight task corresponds to one takeoff/landing flight inspection of the airplane; and in the new construction of the flight task, the inspection tower and the transmission line section corresponding to the flight task, and monitoring equipment (infrared, ultraviolet or visible light) corresponding to the flight task should be determined, a corresponding flight route is planned, and if the flight route is present, it is directly imported.
Fourth step, flight task execution: the mobile substation sends the flight route information in the flight task to be executed to the flight control module, and the unmanned aerial vehicle is started to carry out flight inspection. In the inspection process, the flight task is monitored, and the flight state, the pod state, the flight track and the meteorological information are mainly monitored.
Fifth step, flight task accomplishment: corresponding inspection result data should be imported in the mobile substation, the inspection image information is preprocessed, a flight report is generated in combination with flight process information, the flight report, the flight result data, the flight process data and the flight monitoring data are sent to the centralized monitoring subsystem, and the flight monitoring data needs to be transmitted to the centralized monitoring subsystem in real time.
Sixth step, inspection task accomplishment: the centralized monitoring subsystem carries out inspection defect diagnosis on the inspection result data and the main inspection image information to determine the inspection defects; verifies and diagnoses the defects primarily provided in the flight report; checks the completion degree of the inspection task, and ensures that the completion degree of the inspection task is 100%. The check method is as follows: 1) a transmission line length inspected in the flight task is the inspection transmission line length regulated in the inspection task; and 2) flight inspection is carried out on line towers involved in the inspection task.
Seventh step, inspection result processing.
Eighth step, inspection task closure: the centralized management subsystem generates a corresponding inspection report according to inspection process information, result information and defect information, and provides inspection process description and inspection result description; and the centralized management subsystem carries out defect elimination on the inspection defects in the corresponding inspection report and reflects a defect elimination result in the inspection report.
[0041] The inspection result processing flow is as follows:
first step, image preprocessing: shot image copy information in the inspection result is preprocessed, images with insufficient shooting definition, inaccurate shooting angle and inaccurate scene selection among the shot images are screened out, denoising processing is carried out on the images, and the definition and the contrast of the images are adjusted;
second step, defect diagnosis: a defect sample that is provided according to the defect expert database is diagnosed, whether the information in the images has defects is determined, a defect layer is added on the image, the defects are identified on a new image layer by squares or circles and character illustration, and a diagnosis result is saved in the database; and
third step, manual defect processing: manual confirmation is carried out on the defect information saved in the database to determine whether the defects are diagnosed, and re-identification, deletion, modification and browse operations can be carried out on corresponding defects; and image management can be carried out to browse the original image information and identify the manually found defects.
[0042] The present invention has the beneficial effects that, according to the present invention, effective centralized monitoring of the accessed unmanned aerial vehicle inspection can be achieved, and statistical analysis can be carried out on the state data of the accessed unmanned aerial vehicle inspection, so as to improve the security and the reliability of the line inspection of the unmanned aerial vehicle.
[0043] Unified monitoring of the unmanned aerial vehicle inspection can be achieved in a centralized monitoring mode, which is conducive to analyzing the technical economy and the reliability of the unmanned aerial vehicle inspection and providing supports for the operation management of the unmanned aerial vehicle line inspection.
[0044] The real-time state information of the unmanned aerial vehicle line inspection and the shot image information are transmitted to the centralized monitoring subsystem in a GPRS communication mode in real time, and the inspection result data is automatically processed to improve the automation and informatization degrees of the line inspection, improve the line inspection efficiency and reduce the line inspection cost.
[0045] By means of the centralized monitoring of the state information of the unmanned aerial vehicle inspection, the scheduling personnel of the unmanned aerial vehicle inspection can effectively master the overall unmanned aerial vehicle inspection and can flexibly schedule the line inspection of the unmanned aerial vehicles, so as to improve the use efficiency of the unmanned aerial vehicles for line inspection, balance the used unmanned aerial vehicles for line inspection, prolong the service life of the unmanned aerial vehicles and reduce the use cost.
Brief Description of the Drawings
[0046]
Fig.1 is an architecture diagram of a centralized monitoring system for unmanned aerial vehicle inspection.
Fig.2 is a structural diagram of a centralized monitoring subsystem.
Fig.3 is a structural diagram of a mobile substation system.
Fig.4 is a flowchart of a monitoring method of the present invention.
Fig.5 is a flowchart of inspection result processing of the present invention.
Fig.6 is a flowchart of an unmanned aerial vehicle inspection task of the present invention.
Fig.7 is a flowchart of an unmanned aerial vehicle flight task of the present invention.
[0047] In the drawings:
1, centralized monitoring subsystem; 2, mobile substation; 3, unmanned aerial vehicle flight platform; 4, pod module; 5, flight control module; 6, first GPS module; 7, first communication module; 8, first human-computer interaction module; 9, inspection task planning module; 10, inspection equipment management module; 11, inspection personnel management module; 12, first GIS module; 13, transmission line management module; 14, inspection result management module; 15, inspection defect diagnosis module; 16, inspection report management module; 17, first data storage module; 18, inspection result management module; 18, defect elimination module; 19, inspection task monitoring module; 20, second communication module; 21, second human-computer interaction module; 22, inspection task synchronization module; 23, pod control module; 24, second GIS module; 25, flight control module; 26, flight task planning module; 27, defect pre-diagnosis module; 28, image preprocessing module; 29, meteorological monitoring module; 30, flight task monitoring module; 31, second data storage module; 32, second GPS module; 33, third communication module.
Detailed Description of the Embodiments
[0048] In order that the technical problems to be solved, technical solutions and beneficial effects in the present invention are clearer, a further detailed description of the present invention will be given below in combination with accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely used for explaining the present invention, rather than limiting the present invention.
[0049] As shown in Fig.1, it is a centralized monitoring system for unmanned aerial vehicle inspection. The system includes:
a centralized monitoring subsystem 1, mobile substations 2 and unmanned aerial vehicle flight platforms 3.
[0050] Wherein, the centralized monitoring subsystem 1 is simultaneously accessed and activated online with a plurality of mobile substations 2.
[0051] In the centralized monitoring subsystem 1, a human-computer interaction module 8 can select unmanned aerial vehicle manipulation equipment as basic human-computer interaction equipment, and meanwhile can also select or combine a remote controller, a keyboard, a mouse, audio equipment, a display and a multichannel circular-screen stereo projection system, which are configured according to demand;
an inspection task planning module 9 is connected with an inspection equipment management module 10, an inspection personnel management module 11, a first GIS module 12 and a transmission line management module 13, and is used for planning the inspected transmission line, the equipment, the personnel and the unmanned aerial vehicle on a GIS map, and determining the inspected transmission line, the equipment, the personnel and the time according to the reliability of the equipment, the skill mastery of the personnel, the complexity of the inspection geographical environment, the importance of the line, the seasonal factor, the economical efficiency and other influence factors; the inspection task planning module 9 is also connected with a second communication module 20 for sending inspection task information to the mobile substation 2, and the mobile substation 2 executes a corresponding inspection task;
an inspection task monitoring module 19 is connected with the second communication module 20 and the human-computer interaction module 8, and is used for reading real-time state information and power environment information of an unmanned aerial vehicle inspection site, and describing the real-time state scene and the power environment of the current inspection of the unmanned aerial vehicle in video and image modes;
an inspection result management module 14 is connected with the second communication module 20 and a first data storage module 17, and is used for reading and storing the inspection state data and the inspection result data of the unmanned aerial vehicle, and achieving browse, comparison, analysis and report management of the inspection data; an inspection defect diagnosis module 15 is connected with the first data storage module 17 and the inspection result management module 14, and is used for carrying out defect diagnosis on the inspection result data that includes inspection image, video and other information, displaying the corresponding defect diagnosis result on the image and the video in the mode of position identification and character illustration, as well as carrying out browse, edition and deletion on a defect processing result;
an inspection report management module 16 is connected with the inspection defect diagnosis module 15 and the first data storage module 17, and is used for generating an inspection task report of the unmanned aerial vehicle inspection task, describing the inspection process and the result information of the corresponding inspection task and the found defect information, and carrying out browse, edition, deletion and audit operations on the inspection report;
the inspection report management module 16 is interconnected with a defect elimination module 18 and the first communication module 20, and is used for announcing inspection defects listed in the inspection report and pushing the same to the defect elimination personnel in a form of a mail, a message and a short message, and the defect elimination personnel execute defect elimination;
the first GIS module 12 is associated with the transmission line management module 13, and is used for importing, displaying, editing, deleting and saving the transmission line information of the unmanned aerial vehicle inspection on the GIS map;
the second communication module 20 in the centralized monitoring subsystem 1 can access the mobile substation through GPRS wireless communication to read the real-time state information of the mobile substation, and is used for responding to a remote instruction of the human-computer interaction module, and obtaining the inspection information of the mobile substation and the unmanned aerial vehicle flight platform in real time. The second communication module 20 can also select wireless mobile communication of GSM, CDMA, WCDMA, TD-SCDMA and LTE communication systems, wifi wireless communication, and local area network and internet communication modes for communication;
the inspection defect diagnosis module 15 in the centralized monitoring subsystem 1 includes a defect expert database, a defect diagnosis unit, an image preprocessing unit and a defect management unit, wherein the image preprocessing unit is connected with the first data storage module 17 and is used for preprocessing an original image, and screening out images with insufficient definition and inaccurate scene selection; the defect expert database is connected with the defect diagnosis unit and is used for carrying out defect diagnosis according to the image information and identifying corresponding defects on the image in the form of position identification and character illustration;
the defect elimination module 18 in the centralized monitoring subsystem 1 includes a defect task release module, a defect task push module and a defect elimination confirmation module. Wherein, the defect task release module is connected with the defect task push module and is used for reading the defect task information and sending the same to operation and maintenance defect elimination personnel of the transmission line section to which the defects belong in a form of a message, a mail and a short message, and the operation and maintenance defect elimination personnel execute a defect elimination task; and the defect elimination confirmation module is used by the operation and maintenance defect elimination personnel for accomplishing the defect elimination task, and confirming the accomplishment of the defect elimination task after submitting a corresponding defect elimination proof image.
[0052] In the centralized monitoring subsystem 1, the transmission line management module 13 includes a line information import and export unit, a line information query unit and a line information maintenance unit. Wherein, the line information import and export unit is used for importing and exporting the transmission line information, and the import and export format can select an XML file format, as well as text, CSV, EXCEL, word, pdf, etc.
[0053] In the centralized monitoring subsystem 1, the inspection equipment management module 10 includes an equipment information import and export unit, an equipment information query unit and an equipment information management unit. Wherein, the equipment information import and export unit is used for importing and exporting the equipment information, and the import and export format can select an XML file format, as well as text, EXCEL, word, pdf, etc.
[0054] In the centralized monitoring subsystem 1, the first GIS module 12 includes a GIS line information import and export unit, a line information display unit and a line information maintenance unit. The GIS line information import and export file format can adopt an XML file, as well as text, CSV, EXCEL, WORD, PDF, etc.
[0055] As shown in Fig.3, the mobile substation 2 includes a second human-computer interaction module 21, an inspection task synchronization module 22, a pod control module 23, a second GIS module 24, a flight control module 25, a flight task planning module 26, a defect pre-diagnosis module 27, an image preprocessing module 28, a meteorological monitoring module 29, a flight task monitoring module 30, a second data storage module 31, a second GPS module 32 and a third communication module 33.
[0056] The second human-computer interaction module 21 adopts unmanned aerial vehicle manipulation equipment to achieve the human-computer interaction, and can also select or combine a remote controller, displacement tracking equipment, a motion platform with six degrees of freedom, a keyboard, a mouse, audio equipment, a display and a multichannel circular-screen stereo projection system.
[0057] The flight task planning module 26 is connected with the inspection task synchronization module 22, the pod control module 23, the flight control module 25 and the second GIS module 24, and is used for planning an unmanned aerial vehicle flight task.
[0058] The flight task planning module 26 includes a flight planning unit, a flight task information import and export unit and a flight task information management unit.
[0059] The flight task import and export unit can import and export a corresponding flight task file, and the import and export file format adopts an XML file format, and can also select or combine text, XML, CSV, EXCEL, WORD, BMP, JPEG, GIF, TIFF, TGA, EXIF, etc.
[0060] The defect pre-diagnosis module 27 is connected with the image preprocessing module 28 and the second data storage module 31, and is used for accomplishing the pre-diagnosis of the inspection result data in the mobile substation 2 and primarily filtering useless image information.
[0061] The flight task monitoring module 30 is associated with the meteorological monitoring module 29, the second GIS module 24 and the third communication module 33, and is used for monitoring the inspection task information and the inspection result data of the unmanned aerial vehicle flight platform 3.
[0062] The flight task monitoring module 30 is associated with the third communication module 33, and can send the read inspection task information and the inspection result data of the unmanned aerial vehicle and the mobile substation 2 to the centralized monitoring subsystem 1.
[0063] The meteorological monitoring module 29 can adopt an integrated meteorological monitoring instrument, and can also select or combine a temperature sensor, a humidity sensor, a wind speed sensor, an air density (air pressure) sensor, an altitude tester, etc.
[0064] The second GIS module 24 includes a GIS line information import unit and a line information display unit. The GIS line information import unit is used for importing the GIS line information, and the import file format can adopt XML, and can also select text, CSV, EXCEL, WORD, PDF and the like; and
the third communication module 33 includes a wireless communication unit, a wired communication unit, a data transmission unit and an image transmission unit. The wireless communication unit adopts the GPRS communication mode, and can also select or combine communication modules of wireless mobile communication of GSM, GPRS, CDMA, WCDMA, TD-SCDMA and LTE communication systems, and wifi wireless communication.
[0065] The unmanned aerial vehicle flight platform 3 mainly includes a pod module 4, a flight control module 5, a first GPS module 6, a first communication module 7 and an unmanned aerial vehicle airframe. The pod module 4, the flight control module 5 and the first GPS module 6 communicate with the mobile substation 2 through the first communication module 7. The first communication module 7 includes a data transmission unit and an image transmission unit, and can adopt a digital radio, as well as an analog radio. The pod module 4 adopts a visible light camera, and can also select or combine a camera, an infrared thermal imaging camera, an ultraviolet imaging camera and the like. The unmanned aerial vehicle airframe can adopt a rotor unmanned aerial vehicle, and can also adopt a multi-rotor or a fixed-wing unmanned aerial vehicle.
[0066] As shown in Fig.4, the centralized monitoring flow of the unmanned aerial vehicle inspection of the present invention is divided into three large basic flows: an inspection task execution flow, an inspection result processing flow and an inspection task monitoring flow. The interaction flow of the centralized monitoring of the unmanned aerial vehicle inspection is as follows:
first step, inspection task allocation: inspection tasks are allocated according to the information of inspected transmission lines and the monitored state information of the mobile substation, a transmission line section, an inspection time, an inspection type, an inspection target and other information corresponding to each inspection task are determined, and inspection personnel and equipment are configured for each inspection task. The monitoring on the state information of the mobile substation 2 in the stage is monitoring the GPS position information of the mobile substation 2, the integrity of mobile substation 2 equipment, the full extent of crew and the like, so as to allocate the corresponding inspection task.
Second step, inspection task execution: corresponding inspection task information is audited, and the audited inspection task information is released to the corresponding mobile substation 2 to execute the corresponding inspection task. In the inspection task execution stage, the execution condition of the inspection task is monitored in a wireless communication mode, and the equipment state of the mobile substation 2, the GPS position information and the meteorological environmental information of the mobile substation 2 site are monitored.
Third step, new construction of a flight task: the mobile substation 2 plans the flight task corresponding to the inspection task according to the released inspection task information, and determines that the inspection task accomplishes the necessary flight task and one flight task corresponds to one takeoff/landing flight inspection of the airplane; and in the new construction of the flight task, the inspection tower and the transmission line section corresponding to the flight task, and monitoring equipment (infrared, ultraviolet or visible light) corresponding to the flight task should be determined, a corresponding flight route is planned, and if the flight route is present, it is directly imported.
Fourth step, flight task execution: the mobile substation 2 sends the flight route information in the flight task to be executed to the flight control module, and the unmanned aerial vehicle is started to carry out flight inspection. In the inspection process, the flight task is monitored, and a flight state, a pod state, a flight track and the meteorological information are mainly monitored.
Fifth step, flight task accomplishment: corresponding inspection result data should be imported in the mobile substation 2, the inspection image information is preprocessed, a flight report is generated in combination with flight process information, the flight report, the flight result data, the flight process data and the flight monitoring data are sent to the centralized monitoring subsystem 1, and the flight monitoring data needs to be transmitted to the centralized monitoring subsystem 1 in real time.
Sixth step, inspection task accomplishment: the centralized monitoring subsystem 1 carries out inspection defect diagnosis on the inspection result data and the main inspection image information to determine the inspection defects; verifies and diagnoses the defects primarily provided in the flight report; checks the completion degree of the inspection task, and ensures that the completion degree of the inspection task is 100%. The check method is as follows: 1) a transmission line length inspected in the flight task is the inspection transmission line length regulated in the inspection task; and 2) flight inspection is carried out on line towers involved in the inspection task.
[0067] As shown in Fig.5, seventh step, the inspection result processing flow is as follows:
step 1, image preprocessing: shot image copy information in the inspection result is preprocessed, images with insufficient shooting definition, inaccurate shooting angle and inaccurate scene selection among the shot images are screened out, denoising processing is carried out on the images, and the definition and the contrast of the images are adjusted;
step 2, defect diagnosis: a defect sample that is provided according to the defect expert database is diagnosed, whether the information in the images has defects is determined, a defect layer is added on the image, the defects are identified on a new image layer by squares or circles and character illustration, and a diagnosis result is saved in the database; and
step 3, manual defect processing: manual confirmation is carried out on the defect information saved in the database to determine whether the defects are diagnosed, and re-identification, deletion, modification and browse operations can be carried out on corresponding defects; and image management can be carried out to browse the original image information and identify the manually found defects.
[0068] Eighth step, inspection task closure: the centralized management subsystem 1 generates a corresponding inspection report according to inspection process information, result information and defect information, and provides inspection process description and inspection result description; and the centralized management subsystem carries out defect elimination on the inspection defects in the corresponding inspection report and reflects a defect elimination result in the inspection report.
[0069] As shown in Fig.6, the flow of the unmanned aerial vehicle inspection task can be executed in the following 8 steps:
first step, new construction of the inspection task: in a transmission line on a GIS map, according to the existing transmission line information and defect conditions inspected on the corresponding line section, the transmission line section of the inspection task is determined, and the inspection time, the inspection type, the inspection target and other information are specified; in the new construction of the inspection task, the new construction of the inspection task can also be accomplished by cloning, and the cloning requires the modification of the execution time and other parameters of the inspection task. The currently determined inspection task information includes a task name, a line name, a voltage grade, starting and ending tower numbers, towers (bases), a line length, the inspection type, the inspection target, a planned start time, a planned end time, the person in charge and other information.
Second step, inspection task configuration: the types of a detection terminal and the unmanned aerial vehicle are determined according to the type of the inspection task and the inspection target; and the idle inspection crew and inspection equipment within the time period according to the planned time period of the inspection task and the machine set type.
Third step, inspection task audit: a transmission line inspection manager audits the inspection task, and the fourth step can be executed if the audit is passed; and otherwise, if the task configuration does not pass the audit, the second step is executed to configure the corresponding inspection task again; and if the audit on the inspection line plan is not passed, the first step is executed to adjust the inspected transmission line section.
Fourth step, inspection task notification: an inspection task notification is released for the audited inspection task in the form of a message, a short message and a mail. Fifth step, inspection task release: the corresponding inspection task is sent to the corresponding mobile substation 2 through the Ethernet or in a wireless network form to release the inspection task.
Sixth step, inspection task execution: in the mobile substation 2, a corresponding flight task is established according to the corresponding inspection task, unmanned aerial vehicle inspection is executed, and inspection process information and result information are sent to the centralized monitoring subsystem 1.
Seventh step, inspection task accomplishment: after checking that the completion degree of the inspection task reaches 100%, all inspection task process information, the result information, the flight report and the flight log information are sent to the centralized monitoring subsystem 1.
Eighth step, inspection task closure: defect identification processing is carried out on the inspection result according to the inspection process information, the result information, the flight log and the flight report, and an inspection defect list is provided; corresponding inspection defects are sent to the inspection defect elimination module to eliminate the defects; and a corresponding inspection report is generated according to the inspection process information, the result information and the defect information, and the inspection task is closed.
[0070] After the inspection task is accomplished, the final inspection result forms the inspection report, and the inspection report contains the inspection process information, the flight state information, the meteorological information, the flight log, the inspected defect information, the inspection task information and other contents.
[0071] As shown in Fig.7, the execution flow of the unmanned aerial vehicle flight task in the mobile substation can be divided into the following 6 steps:
first step, new construction of the flight task: the flight task of the flight inspection of the unmanned aerial vehicle is established according to the inspection task information of the unmanned aerial vehicle that is synchronized to the mobile substation 2. The transmission line information to be inspected is displayed in the GIS map, the tower line section of the flight inspection is selected, the GPS position information of the inspection tower and the airplane takeoff/landing points is written in the XML file, and a GPS satellite map for inspection can be automatically selected by a frame to serve as the inspection map.
Second step, flight route planning: if a corresponding flight route is available for the corresponding inspection tower transmission line section, the corresponding flight route is selected; and otherwise, the flight route of the unmanned aerial vehicle is planned according to the inspection tower transmission line section determined in the flight task, and the flight route point, the inspection suspension point, the return route, the takeoff/landing points and the like of the unmanned aerial vehicle are planned.
Third step, flight task audit: the determined inspection transmission line and the corresponding flight route for the unmanned aerial vehicle flight task are audited, and the fourth step is executed if the audit is passed; and if the audit is not passed, the second step is executed to replan the flight route.
Fourth step, flight task execution: the flight route information, the GPS position information of the suspension point and the flight map determined for the flight task are released to the flight control module, the unmanned aerial vehicle is started to carry out transmission line inspection flight, and the flight control module interacts with the unmanned aerial vehicle in a flight process to control the flight of the unmanned aerial vehicle; and the detection pod of the unmanned aerial vehicle is controlled by the pod control module 23 to shoot and photograph
Fifth step, flight accomplishment: the unmanned aerial vehicle sends corresponding flight state information to the mobile substation 2 in the flight process, and sends the flight inspection result data (images, videos) to the mobile substation 2.
Sixth step, task accomplishment: the flight log is imported in the mobile substation 2, primary defect diagnosis analysis is carried out according to the flight process data and the flight result data to generate a corresponding flight report, and the generated flight report is sent to the centralized monitoring management subsystem 1. Although the present invention has been described above in detail by the specific and preferred embodiments, those skilled in the art should understand that the present invention is not limited to the above embodiments, and any modifications, equivalent substitutions and the like, made within the spirit and principle of the present invention, shall all fall into the protection scope of the present invention.
the centralized monitoring subsystem is used for accessing the state information and inspection data of the mobile substation and the unmanned aerial vehicle flight platform, planning and synchronizing an unmanned aerial vehicle inspection task, carrying out real-time remote monitoring on the mobile substation and the unmanned aerial vehicle flight platform for the unmanned aerial vehicle inspection, carrying out defect diagnosis, statistics, analysis and display on the inspection data, and describing a real-time state scene and a power environment of the inspection of the current unmanned aerial vehicle;
the mobile substation is used for planning and releasing a flight task, carrying out local monitoring on the inspection state information and the inspection data, preprocessing inspection image data and carrying out defect pre-diagnosis on the inspection result data; and
the unmanned aerial vehicle flight platform comprises a pod module serving as a line detection terminal, a flight control module for carrying out flight control on the unmanned aerial vehicle flight platform, a GPS module for carrying out GPS positioning, a communication module for communicating with the mobile substation and an unmanned aerial vehicle airframe; the flight control module, the pod module and the GPS module respectively communicate with the mobile substation through data transmission communication links; and the pod module sends detection image information into the mobile substation through an image transmission communication link.
a human-computer interaction module, used for obtaining and analyzing an external command, sending the analyzed external command to a corresponding data processing module for processing, and displaying a corresponding processing result;
an inspection task planning module, used for carrying out task division on a transmission line inspected by the unmanned aerial vehicle, determining the transmission line sections inspected by the inspection machine sets, the necessary inspection equipment and the inspection crew and specifying the planned inspection time according to influence factors, comprising the reliability of the inspection equipment, the inspection records of the personnel, the inspection geographical environment and the meteorological environment, carrying out query, new construction, edition, audit, notification and release operations on the planned inspection task to accomplish the plan of the inspection task;
an inspection task monitoring module, used for monitoring the meteorological environment information of an unmanned aerial vehicle inspection site, the flight state information of the unmanned aerial vehicle, the state information of the mobile substation, the GPS position information, the pod control information and other real-time state information and power environment information, and describing the real-time state scene and the power environment of the current inspection of the unmanned aerial vehicle in video and image modes;
an inspection result management module, which is used for managing the inspection result data of the unmanned aerial vehicle, is connected with a communication module and a data storage module for achieving synchronization, browse, play, comparison, analysis and report management of the inspection result data, and accomplishing the management of the inspection result data;
an inspection defect diagnosis module, used for carrying out screening, preprocessing and defect diagnosis on the inspection result data that comprises image and video information, marking a defect position on an inspection image, illustrating the defect in characters, storing the inspection defect in a database, and carrying out identification, modification, deletion, query and browse operations on the corresponding inspection defect image to accomplish the defect diagnosis of the inspection result;
an inspection report management module, used for generating an inspection task report of the unmanned aerial vehicle inspection task, describing the transmission line, the equipment, the personnel, the time, the flight task report and the flight log information of the corresponding inspection task and the found defect information, and carrying out browse, edition, deletion and audit operations on the inspection report to accomplish the management of the inspection report;
a defect elimination module, used for processing the inspection defect information in the inspection report, triggering a defect elimination flow by the inspected transmission line defects, and carrying out release, allocation, notification, elimination and elimination confirmation operations on a defect elimination task to accomplish an elimination operation of the inspection defects found by the unmanned aerial vehicle inspection;
a GIS module, used for importing and exporting transmission line information, wherein the transmission line information is displayed in the GIS module, section division, selection and frame selection operations of the transmission line are provided, and the GIS module can be used for browsing, editing and deleting corresponding line information on the GIS map, as well as displaying the flight route information of the unmanned aerial vehicle on the GIS map;
the communication module, used for reading the real-time state information of the mobile substation, responding to a remote instruction of the human-computer interaction module, releasing the inspection task information to the mobile substation, obtaining the inspection information of the mobile substation and the unmanned aerial vehicle flight platform in real time, and accomplishing the information interaction and the communication of the centralized monitoring subsystem and the mobile substation;
a transmission line management module, used for carrying out import, export, query, browse, deletion and edition operations on a tower GPS position, a tower model number, a tower height, a starting tower serial number, tower serial numbers and other information of the transmission line to accomplish the management of the transmission line information;
an inspection personnel management module, used for carrying out query, maintenance, registration and deletion management on basic personnel information of the inspection crew and an inspection task manager through identity card information, achieving automatic query and display of the personnel information through an identity card reader, and carrying out query, browse, edition and deletion operations on the inspection record information of the inspection crew to accomplish the management of the inspection personnel information;
an inspection equipment management module, used for managing inspection equipment information, carrying out import, export, query, browse, registration, maintenance and deletion operations on the equipment information, maintaining the state information of the inspection equipment, comprising idle, inspection use, maintenance or servicing state, and achieving effective management and use of the inspection equipment; and
the data storage module, used for storing system data in the mode of a database and a file, wherein the data storage module is used for storing basic system data of a centralized management subsystem, the inspection process data, the inspection result data and the inspection monitoring data, and inspection video data is stored in a file, and a storage file path is stored in the database.
the inspection task planning module comprises an inspection task planning unit, an inspection task management unit and an inspection task information synchronization unit; the inspection task planning unit is connected with the inspection equipment management module, the inspection personnel management module, the GIS module and the transmission line management module, and is used for planning the inspected transmission line, the equipment, the personnel and the unmanned aerial vehicle on a GIS map, and determining the inspection factors; the inspection task management unit is connected with the inspection task planning unit and is used for managing the planed inspection task; and the inspection task information synchronization unit is connected with the inspection task management unit and is used for synchronizing the selected unmanned aerial vehicle inspection task information to the corresponding mobile substation.
a human-computer interaction module, used for obtaining and analyzing an external command, sending the analyzed external command to a corresponding data processing module for processing, displaying a corresponding processing result, inputting and outputting system data, and accomplishing human-system interaction;
an inspection task synchronization module, used for synchronizing the inspection task information in the centralized monitoring subsystem to the local, carrying out query and state maintenance on the inspection task that is synchronized to the local, and setting a current inspection task to accomplish the synchronization and the management of the inspection task information;
a pod control module, used for monitoring and controlling a pod on the unmanned aerial vehicle flight platform, reading pod information which comprises, but not limited to, the pod angle, the battery power, the battery voltage, the battery current, the shooting time and the shooting GPS value in real time, as well as releasing a control instruction according to the external instruction, controlling the pod angle, executing a shooting action and stopping the shooting action, so as to monitor the pod on the unmanned aerial vehicle flight platform;
a GIS module, used for importing, exporting and displaying the transmission line information of the inspection task, providing frame selection and GPS position positioning operations of the GIS map, and providing a calibration operation function of a GPS position point on the GIS map;
a flight control module, used for monitoring and controlling the state information of the unmanned aerial vehicle flight platform, reading the GPS information, the speed, the height, the rotating speed, the total distance, the cylinder temperature, the battery voltage, the battery current and the battery power information of the unmanned aerial vehicle flight platform in real time, and releasing a command to the unmanned aerial vehicle flight platform according to the external instruction to control the unmanned aerial vehicle flight platform;
a flight task planning module, used for planning takeoff/landing points, a suspension point, track points, a corresponding flight height, a flight speed and a line distance of unmanned aerial vehicle inspection on the GIS map according to the transmission line information, the geographical environment information and the meteorological environment information of the unmanned aerial vehicle inspection, generating a corresponding flight route, and carrying out query, browse, deletion, import and export operations on the flight task information of the unmanned aerial vehicle to accomplish the management and the plan of the flight task;
a defect pre-diagnosis module, used for editing and splicing images, screening out images with potential defect possibility, identifying the defect information and the defect position information in image information, and carrying out identification, modification, deletion, query and browse operations on the corresponding defect information to accomplish the defect diagnosis and management of the inspection result;
an image preprocessing module, used for preprocessing and managing the inspected image information, carrying out browse, edition, screening and preprocessing operations on the corresponding defect information, screening out images with insufficient shooting definition, inaccurate shooting angle and inaccurate scene selection among shot images, carrying out denoising processing on the images, and adjusting the definition and the contrast of the images to achieve the preprocessing of the image information;
a meteorological monitoring module, which is used for monitoring the meteorological information of an inspection site of the unmanned aerial vehicle in real time, and is connected with the flight task monitoring module by a matching interface to send the monitored meteorological information to the centralized monitoring subsystem;
a flight task monitoring module, used for monitoring the flight state information, the meteorological information of the inspection site and the GPS position information, and displaying the same in the human-computer interaction module, as well as sending the corresponding flight task monitoring information to the centralized monitoring subsystem by a communication module;
a data storage module, used for storing the system data, and storing the basic system data of the centralized management subsystem, the inspection process data, the inspection result data and the inspection monitoring data through the data, wherein the inspection video data is stored in the file, and the storage file path is stored in the database;
a GPS module, which is used for achieving GPS positioning of the mobile substation, and is connected with the flight task monitoring module through a serial port to send the GPS information of the mobile substation to the centralized monitoring subsystem; and
the communication module, used for realizing the data interaction with the centralized monitoring subsystem, synchronizing the inspection task information from the centralized monitoring subsystem and sending the inspection data and the inspection monitoring data to the centralized monitoring subsystem, wherein the communication module can also be used for reading the unmanned aerial vehicle state information and the inspection video information of the unmanned aerial vehicle flight platform through a data transmission module and an image transmission module.
first step, inspection task allocation: inspection tasks are allocated according to the information of inspected transmission lines and the monitored state information of the mobile substation, a transmission line section, an inspection time, an inspection type and an inspection target corresponding to each inspection task are determined, and inspection personnel and equipment are configured for each inspection task. The monitoring on the state information of the mobile substation in the stage is monitoring the GPS position information of the mobile substation, the integrity of mobile substation equipment, the full extent of crew and the like, so as to allocate the corresponding inspection task;
second step, inspection task execution: corresponding inspection task information is audited, and the audited inspection task information is released to the corresponding mobile substation to execute the corresponding inspection task; in the inspection task execution stage, the execution condition of the inspection task is monitored in a wireless communication mode, and the equipment state of the mobile substation, the GPS position information and the meteorological environmental information of the mobile substation site are monitored;
third step, new construction of a flight task: the mobile substation plans the flight task corresponding to the inspection task according to the released inspection task information, and determines that the inspection task accomplishes the necessary flight task and one flight task corresponds to one takeoff/landing flight inspection of the airplane; and in the new construction of the flight task, the inspection tower and the transmission line section corresponding to the flight task, and monitoring equipment corresponding to the flight task should be determined, a corresponding flight route is planned, and if the flight route is present, it is directly imported;
fourth step, flight task execution: the mobile substation sends the flight route information in the flight task to be executed to the flight control module, and the unmanned aerial vehicle is started to carry out flight inspection; in the inspection process, the flight task is monitored, and the flight state, the pod state, the flight track and the meteorological information are mainly monitored;
fifth step, flight task accomplishment: corresponding inspection result data is imported in the mobile substation, the inspection image information is preprocessed, a flight report is generated in combination with flight process information, the flight report, the flight result data, the flight process data and the flight monitoring data are sent to the centralized monitoring subsystem, and the flight monitoring data is transmitted to the centralized monitoring subsystem in real time;
sixth step, inspection task accomplishment: the centralized monitoring subsystem carries out inspection defect diagnosis on the inspection result data and the main inspection image information to determine the inspection defects; verifies and diagnoses the defects primarily provided in the flight report; checks the completion degree of the inspection task, and ensures that the completion degree of the inspection task is 100%;
seventh step, inspection result processing; and
eighth step, inspection task closure: the centralized management subsystem generates a corresponding inspection report according to inspection process information, result information and defect information, and provides inspection process description and inspection result description; and the centralized management subsystem carries out defect elimination on the inspection defects in the corresponding inspection report and reflects a defect elimination result in the inspection report.
first step, image preprocessing: shot image copy information in the inspection result is preprocessed, images with insufficient shooting definition, inaccurate shooting angle and inaccurate scene selection among the shot images are screened out, denoising processing is carried out on the images, and the definition and the contrast of the images are adjusted;
second step, defect diagnosis: a defect sample that is provided according to the defect expert database is diagnosed, whether the information in the images has defects is determined, a defect layer is added on the image, the defects are identified on a new image layer by squares or circles and character illustration, and a diagnosis result is saved in the database; and
third step, manual defect processing: manual confirmation is carried out on the defect information saved in the database to determine whether the defects are diagnosed, and re-identification, deletion, modification and browse operations are carried out on corresponding defects; and image management is carried out to browse the original image information and identify the manually found defects.
REFERENCES CITED IN THE DESCRIPTION
This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.
Patent documents cited in the description