TWI650638B - System module built on a non-intrusive data capture system to simulate machine operation screens - Google Patents

Abstract

The invention provides a system module which is constructed in a non-intrusive data acquisition system to simulate a machine operation screen, and is applied to a machine controller, and the image capturing device of the system module is a receiver station controller. The original operation screen is output and transmitted to the non-intrusive data acquisition system and the high-speed image processing unit to capture information in the operation screen, so that the software control system can instantly capture the structure based on the non-intrusive data acquisition system. The operation information of the machine controller is used to construct the corresponding operation simulation screen of the machine, and the image output device outputs the screen to the machine controller, and the field operator is provided with the assistance of the high-speed image processing unit. Obtain information about the operation of the machine, including the current operation screen, the positioning of the mouse cursor and the detection of the pop-up window. It can also provide more accurate machine control programs by using the signal receiving device and the human-machine interface simulation device.

Description

System module built on a non-intrusive data capture system to simulate machine operation screens

The invention provides a system module which is constructed in a non-intrusive data acquisition system to simulate a machine operation screen, in particular, a system module can immediately capture a machine controller based on a non-intrusive data acquisition system. The operation information and the on-site operator provide a simulated original machine operation screen to obtain the machine-related operation information in real time.

According to the current situation, the manufacturing industry is facing labor shortages and environmental awareness, labor and operating costs, and labor-intensive and technically intensive pressures. Most of the manufacturers use the production line automation technology and fixtures to achieve manufacturing. Reduce the manpower, save manufacturing time and increase production capacity, and in the automation of the production line, apply processing tools, machines, or machines at different stations in the factory to carry out various processing, inspection, cleaning, assembly, quality control, warehousing and transportation. Production process to produce the required components and finished products.

Furthermore, with the development of production line automation technology, it is necessary to use faster equipment and open architecture to meet the needs of use, so manufacturers have developed various industrial computers suitable for industrial control, and as the machine and main control of automation equipment. Control between devices, but in the process of manufacturing automation equipment, if the old machine controller is updated and upgraded to a network-enabled device, the difficulty of upgrading such machine controllers appears in hardware at the same time. The expansion of the equipment and the modification of the software system, therefore, in order to maintain the normal operation of such old machines, The non-invasive Data-extraction System is used to obtain information about the control machine.

Please refer to the tenth figure, which is a schematic diagram of the system architecture of the non-intrusive data acquisition. It can be clearly seen from the figure that the traditional non-intrusive data acquisition system uses the display screen output by the machine controller as the display screen. The source of the data, and the display screen is simultaneously transmitted to the screen of the data acquisition system and the machine controller, and the ROI (Region of Interest Extraction) and the optical character can be obtained through image recognition. Optical Character Recognition (OCR) converts the information displayed on the screen into digital information, and the control of the machine controller is controlled by the KVM Switch on the keyboard of the data capture system and the machine controller. Switch between the mouse and the mouse, but because the required information may be distributed on different operation screens of the machine controller, it is necessary to quickly switch the operation screen of the machine controller to retrieve the relevant machine status and data. In such a situation, the machine operation screens seen by the field operators are mostly high-speed page switching, and the data of the machine controller is instantly captured. It also makes the machine enter an unmanageable state, which will cause certain restrictions on the overall function; in other words, when the on-site operator needs to control the machine, it is necessary to suspend the data capture system before passing through the machine. The controller controls the machine, which causes the data acquisition system to not capture the data of the machine controller. The on-site operator can not immediately check the status and data of the machine, but it needs to be redesigned by the industry to effectively solve it.

Therefore, the inventor has in view of the above-mentioned conventional data acquisition system control machine control At the same time as the operation screen data output by the device, the on-site operator can not control the problem and lack of the machine through the machine controller. It collects relevant data and evaluates and considers it through multiple parties, and continuously tries to use the years of research and development experience in this industry. Modifications, the invention of the system module invention patent for the non-intrusive data acquisition system to simulate the operation screen of the machine was born.

The main purpose of the present invention is that the machine operating program of the machine controller can generate an operation screen for controlling the original display of the machine, and the image capturing device of the system module can output the original operation screen of the receiver controller. And transmitted to the non-intrusive data acquisition system and the high-speed image processing unit to capture information in the operation screen, so that the software control system can immediately capture the machine controller under the framework of the non-intrusive data acquisition system. Operation information, to construct a machine operation flow to generate a corresponding machine simulation operation screen, and the image output device outputs to the screen of the machine controller, and at the same time, the on-site operator obtains the machine-related operation by the assistance of the high-speed image processing unit. The information includes the current operation screen, the positioning of the mouse cursor and the detection of the pop-up window. The signal receiving device and the human-machine interface simulation device can also be used to transmit corresponding control signals to the machine controller to provide a more accurate machine. Control the program.

The secondary object of the present invention is that the high-speed image processing unit can provide the following information in real time: recognize the characteristics of the machine screen in the original operation screen, and note the Page-ID of the identification result in the image data of the operation screen. , so that the software control system periodically updates the corresponding operation page according to the Page-ID; the mouse cursor cursor image in the operation screen is high-speed comparison, and can be positioned back to the software control system for parsing, and the mouse can also be positioned. The coordinates of the cursor, to confirm whether the movement of the mouse cursor meets the position controlled by the software control system; and to define the critical value of the image change, the appearance of the pop-up window can be detected by a huge amount of image changes, and the pop-up window is used. Detect the corresponding error, alarm/warning dialog The box or other relevant alert message is reported back to the external central monitoring system to report the occurrence of an alert message such as an error or abnormal condition.

Another object of the present invention is that the software control system includes two modes of operation: an edit mode and an execution mode. The edit mode is mainly used to construct an operation flow of the machine controller, and the operation flow describes each operation page in the machine operation screen. The relationship between each operation screen includes the following information: Page-ID in the machine operation screen, which is used to represent the corresponding operation page; the image of the operation screen is compared with the operation screen of the machine. Built-in control components to construct the operating sequence of the machine; the coordinates and range of the general control components, the control elements that switch to other operating pages; and the coordinates and range of the first/previous control elements, which indicate the switching The control element used on the first page or the previous page, wherein the software control system can automatically display the control component on the machine operation screen, and query the control element of the first page/previous page by the predefined feature image, and can pass through The human-machine interface simulation device transmits instructions corresponding to the control components to the machine controller, and then traverses the tree traversal algorithm one by one. Each operation page in the machine operation screen is used to construct the operation flow chart of the machine operation program. Finally, the operation flow chart records the operation pages of all the machine operation programs, all the control elements embedded in each operation page and their operations. Switch the corresponding operation page.

A further object of the present invention is that the execution mode of the software control system is symbiotic in the non-intrusive data acquisition system, and the software control system is combined with the signal receiving device and the machine operation flow to analyze the field operator's machine platform. The operation information can be used to generate the corresponding machine simulation operation screen; when necessary, the software control system can also use the human-machine interface simulation device to generate the control signal generated by the control component, and send the control signal to the machine control program to perform the field operation. Instructions entered by personnel.

Another object of the present invention is that the system module can provide a field operator with a simulated original machine operation screen based on the non-intrusive data acquisition system. When the on-site operator checks the status and data of the machine in real time, the machine platform The data acquisition is not interrupted; in addition to reducing the burden on the central processing unit (CPU) of the software control system, the high-speed image processing unit of the system module can also guarantee the immediacy of image processing and control on the return machine. The image of the operation screen is accompanied by the result of the image processing, so that the software control system can adopt the corresponding processing program according to the result; the mouse cursor icon returned by the high-speed image processing unit can replace the function of the original human eye, and Confirm whether the movement of the mouse cursor conforms to the position controlled by the software control system to complete the closed loop control of the mouse; the software control system can provide the result of the image coordinates of the mouse cursor and the image of the operation screen according to the high speed image processing unit. More precise machine control program, and the control signal input by the keyboard/mouse will be first controlled by the software control system. , Can provide customized setting controls filter function to prevent erroneous operation of the site operator.

1‧‧‧ machine controller

11‧‧‧Computer host

111‧‧‧Keyboard/mouse

12‧‧‧ screen

2‧‧‧ Non-intrusive data retrieval system

21‧‧‧Selection of regions of interest

22‧‧‧ Optical Character Recognition

3‧‧‧System Module

31‧‧‧Image capture device

32‧‧‧High speed image processing unit

33‧‧‧Software Control System

331‧‧‧ Periodically update its corresponding operation page according to Page-ID

332‧‧‧ Machine controller operation flow

333‧‧‧Switch the corresponding operation page

334‧‧‧Query the corresponding control elements in the operation flow according to the position of the mouse button click

34‧‧‧Image output device

35‧‧‧Signal receiving device

36‧‧‧Human Machine Interface Simulator

The first figure is a block diagram of the system module of the present invention through the non-intrusive data acquisition system to capture the machine controller data output machine simulation operation screen.

The second figure is an architectural diagram of the machine operating program executed by the machine controller of the present invention.

The third figure is an operation flow chart of constructing a simulation operation screen of the machine module of the invention.

The fourth figure is the main screen view of the simulation operation screen of the machine of the present invention.

The fifth figure is an operation page diagram of the calibration screen of the present invention.

The sixth figure is an operation page diagram of the program editing screen of the present invention.

The seventh figure is an operation page diagram of the processing monitoring screen of the present invention.

The eighth figure is an operation page diagram of the alarm display screen of the present invention.

The ninth diagram is an operation page diagram of the parameter setting of the present invention.

The tenth figure is a schematic diagram of the system architecture of the conventional non-intrusive data extraction system.

In order to achieve the above objects and effects, the technical means and constructions of the present invention will be described in detail with reference to the preferred embodiments of the present invention.

Please refer to the first, second and third figures, which are respectively a block diagram of the system operation module of the present invention through the non-intrusive data acquisition system, the machine controller controller data output machine simulation operation screen, and the machine controller execution. The architecture diagram of the machine operation program and the operation flowchart of the system module construction machine simulation operation screen, it can be clearly seen from the figure that the architecture of the present invention is used in the non-intrusive data acquisition system to simulate the operation screen of the machine. The system module is applied to a machine controller 1 which is a machine operating program with a multi-page control program built therein, and the machine controller 1 is electrically connected to include, but not limited to, a table. a computer, a workstation, a server, a notebook computer or other console for controlling the operation of the machine, and has a computer host 11 on the console, and the computer host 11 is electrically connected with a screen 12 and a keyboard/mouse 111 .

In the embodiment, the machine controller 1 is electrically connected to the machine with a multi-axis fine hole or deep hole electric discharge machine, but in practical applications, it is not limited thereto, and may be a semiconductor, The automation equipment or processing equipment used in the printed circuit board, precision electronics and optoelectronics, machinery manufacturing industries, and the machine controller 1 can execute the machine operation program, and the machine operation program generates the operation screen originally displayed by the machine. When the operation screen of the electric discharge machine is used as an explanation, the operation screen includes the main screen, the calibration screen, the program editing screen, and the execution processing. The operation screens of the monitor screen, the alarm display screen and the system parameter setting screen can also be added to the operation screens such as the coordinate system screen and the diagnostic function screen according to the design or operation requirements, such as the fourth, fifth, sixth, As shown in the seventh, eighth and ninth figures, the main screen and other operation pages of the above-mentioned operation screen embodiment respectively can display the operation and production status of the machine according to the operation screen, such as working mode, working coordinate, and processing depth. The data of the parameters such as time, current, pulse width, etc., but the machine operation program of the machine controller 1 has different operation screens according to the controlled machine, and the operation screen displayed on the screen 12 can be the original operation of the machine. The picture, so it is explained together in the following instructions, and is combined with Chen Ming.

Furthermore, the machine controller 1 of the present invention is electrically connected to the system module 3 of the non-intrusive data capture system 2, and the system module 3 includes an image capture device 31 and a high speed image processing unit 32. a software control system 33, an image output device 34, a signal receiving device 35, and a Human Interface Device (HID) analog device 36, wherein the software control system 33 can drive the image capturing device 31 to control the receiver station. The operation screen image originally displayed by the machine operation program output by the device 1 is simultaneously transmitted to the non-intrusive data acquisition system 2 and the high-speed image processing unit 32 for processing, mainly as the image data of the optical character recognition software (OCR Software). Source, and the non-intrusive data capture system 2 performs the capture of the region of interest on the image of the operation screen, and the optical character recognition 22 converts the information displayed by the image into digital information, and the high speed image processing unit 32 Then, it is a post-processing unit of the image of the machine operation screen captured by the image capturing device 31, and the related image processing algorithm is constructed in the field. Type logic gate array (Field Programmable Gate Array, FPGA), application-specific integrated circuit ( Application-Specific Integrated Circuit (ASIC)/Application-Specific Standard Product (ASSP) or microprocessor-based chip or circuit for high-speed image recognition, comparison, motion detection, and mouse cursor position Functions such as positioning, and periodically updating the operation page corresponding to the above-mentioned machine operation screen.

However, the non-intrusive data capture system 2 is mainly used for capturing information in the operation screen, and the software control system 33 of the system module 3 receives the digital information captured by the non-intrusive data acquisition system 2. At the same time, the high-speed image processing unit 32 first recognizes the specific page-Pattern information in the original operation picture, and then notes or marks the page-ID attribute data obtained by the identification result. In the image data of the screen, the software control system 33 can update the corresponding operation page 331 periodically in each cycle according to the Page-ID, and store the image of the machine operation screen captured by the image capturing device 31. In the buffer built into the software control system 33, and the machine operation screen is a temporary image output by the image output device 34 to the machine controller 1, such as a typical client-server. (Consumer) working mode, using the scratchpad as a data buffer function, and the software control system 33 can receive all or part of the digital information captured by the non-intrusive data capturing system 2, and The machine operation information returned by the high-speed image processing unit 32 is analyzed, and the post-processing is performed to generate a machine simulation operation screen, for example, a mouse cursor and a keyboard input can be added to the machine operation screen, or the machine is Each operation page in the operation screen can be embedded with a dialog box (Dialog Box) and a button ( Control elements such as Button) or Data List, and link specific control functions to their control elements.

In addition, the signal receiving device 35 is configured to receive a control signal input from the physical keyboard/mouse 111, and pass the control signal through a HID data buffer (HID Data Buffer), and HID detection (detection)/data forwarding (Data The Forwarder function is transmitted to the software control system 33 for processing, and the corresponding control element 334 in the operation flow is queried according to the location of the mouse-clicking, and the key input (Key-in) data can also be temporarily stored. The human-machine interface simulation device 36 can simulate the keyboard/mouse transmission corresponding control signal by the microcontroller (MCU) of the software control system 33, and temporarily store the control signal by the HID data buffer, and the HID detection/data forwarding function. The software control system 33 can use the human-machine interface simulation device 36 to move the reaction mouse cursor and the mouse click control element according to the mouse-moving and mouse click position reaction keyboard/mouse input control signals. The generated control signal is transmitted to the computer host 11 of the machine controller 1, and can be utilized when the software control system 33 switches to its corresponding operation page according to the control element. Perform actual data entry.

The high-speed image processing unit 32 in the present embodiment can provide the following information in real time: recognize the feature of the machine screen in the original operation screen, and note the page-ID of the identification result in the image data of the operation screen. The software control system 33 periodically updates its corresponding operation page 331 according to the Page-ID; the mouse cursor cursor image in the high-speed comparison operation screen, and can be positioned while being transmitted back to the software control system 33 for parsing. Mouse Cursor Lacator At the coordinates, to confirm whether the movement of the mouse cursor conforms to the position controlled by the software control system 33; and to define a critical value of the image change, the appearance of the pop-up window can be detected by a huge amount of image changes, and the pop-up window is utilized. Pop-Up Window Detection returns the corresponding error, Alarm/Warning Message-Box or other related alarm messages to an external central monitoring system (such as Computer Integrated Manufacturing (CIM)). , Manufacturing Execution System (MES) or other computer-made integrated system], in order to report the occurrence of an alarm message such as an error or abnormal condition; wherein the machine picture feature refers to the user operating according to each machine The screen is preset with a feature image sufficient to represent the operation screen, and can have a plurality of feature images on a single screen (such as a main screen, an operation page, etc.), a machine operation screen captured by the image capture device 31, and a high speed image. The processing unit 32 can transmit the feature images back to the software control system 33 to analyze the field operator. The control of the machine through the machine controller 1; and the critical value of the image change refers to a threshold value for defining whether the image of the operation screen tends to be stable, for example, the appearance of a pop-up window can be detected, and high-speed image processing is avoided. Unit 32 captures the machine operation screen that is being "changed" to produce an unexpected malfunction.

As described above, the software control system 33 includes two modes of operation, an edit mode and an execution mode, wherein the edit mode is mainly used to construct an operation flow 332 of the machine controller 1, and the operation flow can describe each of the machine operation screens. For the relationship between the operation pages, the following information must be planned in advance for each operation screen: Page in the machine operation screen -ID, which is used to represent the corresponding operation page; the image of the operation screen is used to compare the control elements embedded in the operation screen of the machine, so as to construct the relationship of the operation flow of the machine; the coordinates and range of the general control elements are Marking the control elements that switch to other operating pages; and the coordinates and ranges of the Home/Return control elements, which indicate the special control elements used to switch to the first or previous page; The control system 33 uses the image capturing device 31 to capture the image of the machine operation screen and the machine operation information returned by the high-speed image processing unit 32, so that the software control system 33 can transmit image recognition, comparison, analysis, and the like. The possible control elements, such as buttons, display lights, etc., are automatically marked on the machine operation screen, and the control elements of the first page/previous page can be queried by the predefined image pattern (Image Pattern), and the user can be used. The machine interface simulation device 36 transmits to the machine controller 1 a reaction mouse cursor movement corresponding to the mouse click control element, and then a tree traversal algorithm (Tree Travers Al Algorithm) By accessing all the nodes of the tree data structure one by one, you can completely browse the operation pages in the operation screen of the machine, so as to construct the operation flow chart of the whole machine operation program. Finally, the operation flow chart will record all the machines. The operation page of the operation program, all the control elements embedded in each operation page and the operation page 333 corresponding to the switching operation, and the operation information of the machine after the image processing returned by the high-speed image processing unit 32 can be analyzed and updated. Software control system 33 status.

The execution mode of the software control system 33 is symbiotically generated in the non-intrusive data capture system 2, and the image capture device 31 is used to capture the image of the machine operation screen output by the machine control program of the machine controller 1. The non-intrusive data capture system 2 captures the information in the operation screen, and then periodically returns the page-ID according to the high-speed image processing unit 32. The corresponding operation page 331 of the new machine can be combined with the signal receiving device 35 and the machine operation flow by the software control system 33 to analyze the operation information of the on-site operator to the machine, thereby generating a corresponding machine simulation operation screen; When necessary, the software control system 33 can also transmit the control signal generated by the reaction mouse cursor movement and the mouse click control element to the machine controller 1 by using the human interface simulation device 36, and transmit the command to the control signal by the following command. The machine control program executes instructions entered by the field operator.

As shown in the second and third figures, the switch between the operation screens generated by the machine controller 1 in the embodiment has corresponding buttons/hot keys, and therefore, each operation screen needs to be recorded. The relationship with other operation pages, for example, in the main screen, for the system parameter setting screen (as shown in the ninth figure), in addition to the hot key (F6) used for recording, it is also necessary to mark the coordinates of the corresponding button. Range, and the complete machine operation screen and other operation page are marked, as shown in the second and third figures, when the software control system 33 receives the control signal from the keyboard/mouse 111 of the computer host 11 via the signal receiving device 35. In time, for example, a mouse button click or a keyboard press hot key, etc., the corresponding processing can be taken by comparing the data indicated by each operation page in the machine operation information by the high speed image processing unit 32, for example, the home page/top The control element of one page switches the operation page. When the relationship between each operation page and other operation pages can be clearly defined, the user can soften according to the relationship between the operation pages. The control system 33 plans a complete operation manner for browsing each operation page in the operation screen of the machine, that is, an operation flowchart for the software control system 33 to construct the entire machine operation program of the machine controller 1; The corresponding button/hotkey used to switch each operation screen on the machine operation screen includes, but is not limited to, buttons one to seven, hot keys F1 to F7, and each operation screen actually uses the corresponding button/hot key and sequentially switches Way, etc., depending on the specific The usage status or authority is related to the setting, so only a brief description is made in this specification, and is not limited by the exemplary embodiments disclosed in the second to ninth drawings.

In this embodiment, when the field operator is operating the keyboard/mouse 111 of the computer host 11, the control signal input by the physical keyboard/mouse 111 is received by the signal receiving device 35, and the input data is transmitted to the software control system. 33 receiving and processing, if only the conversion of the operation page, the software control system 33 is responsible for taking out the corresponding machine operation screen from the machine operation screen image stored in the temporary memory, if the setting of the machine parameter setting screen is involved In addition to the input control item of the software control system 33, the input data data is temporarily stored in the register of the software control system 33, and the machine operation screen is switched to the target operation in the software control system 33. At the time of the page, the man-machine interface simulation device 36 can be used to transmit a control signal command to the machine control program of the machine controller 1 to perform actual data input by the field operator.

In the present embodiment, the software control system 33 utilizes the following operational procedures to implement the function of the machine controller 1 to simulate the operation of the machine: each time the non-intrusive data capture system 2 periodically captures the operation screen information. In the loop, the machine operation screen captured by the image capturing device 31 can be stored; the machine operation information returned by the high-speed image processing unit 32 is analyzed, the state of the software control system 33 is updated, and the position of the mouse cursor position is included. The operation page in the operation screen currently executed by the machine control program and the corresponding machine operation flow are recorded in the control component of each operation page; when the pop-up window is detected, the corresponding error message, warning dialog box and the like may be sent. Returning to the external central monitoring system, the human-machine interface simulation device 36 can also be used to release the error/warning dialog box, so that the non-intrusive data acquisition system 2 can continue the program for capturing the machine operation screen data; the receiving signal receiving device 35 The transmitted control signal is corresponding to the present The mouse button click of the field operator compares the range of the control component in the operation flow of the machine with the coordinate position of the click, and confirms that the position of the mouse click is within the effective range of the control component according to the operation flow of the machine, and the image can be utilized. The output device 34 outputs the machine simulation operation screen connected to the control unit to the screen 12 of the machine controller 1; the signal receiving device 35 temporarily stores the keyboard input data corresponding to the field operator, and switches to the corresponding operation. At the time of the page, the actual interface data input to the machine controller 1 can be performed by the human interface simulation device 36.

The control signal of the keyboard input by the field operator via the machine controller 1 can be transmitted to the software control system 33 for processing by the signal receiving device 35, and then forwarded to the machine controller 1 by the human-machine interface simulation device 36. Therefore, the control items on the software control system 33 can be set according to specific usage conditions or rights, for example, the function of setting only the machine parameter to the equipment engineer; and the authority of the operator can filter the control items of all the set functions. Only the operator is allowed to view the status and information of the machine.

Therefore, the present invention is mainly directed to the machine operating program of the machine controller 1 to generate the original operation screen of the machine. Based on the architecture of the non-intrusive data capturing system 2, the image capturing device of the system module 3 can be utilized. The operation screen outputted by the receiver station controller 1 is transmitted to the non-intrusive data capture system 2 and the high speed image processing unit 32 to capture information in the operation screen, so that the software control system 33 can immediately capture the machine control. The operation information of the device 1 is used to construct a corresponding operation simulation screen of the machine, and the image output device 34 outputs to the screen 12 of the machine controller 1 while being provided by the high-speed image processing unit 32. The operator immediately obtains the operation information related to the machine, including the currently performed operation screen, the positioning of the mouse cursor and the detection of the pop-up window, and can also provide a more accurate machine by using the signal receiving device 34 and the human-machine interface simulation device 35. Console control program.

The detailed description of the present invention is intended to be a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and other equivalents and modifications may be made without departing from the spirit of the invention. Changes are intended to be included in the scope of the patents covered by the present invention.

In summary, the above-described system for the non-intrusive data acquisition system to simulate the operation screen of the machine platform can actually achieve its efficacy and purpose when used, so the invention is excellent in practicality. The invention is in conformity with the application requirements of the invention patent, and the application is filed according to law. It is hoped that the trial committee will grant the case as soon as possible to protect the inventor's hard work. If there is any doubt in the bureau, please do not hesitate to give instructions, the inventor will try his best to cooperate. Real sense of virtue.

Claims (14)

A system module for constructing a non-intrusive data capture system to simulate a machine operation screen is applied to a machine controller for controlling a machine platform, the system module comprising: an image capture device for The machine control program receiving the machine controller outputs the original machine operation screen, and transmits the information to the non-intrusive data capture system to capture the information in the operation screen of the machine; a high speed image processing unit receives the machine The operation screen for providing image processing information after the image processing includes: identifying the feature of the machine screen in the operation screen of the machine, and appending the page-ID of the identification result to the image data of the operation screen of the machine Internal; high speed ratio to the mouse cursor in the operation screen of the machine, and locate the coordinates of the mouse cursor icon; and define the threshold value of the image change, used to detect the appearance of the pop-up window; a software control The system receives the information of the non-intrusive data retrieval system, and parses the operation information of the machine returned by the high-speed image processing unit, including: periodically according to the Page-ID The operation page corresponding to the operation screen of the machine compares the coordinates and the range of the embedded control component in the operation page, thereby constructing a corresponding machine simulation operation screen by constructing the operation flow of the machine controller; The image processing unit detects the corresponding alarm message when the pop-up window is displayed; an image output device is configured to output the simulation operation screen of the machine connected to the control component to the screen of the machine controller; a signal Receiving means for transmitting the keyboard/mouse control signal input by the machine controller to the software control system for processing, and querying according to the position clicked by the mouse button The control component corresponding to the operation flow of the machine controller; and a human-machine interface simulation device for simulating a keyboard/mouse transmission corresponding control signal to the machine controller to execute an input instruction. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine, as described in claim 1, wherein the machine controller has a computer host and the screen electrically connected thereto, and the screen The keyboard/mouse is electrically connected to the host computer. The system module of the non-intrusive data acquisition system for simulating the operation screen of the machine, as described in claim 1, wherein the machine controller is a built-in organic operation program and is operated by the machine. The program generates the original operation screen of the machine, and the machine operation screen includes an operation page which can be a main screen, a calibration screen, a program editing screen, a processing monitoring screen, an alarm display screen, and a system parameter setting screen. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine, as described in claim 1, wherein the non-intrusive data retrieval system is configured to receive the output of the machine controller The machine controls the original operation screen of the machine, and performs image capturing of the image of the machine operation screen and optical character recognition to convert the information displayed by the image into digital information. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine according to the first aspect of the patent application, wherein the image capture device captures the image of the operation screen of the machine The temporary image stored in the built-in software of the software control system is a temporary image outputted by the image output device to the machine controller. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine, as described in claim 1, wherein the high speed image processing unit of the system module is a post-processing unit of the image of the operation screen of the machine captured by the image capturing device, and constructing the image processing algorithm in a field programmable logic gate array, a special application integrated circuit/specific use wafer or a microprocessor . The system module of the non-intrusive data capture system for simulating the operation screen of the machine according to the first aspect of the patent application, wherein the high-speed image processing unit of the system module recognizes the feature of the machine screen According to the feature image preset by each machine operation screen, and returning the feature images to the software control system, the field operator controls the machine through the machine controller, and the image changes. The threshold value is used to define whether the image of the operation screen of the machine is stable, so as to detect the appearance of the pop-up window. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine according to the first aspect of the patent application, wherein the software control system of the system module includes an editing mode and an execution mode, and the editing mode is used. Constructing the operation flow of the machine controller, and describing the relationship between each of the operation pages in the operation screen of the machine by the operation flow of the machine controller, and the execution mode is symbiotic to the non-intrusive data acquisition In the system, the software control system combines the operation flow of the signal receiving device and the machine controller to analyze the operation information of the machine operator on the machine, thereby generating a corresponding simulation operation screen of the machine, or The control signal generated by the control unit is transmitted to the machine controller by the human interface simulation device. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine, as described in claim 8, wherein the editing mode of the software control system includes the following for each operation picture of the machine Information: The Pag in the operation screen of the machine The e-ID is used to represent the corresponding operation page; the image of the operation screen is compared with the control element embedded in the operation screen of the machine, thereby constructing the operation flow of the machine controller; the general control element The coordinates and ranges indicate the control elements that are switched to other operating pages; and the coordinates and ranges of the first/previous control elements, which indicate the control elements used to switch to the first or previous page. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine according to claim 9 of the patent application scope, wherein the software control system can automatically mark the control component on the machine operation screen, and The pre-defined feature image can query the first page/previous page control component, and the human-machine interface simulation device transmits the instruction corresponding to the control component to the machine controller, and then browses the machine one by one by a tree traversal algorithm. Each of the operation pages in the operation screen is used to construct the operation flow chart of the machine operation program, and finally the operation flow chart records the operation pages of all the machine operation programs, all embedded in each of the operation operations. The control element of the page and the corresponding operation page of the switch. The system module of the non-intrusive data capture system for simulating the operation screen of the machine, as described in claim 1, wherein the software control system of the system module can store the image capture device The machine operation screen, and parsing the update status of the machine operation information returned by the high-speed image processing unit, including the position of the mouse cursor position, the operation page in the current operation operation screen of the machine control program, and the corresponding machine The operation flow of the controller records the control elements of each of the operation pages. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine, as described in claim 1, wherein the software control system of the system module is When the high-speed image processing unit detects the appearance of the pop-up window, the alarm message of the corresponding error and warning dialog box can be reported to the external central monitoring system for error or condition, and the human-machine interface simulation device can be used to release the alarm. The message causes the non-intrusive data capture system to continue the process of capturing the data of the machine operation screen. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine, as described in claim 1, wherein the software control system of the system module can receive the control transmitted by the signal receiving device. The signal corresponds to the range of the control component and the coordinate position of the click in the operation flow of the machine controller corresponding to the field operator, and confirms the mouse click according to the operation flow of the machine controller. The position of the control element is within the effective range of the control element, and the image output device can be used to output the machine simulation operation screen connected to the control unit to the screen of the machine controller. The system module of the non-intrusive data retrieval system for simulating the operation screen of the machine, as described in claim 1, wherein the software control system of the system module can be temporarily stored by the signal receiving device for corresponding field operation. The keyboard input data performed by the personnel, and when switching to the corresponding operation page, the human machine interface simulation device can be used to perform actual data input on the machine controller.