New patent application published for: GENERATIVE ARTIFICIAL INTELLIGENCE FOR CREATION OF INSTRUCTION CODE FROM AN INPUT
GENERATIVE ARTIFICIAL INTELLIGENCE FOR CREATION OF INSTRUCTION CODE FROM AN INPUT
Abstract
Various systems and methods are presented regarding generating executable computer code/instructions from input files, whereby the input files may be an image file (e.g., JPEG, PDF, etc.). The image file can be digital capture of a sequence of instructions such as a graphical representation comprising a ladder diagram, a function block diagram, a sequential function chart, etc. P&ID and suchlike can also be submitted to the system. Code generated from the input files can be enhanced by application of historical data comprising pertinent subroutines, and suchlike. Further, an entity can be prompted to provide further information in the event of the input file does not provide all of the content.
Inventors:
Pantea; Adrian D. (Scottsdale, AZ), Ohlsen; Michael J. (Chesterland, OH), Carrara; Anthony (Strongsville, OH), Hays; Christopher S. (Phoenix, AZ), Rosu; Allen (Painesville, OH), Anand; Ashish (Aurora, OH), Stanek; Christopher E. (Willoughby, OH), Fernandes; Fabiano (Solon, OH)
Applicant:
Rockwell Automation Technologies, Inc. (Mayfield Heights, OH)
Family ID:
1000009442712
Appl. No.:
19/718269
Filed:
June 24, 2026
Claims
1. A system, comprising: a memory that stores computer executable components; and a processor that executes the computer executable components stored in the memory, wherein the computer executable components comprise: a file processing component configured to: receive an input file representing an industrial process, wherein the input file is a digital image capture of a drawn visual representation of a control program; identify, based on analysis of the input file, an operation represented in the visual representation of the control program to be performed by an automation controller that controls operation of the industrial process; and generate, based on the analysis, automation code that, in response to execution by the automation controller, causes the automation controller to perform the operation.
2. The system of claim 1, wherein the visual representation is one of a ladder diagram, a function block diagram, a sequential function chart, or a flowchart.
3. The system of claim 1, wherein the digital image file is one of a Joint Photographic Experts Group (JPEG) image file, a Portable Network Graphics (PNG) image file, a Graphics Interchange Format (GIF) image file, a Scalable Vector Graphics (SVG) image file, or a Portable Document Format (PDF) image file.
4. The system of claim 1, wherein the automation controller is a first automation controller, the operation is a first operation, and the file processing component is further configured to: identify, based on the analysis of the input file, a second operation to be performed by a second automation controller; reference a database comprising a list of automation controllers; and in response to a determination that the second automation controller is not present in the list of automation controllers, generate a request for further information regarding the second automation controller.
5. The system of claim 4, further comprising an interface component configured to: display the request on a client device; receive a response to the request, wherein the response identifies the second automation controller; and append, based on the response, the automation code with supplemental automation code that, in response to execution on the second automation controller, causes the second automation controller to perform the second operation.
6. The system of claim 1, wherein the file processing component is further configured to receive supplemental code comprising at least one of metadata, an annotation, or a descriptor providing additional context for the input file, and generate the automation code further based on analysis of the supplemental code.
7. The system of claim 1, further comprising an interface component configured to: display the input file representing the industrial process together with an annotation point indicating a portion of the visual representation that requires supplemental information; and receive the supplemental information via interaction with the annotation point, and generate the automation code further based on the supplemental information.
8. The system of claim 7, wherein the supplemental information specifies at least one of an operation performed by the automation controller or an operation of equipment in the industrial process.
9. The system of claim 1, further comprising a recommendation component configured to: formulate, based on analysis of the automation code, an improvement to the automation code, wherein the improvement comprises at least one of replacement of a portion of the automation code with pre-existing automation code or modification of a sequence of operations defined by the automation code.
10. The system of claim 1, wherein the input file is a first input file, the operation is a first operation, and the file processing component is further configured to: receive a second input file comprising a digital image of a piping and instrumentation diagram, identify a second operation to be performed by the automation controller based on analysis of the second input file, and generate, based on the analysis, second automation code that, in response to execution by the automation controller, causes the automation controller to perform the second operation.
11. A method, comprising: receiving, by a system comprising a processor, an input file representing an industrial process, wherein the input file is a digital image capture of a drawn a visual representation of a control program; identifying, by the system based on analysis of the input file, an operation represented in the drawn visual representation to be performed by a programmable logic controller that controls operation of the industrial process; and generating, by the system based on the analysis, automation code that, in response to execution by the programmable logic controller, causes the programmable logic controller to perform the operation.
12. The method of claim 11, wherein the visual representation is one of a ladder diagram, a function block diagram, a sequential function chart, or a flowchart.
13. The method of claim 11, wherein the digital image is one of a Joint Photographic Experts Group (JPEG) image file, a Portable Network Graphics (PNG) image file, a Graphics Interchange Format (GIF) image file, a Scalable Vector Graphics (SVG) image file, or a Portable Document Format (PDF) image file.
14. The method of claim 11, wherein the generating of the automation code comprises: receiving supplemental code comprising at least one of metadata, an annotation, or a descriptor providing additional context for the input file, and generating the automation code further based on analysis of the supplemental code.
15. The method of claim 11, wherein the generating of the automation code comprises: displaying the input file together with an annotation point indicating a portion of the visual representation that requires supplemental information; and receiving the supplemental information via interaction with the annotation point, and generating the automation code further based on the supplemental information.
16. The method of claim 11, further comprising: determining, based on analysis of the automation code, an improvement to the automation code, wherein the improvement comprises at least one of replacement of a portion of the automation code with pre-existing automation code or modification of a sequence of operations defined by the automation code; and implementing, by the system, the improvement in the automation code.
17. The method of claim 11, wherein the input file is a first input file, the operation is a first operation, and the method further comprises: receiving, by the system, a second input file comprising a digital image of a piping and instrumentation diagram, identifying, by the system, a second operation to be performed by the programmable logic controller based on analysis of the second input file, and generating, by the system based on the analysis, second automation code that, in response to execution by the programmable logic controller, causes the programmable logic controller to perform the second operation.
18. A non-transitory computer-readable medium having stored thereon instructions that, in response to execution, cause a system comprising a processor to perform operations, the operations comprising: receiving an input file representing an industrial process, wherein the input file is a digital image capture of a drawn a visual representation of a control program; identifying, based on analysis of the input file, an operation represented in the drawn visual representation to be performed by an industrial controller that controls operation of the industrial process; and generating, based on the analysis, automation code that, in response to execution by the industrial controller, causes the industrial controller to perform the operation.
19. The non-transitory computer-readable medium of claim 18, wherein the visual representation is one of a ladder diagram, a function block diagram, a sequential function chart, or a flowchart.
20. The non-transitory computer-readable medium of claim 18, wherein the generating of the automation code comprises: receiving supplemental code comprising at least one of metadata, an annotation, or a descriptor providing additional context for the input file, and generating the automation code further based on analysis of the supplemental code.
- Company
- Rockwell Automation Technologies, Inc.
- Keywords
- G05B19/0426