A novel technique to improve the learning ability of robots that perform repetitive tasks

Learning from one's past mistakes is not limited to humans. Computers do it too. In industries, this is done via computer-based control systems that help operate production systems in industries. For industrial robots that perform specific tasks in batches, say producing clothing, computer chips, or baked goods, the most commonly used control technique is iterative learning control (ILC). Most industries still rely on ILC systems that use a learning strategy called the proportional-type update rule (PTUR). This technique improves the performance of ILC systems by repeating the same task over and over and updating its control input based on errors encountered in previous iterations.

However, this control methodology was proposed decades in the past. And since ILC systems are being increasingly adopted for performing more complex tasks, there is a need for techniques that can learn faster and with greater accuracy.

In a recent breakthrough, a group of scientists has proposed a new technique that uses the fractional power update rule (FPUR) to enhance the performance potential of single-input-single-output linear ILC systems. The study has been published in the May 2023 Issue, IEEE/CAA Journal of Automatica Sinica.

Convergence rates—the rates at which the difference between the desired output and the actual output decreases over time—play a crucial role in defining the efficiency of an ILC system. Existing methods for improving convergence rate often turn out to be unsatisfactory in situations that require high precision. Even in the case of constant or manually selected learning gains, current ILC systems that use linear update method fail to exploit the available information to the fullest. Therefore, the scientists investigated approaches beyond PTUR, which utilized nonlinear update methods to learn and reach the desired output. “Traditional PTUR uses a linear term for the tracking error to update the control input. On the other hand, FPUR uses a fractional term for updation. Since any positive number smaller than one has a larger fractional power than itself, the update intensity of FPUR is larger than that of PTUR for small tracking errors, leading to a faster convergence rate,” explains Zihan Li, the lead author of the study and a master's student at the School of Mathematics at Renmin University of China.

The team developed a new FPUR method inspired by newer finite-time control (FTC) and terminal sliding mode control (TSMC) strategies, which are potential techniques for overcoming the previously mentioned issues and for improving convergence speed. The scientists also adopted a nonlinear mapping approach to explore the error dynamics over time. This approach allowed them to report fast convergence performance and characterize possible limit cycles of tracking errors in ILC systems. Furthermore, numerical simulations were also performed to validate the effectiveness of the new method.

When asked about how the proposed system would change the field of ILC systems, Li says, “This study serves three main purposes. First, it provides an algorithm that uses a nonlinear update method to improve the learning ability. Second, it shows that adapting fractional power terms allows the convergence rate to be regulated based on actual performance. And finally, it exhibits fast convergence rates on par with those of FTC and TMSC.”

This study has demonstrated, for the first time, the use of the FPUR for ILC in single-input-single-output linear systems. The proposed technique could potentially be used in other repetitive systems such as autonomous vehicles, unmanned aerial vehicles, and rehabilitation robots.

Z. H. Li, D. Shen, and X. H. Yu, “Enhancing iterative learning control with fractional power update law,” IEEE/CAA J. Autom. Sinica, vol. 10, no. 5, pp. 1137–1149, May 2023.

###

Author Information

Zihan Li is working toward his master’s degree at the School of Mathematics, Renmin University of China. Before joining the institute, he completed his B.S. degree in mathematics from Hunan University in 2021. His current area of research includes learning control and parameter estimation.

Prof. Dong Shen is a senior member at IEEE and on the Editorial Boards of International Journal of Robust and Nonlinear Control and IET Cyber-Systems and Robotics, and the Early Advisory Board of IEEE/CAA Journal of Automatica Sinica. Since 2020, he has been a Professor at the School of Mathematics, Renmin University of China (RUC). Shen received B.S. and Ph.D. degrees in mathematics from Shandong University, and the Academy of Mathematics and Systems Science, Chinese Academy of Sciences (CAS). Before joining RUC, he was a Professor at the College of Information Science and Technology, Beijing University of Chemical Technology. His current areas of interest include iterative learning control, stochastic optimization, and distributed artificial intelligence.

Prof. Xinghuo Yu is a Fellow of the Australian Academy of Science, a Fellow at IEEE and a Distinguished Professor and a Vice-Chancellor’s Professorial Fellow at Royal Melbourne Institute of Technology (RMIT) University, Australia. He is also an Honorary Fellow of Engineers Australia. Yu received B.Eng. and M.Eng. degrees in electrical and electronic engineering from the University of Science and Technology of China. He then got his Ph.D. degree in control science and engineering from Southeast University. He was the President of IEEE Industrial Electronics Society in 2018 and 2019. His latest areas of research interests include control systems, complex and intelligent systems, and future energy systems.

 

IEEE/CAA Journal of Automatica Sinica aims to publish high-quality, high-interest, far-reaching research achievements globally, and provide an international forum for the presentation of original ideas and recent results related to all aspects of automation.

The Impact Factor of IEEE/CAA Journal of Automatica Sinica is 7.847, ranking among Top 10% (SCI Q1) in the category of Automation & Control Systems, according to the latest Journal Citation Reports released by Clarivate Analytics in June 2022. In addition, its latest CiteScore is 13.0, ranked TOP 1 in the category of “Control and Optimization”, top 5% in the category of "Computer Science Information System", top 5% in the category of "Control and Systems Engineering", and top 7% in the category of “Artificial Intelligence". 

Why publish with us: Fast and high quality peer review; Simple and effective online submission system; Widest possible global dissemination of your research; Indexed in SCIE, EI, IEEE, Scopus, Inspec. JAS papers can be found at http://ieeexplore.ieee.org/xpl/mostRecentIssue.jsp?punumber=6570654 or www.ieee-jas.net

---

---