Optimal layout planning for human robot collaborative assembly systems and visualization through immersive technologies (2024)

research-article

Authors: M. Eswaran, Anil kumar Inkulu, Kaartick Tamilarasan, M.V.A. Raju Bahubalendruni, + 3, R. Jaideep, Muhammad Selmanul Faris, and Nidhin Jacob (Less)

Published: 25 June 2024 Publication History

  • 0citation
  • 0
  • Downloads

Metrics

Total Citations0Total Downloads0

Last 12 Months0

Last 6 weeks0

  • Get Citation Alerts

    New Citation Alert added!

    This alert has been successfully added and will be sent to:

    You will be notified whenever a record that you have chosen has been cited.

    To manage your alert preferences, click on the button below.

    Manage my Alerts

    New Citation Alert!

    Please log in to your account

      • View Options
      • References
      • Media
      • Tables
      • Share

    Abstract

    The deployment of Industry 4.0 emerging technologies such as Augmented reality (AR), Virtual reality (VR), and collaborative Robots enhances flexibility and precision in the manufacturing systems. A flexible, and collaborative manufacturing system with robots and human integrates the prominent attributes of customized automation and fortify the safety of the human workforce. The proposed work involves the approach of AR-assisted assembly layout configurations for the Human-Robot Collaboration (HRC) production system, which is a typical example of the smart manufacturing system. The reconfiguration/configuration of the assembly layout is triggered with respect to the demand of new variants into the market and the upgradation of new technologies in the existing system. A multi-objective algorithm is proposed to maximize the production outlet with effective utilization of floor space, minimum idle time and optimum resource allocation. The selected work is branched into three phases: To begin with, the approach of task allocation is constructed to identify the suitable resources (human, robot) for the appropriate assembly tasks in the HRC system. The outcomes such as resource allocation, number of resources, and footprint of resources are considered as input to the optimization model. Further, modified particle swarm optimization (MPSO) is deployed to generate a feasible assembly layout for the HRC manufacturing system. Additionally, the breath-first approach has been utilized to generate the optimal aisle as a conveyor in the layout. Notably, the comparisons studies have been carried out in this work, which facilitates to explore the robustness of proposed modified PSO algorithms for the selected applications. Subsequently, the virtual and AR tool is deployed for the layout planer to explore and validate the obtained layout from the PSO model in both the virtual and physical environment of the industrial workspace. Finally, an industrial case study of rotary gear pump assembly system is adopted for the implementation of the proposed framework.

    References

    [1]

    A. Ali, H. Azevedo-Sa, D.M. Tilbury, L.P. Robert, Heterogeneous human–robot task allocation based on artificial trust, Scientific Reports 12 (1) (2022),.

    [2]

    S. Alirezazadeh, L.A. Alexandre, Dynamic task scheduling for human-robot collaboration, IEEE Robotics and Automation Letters 7 (4) (2022) 8699–8704,.

    [3]

    M.V.A.R. Bahubalendruni, B.B. Biswal, An efficient stable subassembly identification method towards assembly sequence generation, National Academy Science Letters 41 (6) (2018) 375–378,.

    [4]

    T. Bänziger, A. Kunz, K. Wegener, Optimizing human–robot task allocation using a simulation tool based on standardized work descriptions, Journal of Intelligent Manufacturing 31 (7) (2020) 1635–1648,.

    Digital Library

    [5]

    D.K. Baroroh, C.H. Chu, Human-centric production system simulation in mixed reality: An exemplary case of logistic facility design, Journal of Manufacturing Systems 65 (2022) 146–157,.

    [6]

    M. Besbes, M. Zolghadri, R. Costa Affonso, F. Masmoudi, M. Haddar, A methodology for solving facility layout problem considering barriers: Genetic algorithm coupled with A* search, Journal of Intelligent Manufacturing 31 (3) (2020) 615–640,.

    [7]

    M. Besbes, M. Zolghadri, R. Costa Affonso, F. Masmoudi, M. Haddar, 3D facility layout problem, Journal of Intelligent Manufacturing 32 (4) (2021) 1065–1090,.

    Digital Library

    [8]

    B. Bhattacharya, E.H. Winer, Augmented reality via expert demonstration authoring (AREDA), Computers in Industry 105 (2019) 61–79,.

    Digital Library

    [9]

    F. Chen, K. Sekiyama, F. Cannella, T. f*ckuda, Optimal subtask allocation for human and robot collaboration within hybrid assembly system, IEEE Transactions on Automation Science and Engineering 11 (4) (2014) 1065–1075,.

    [10]

    S.H. Choi, K.B. Park, D.H. Roh, J.Y. Lee, M. Mohammed, Y. Ghasemi, H. Jeong, An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation, Robotics and Computer-Integrated Manufacturing 73 (2022),.

    Digital Library

    [11]

    Q. Deng, Q. Kang, L. Zhang, M.C. Zhou, J. An, Objective space-based population generation to accelerate evolutionary algorithms for large-scale many-objective optimization, IEEE Transactions on Evolutionary Computation 27 (2) (2023) 326–340,.

    Digital Library

    [12]

    A. Deshpande, I. Kim, The effects of augmented reality on improving spatial problem solving for object assembly, Advanced Engineering Informatics 38 (2018) 760–775,.

    Digital Library

    [13]

    M. Djassemi, Improving factory layout under a mixed floor and overhead material handling condition, Journal of Manufacturing Technology Management 18 (3) (2007) 281–291,.

    [14]

    Eswaran, M., & Bahubalendruni, M. V. A. R. (2022, October 1). Challenges and opportunities on AR/VR technologies for manufacturing systems in the context of industry 4.0: A state of the art review. Journal of Manufacturing Systems, 65, 260–278. Elsevier B.V. 10.1016/j.jmsy.2022.09.016.

    [15]

    Eswaran, M., Gulivindala, A. K., Inkulu, A. K., & Raju Bahubalendruni, M. V. A. (2023, March 1). Augmented reality-based guidance in product assembly and maintenance/repair perspective: A state of the art review on challenges and opportunities. Expert Systems with Applications, 213. Elsevier Ltd. 10.1016/j.eswa.2022.118983.

    [16]

    H.C. Fang, S.K. Ong, A.Y.C. Nee, Interactive robot trajectory planning and simulation using augmented reality, Robotics and Computer-Integrated Manufacturing 28 (2) (2012) 227–237,.

    Digital Library

    [17]

    S. Gao, M. Zhou, Y. Wang, J. Cheng, H. Yachi, J. Wang, Dendritic neuron model with effective learning algorithms for classification, approximation, and prediction, IEEE Transactions on Neural Networks and Learning Systems 30 (2) (2019) 601–614,.

    [18]

    A. Hietanen, R. Pieters, M. Lanz, J. Latokartano, J.K. Kämäräinen, AR-based interaction for human-robot collaborative manufacturing, Robotics and Computer-Integrated Manufacturing 63 (2020),.

    Digital Library

    [19]

    Inkulu, A. K., Bahubalendruni, M. V. A. R., Dara, A., & SankaranarayanaSamy, K. (2022, February 11). Challenges and opportunities in human robot collaboration context of Industry 4.0 - a state of the art review. Industrial Robot, 49, 226–239. Emerald Group Holdings Ltd. 10.1108/IR-04-2021-0077.

    [20]

    M. Khatib, K. Al Khudir, A. De Luca, Human-robot contactless collaboration with mixed reality interface, Robotics and Computer-Integrated Manufacturing 67 (2021),.

    [21]

    N. Kousi, C. Gkournelos, S. Aivaliotis, K. Lotsaris, A.C. Bavelos, P. Baris, …., S. Makris, Digital twin for designing and reconfiguring human–robot collaborative assembly lines, Applied Sciences (Switzerland) 11 (10) (2021),.

    [22]

    M.L. Lee, S. Behdad, X. Liang, M. Zheng, Task allocation and planning for product disassembly with human–robot collaboration, Robotics and Computer-Integrated Manufacturing 76 (2022),.

    [23]

    Z. Lei, S. Gao, Z. Zhang, H. Yang, H. Li, A chaotic local search-based particle swarm optimizer for large-scale complex wind farm layout optimization, IEEE/CAA Journal of Automatica Sinica 10 (5) (2023) 1168–1180,.

    [24]

    C. Li, P. Zheng, S. Li, Y. Pang, C.K.M. Lee, AR-assisted digital twin-enabled robot collaborative manufacturing system with human-in-the-loop, Robotics and Computer-Integrated Manufacturing 76 (2022),.

    Digital Library

    [25]

    C. Li, P. Zheng, Y. Yin, Y.M. Pang, S. Huo, An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction, Robotics and Computer-Integrated Manufacturing 80 (2023),.

    Digital Library

    [26]

    S. Liu, L. Wang, X. Vincent Wang, Multimodal data-driven robot control for human-robot collaborative assembly, Journal of Manufacturing Science and Engineering 144 (5) (2022),.

    [27]

    X. Luo, Y. Zhou, Z. Liu, L. Hu, M.C. Zhou, Generalized Nesterov’s acceleration-incorporated, non-negative and adaptive latent factor analysis, IEEE Transactions on Services Computing 15 (5) (2022) 2809–2823,.

    [28]

    Ma, Y., Hao, X., Hao, J., Lu, J., Liu, X., Tong, X., … Meng, Z. (2021). A hierarchical reinforcement learning based optimization framework for large-scale dynamic pickup and delivery problems.

    [29]

    A.A. Malik, A. Bilberg, Complexity-based task allocation in human-robot collaborative assembly, Industrial Robot 46 (4) (2019) 471–480,.

    [30]

    T. Masood, J. Egger, Adopting augmented reality in the age of industrial digitalisation, Computers in Industry 115 (2020),.

    Digital Library

    [31]

    M. Moghaddam, N.C. Wilson, A.S. Modestino, K. Jona, S.C. Marsella, Exploring augmented reality for worker assistance versus training, Advanced Engineering Informatics 50 (2021),.

    Digital Library

    [32]

    F. Ni, J. Hao, J. Lu, X. Tong, M. Yuan, J. Duan, …., K. He, August). A multi-graph attributed reinforcement learning based optimization algorithm for large-scale hybrid flow shop scheduling problem, in: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, 2021, pp. 3441–3451.

    [33]

    M.R. Pourhassan, S. Raissi, An integrated simulation-based optimization technique for multi-objective dynamic facility layout problem, Journal of Industrial Information Integration 8 (2017) 49–58,.

    [34]

    A. Pupa, W. Van Dijk, C. Brekelmans, C. Secchi, A resilient and effective task scheduling approach for industrial human-robot collaboration, Sensors 22 (13) (2022),.

    [35]

    B. Sadrfaridpour, Y. Wang, Collaborative assembly in hybrid manufacturing cells: An integrated framework for human-robot interaction, IEEE Transactions on Automation Science and Engineering 15 (3) (2018) 1178–1192,.

    [36]

    P. Tsarouchi, A.S. Matthaiakis, S. Makris, G. Chryssolouris, On a human-robot collaboration in an assembly cell, International Journal of Computer Integrated Manufacturing 30 (6) (2017) 580–589,.

    Digital Library

    [37]

    P. Tsarouchi, G. Michalos, S. Makris, T. Athanasatos, K. Dimoulas, G. Chryssolouris, On a human–robot workplace design and task allocation system, International Journal of Computer Integrated Manufacturing 30 (12) (2017) 1272–1279,.

    Digital Library

    [38]

    Vysocky, A., & Novak, P. (2016). Human - Robot collaboration in industry. MM Science Journal, 2016-June, 903–906. 10.17973/MMSJ.2016_06_201611.

    [39]

    L. Zhang, Q. Kang, Q. Deng, L. Xu, Q. Wu, A line complex-based evolutionary algorithm for many-objective optimization, IEEE/CAA Journal of Automatica Sinica 10 (5) (2023) 1150–1167,.

    [40]

    R. Zhang, Q. Lv, J. Li, J. Bao, T. Liu, S. Liu, A reinforcement learning method for human-robot collaboration in assembly tasks, Robotics and Computer-Integrated Manufacturing 73 (2022),.

    Digital Library

    [41]

    Y. Zhou, W. Xu, M. Zhou, Z.H. Fu, Bi-trajectory hybrid search to solve bottleneck-minimized colored traveling salesman problems, IEEE Transactions on Automation Science and Engineering (2023),.

    [42]

    Q. Zhu, S. Huang, G. Wang, S.K. Moghaddam, Y. Lu, Y. Yan, Dynamic reconfiguration optimization of intelligent manufacturing system with human-robot collaboration based on digital twin, Journal of Manufacturing Systems 65 (2022) 330–338,.

    Recommendations

    • AR-based interaction for human-robot collaborative manufacturing

      Highlights

      • A depth-based model for HRC, consisting of three different HRC zones and their continuous update and safety monitoring.

      Abstract

      Industrial standards define safety requirements for Human-Robot Collaboration (HRC) in industrial manufacturing. The standards particularly require real-time monitoring and securing of the minimum protective distance between a robot ...

      Read More

    • Integrated product design and assembly planning in an augmented reality environment

      Purpose - The purpose of this paper is to present a methodology that integrates design and assembly planning in an augmented reality AR environment. Intuitive bare-hand interactions BHIs and a combination of virtual and real objects are used to perform ...

      Read More

    • Key Technique of Assembly System in an Augmented Reality Environment

      ICCMS '10: Proceedings of the 2010 Second International Conference on Computer Modeling and Simulation - Volume 01

      Assembly technology aims to develop fast, reliable and low cost method to improve product design in the manufacturing industry. Augmented Reality (AR) is a promising technology which can enhance the sense of reality by combining virtual objects with ...

      Read More

    Comments

    Information & Contributors

    Information

    Published In

    Optimal layout planning for human robot collaborative assembly systems and visualization through immersive technologies (1)

    Expert Systems with Applications: An International Journal Volume 241, Issue C

    May 2024

    1588 pages

    ISSN:0957-4174

    Issue’s Table of Contents

    Elsevier Ltd.

    Publisher

    Pergamon Press, Inc.

    United States

    Publication History

    Published: 25 June 2024

    Author Tags

    1. Augmented reality
    2. Layout planning
    3. PSO
    4. Task allocation
    5. Assembly

    Qualifiers

    • Research-article

    Contributors

    Optimal layout planning for human robot collaborative assembly systems and visualization through immersive technologies (2)

    Other Metrics

    View Article Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Total Citations

    • Total Downloads

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0

    Other Metrics

    View Author Metrics

    Citations

    View Options

    View options

    Get Access

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    Get this Publication

    Media

    Figures

    Other

    Tables

    Optimal layout planning for human robot collaborative assembly systems and visualization through immersive technologies (2024)
    Top Articles
    Latest Posts
    Article information

    Author: Amb. Frankie Simonis

    Last Updated:

    Views: 5696

    Rating: 4.6 / 5 (76 voted)

    Reviews: 83% of readers found this page helpful

    Author information

    Name: Amb. Frankie Simonis

    Birthday: 1998-02-19

    Address: 64841 Delmar Isle, North Wiley, OR 74073

    Phone: +17844167847676

    Job: Forward IT Agent

    Hobby: LARPing, Kitesurfing, Sewing, Digital arts, Sand art, Gardening, Dance

    Introduction: My name is Amb. Frankie Simonis, I am a hilarious, enchanting, energetic, cooperative, innocent, cute, joyous person who loves writing and wants to share my knowledge and understanding with you.