Next Article in Journal
Discovery, Quantitative Recurrence, and Inhibition of Motion-Blur Hysteresis Phenomenon in Visual Tracking Displacement Detection
Previous Article in Journal
Measuring and Predicting Sensor Performance for Camouflage Detection in Multispectral Imagery
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Mobile Manipulators in Industry 4.0: A Review of Developments for Industrial Applications

1
LCPI, Arts et Métiers Institute of Technology (AMIT), HESAM Université, 75013 Paris, France
2
LISPEN, Arts et Métiers Institute of Technology (AMIT), HESAM Université, 59046 Lille, France
3
Volvo Construction Equipment AB, 635 10 Eskilstuna, Sweden
4
OMRON Industrial Automation, 94130 Nogent-sur-Marne, France
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(19), 8026; https://doi.org/10.3390/s23198026
Submission received: 23 August 2023 / Revised: 11 September 2023 / Accepted: 20 September 2023 / Published: 22 September 2023
(This article belongs to the Section Industrial Sensors)

Abstract

:
In the realm of Industry 4.0, diverse technologies such as AI, Cyber-Physical Systems, IoT, and advanced sensors converge to shape smarter future factories. Mobile manipulators (MMs) are pivotal, fostering flexibility, adaptability, and collaboration in industrial processes. On one hand, MMs offer a remarkable level of flexibility, adaptability, and collaboration in industrial processes, facilitating swift production line changes and efficiency enhancements. On the other hand, their integration into real manufacturing environments requires meticulous considerations, such as safety, human–robot interaction, and cybersecurity. This article delves into MMs’ essential role in achieving Industry 4.0’s automation and adaptability by integrating mobility with manipulation capabilities. The study reviews MMs’ industrial applications and integration into manufacturing systems. The most observed applications are logistics (49%) and manufacturing (33%). As Industry 4.0 advances, the paper emphasizes updating and aligning MMs with the smart factory concept by networks of sensors and the real-time analysis of them, especially for an enhanced human–robot interaction. Another objective is categorizing considerations for MMs’ utilization in Industry 4.0-aligned manufacturing. This review methodically covers a wide range of considerations and evaluates existing solutions. It shows a more comprehensive approach to understanding MMs in Industry 4.0 than previous works. Key focus areas encompass perception, data analysis, connectivity, human–robot interaction, safety, virtualization, and cybersecurity. By bringing together different aspects, this research emphasizes a more integrated view of the role and challenges of MMs in the Industry 4.0 paradigm and provides insights into aspects often overlooked. A detailed and synthetic analysis of existing knowledge was performed, and insights into their future path in Industry 4.0 environments were provided as part of the contributions of this paper. The article also appraises initiatives in these domains, along with a succinct technology readiness analysis. To sum up, this study highlights MMs’ pivotal role in Industry 4.0, encompassing their influence on adaptability, automation, and efficiency.

1. Introduction

Modern industrial production has a growing requirement for flexibility since it allows companies to respond to shifting consumer demands, developing technologies, and new regulations [1]. This increases the expectations placed on the design and adaptability of robotics systems now and in the future. In order to meet this need, the literature has investigated prospective generations of transformable solutions for automation and logistics for small and large manufacturing systems. The robotics sector has undergone a transformation throughout the industrial age. Beginning with Robotics 1.0, where the primary goal was to provide early motorization to reduce repetitive human tasks, the field branched off with the integration of vision and feedback systems in Robotics 2.0. The transition to Robotics 3.0 represented a digital transformation that emphasized data exchange, human–machine collaboration, and the principles of Industry 4.0. The current era, Robotics 4.0, supports cloud-based controls, artificial intelligence, and IoT integration, and it aims for more organic interactions and comprehensive collaborative experiences. In parallel with these developments, a variety of robotic systems have emerged, including robotic arms for precision manufacturing, aerial drones, humanoid robots, autonomous vehicles, underwater explorers, surgical robots, and swarm robots [2]. Robotic systems known as mobile manipulators (MMs) have become a creative way to improve manufacturing flexibility and efficiency by combining the mobility of a mobile robot with the ability to manipulate objects through robotic arms. These systems can carry out a variety of activities with a high degree of flexibility and accuracy due to the integration of mobility and manipulation.

1.1. MMs: A History and Related Works

Basically, MMs consist of one or multiple robotic arms mounted on the top of a mobile platform. The system is surely equipped with proper sensors, actuators, and tools, enabling the MM to move according to surroundings safely and autonomously and to perform a task based on the selected tool for the end-effector of the arm. MMs can be designed for special functionalities by adapting their size, shape, payload, mobility, tools, and other characteristics. They are designed to work in special environments that can be on the ground (indoor or outdoor, for smooth or turbulent rout), aerial, or underwater. They can be designed to move sensitive small objects or huge ones for big constructions. Mobile platforms can be legged or wheeled. Wheeled is more common, which can be omnidirectional, holonomic, or nonholonomic. MMs gradually established their position for numerous applications, such as in agriculture, military, nuclear, space, mine, healthcare and assistive, domestic, search and rescue, and industrial fields. The primary focus of this article is on the industrial applications; however, some of the solutions in other areas have been addressed within some of the projects that are discussed as follows.
S. Bøgh et al. [3] provided an overview of existing MMs from the first prototype in 1984 (MORO) until 2010 (Figure 1). Nevertheless, the origins of MM creation may be traced back even farther to the Stanford Research Institute, which developed SHAKEY from 1966 to 1972 [4].
The journey of MMs has evolved through various stages, with the literature punctuating each transformative phase. The inception of MMs on production lines primarily aimed to bolster navigation, control, and perception, a trend significantly discussed in the RoboCup competitions [5]. As mobile platforms were integrated with serial manipulator arms, systems started to offer over nine degrees of freedom, paving the way for applications beyond the industrial sector, including service and rehabilitation [5].
However, extending the workspace of these manipulators posed both control and mechatronic design challenges [6]. The collaborative approach emerged as a promising avenue, with MMs being visualized as collaborative entities in industrial applications. This collaborative design, termed as Collaborative Mobile Industrial Manipulator, showcased an intricate blend of hardware, ranging from end-effectors to sensors, and software that incorporated planners and controllers [7]. Their versatility found interest in sectors such as logistics and manufacturing, even as research continued to optimize their interaction dynamics and autonomous controls.
Another groundbreaking direction was the convergence of unmanned aerial vehicles (UAVs) with MMs, hinting at the future of cooperative assembly and dynamic logistics [8]. Yet, the combined potential of UAVs and MRMs remains a nascent field, echoing the need for more focused investigations.
While these reviews provided insights into the challenges of system design [5], collaborative aspects [6], hardware-software architecture [7], and UAV-MM integration [8], there appear to be gaps in addressing certain facets of MMs.
In light of the above, our review aims to build, upon these foundations, a fresh perspective on the yet unexplored or under-represented areas, ensuring a more holistic understanding of the MM domain.

1.2. Towards Smarter Factory

By incorporating cutting-edge technologies, such as the Internet of Things (IoT), artificial intelligence (AI), advanced sensors, and robots into production processes, the fourth industrial revolution, Industry 4.0, seeks to develop smart factories that are highly efficient, adaptable, and responsive to market changes [9]. Due to the advent and development of Industry 4.0, robotic technology, which provided an essential contribution to the contemporary industry, has undergone significant growth in recent years. In order to satisfy the dynamic requirements of the factory of the future within the context of Industry 4.0, it is projected that the next generation of robots and its accompanying technologies will play a major role. Specifically, effectively utilizing the latest sensor technology is a crucial aspect of recent advancements in robotics. These advanced sensors not only enhance robots’ understanding of their surroundings but also play a vital role in ensuring safe and efficient communication between humans and robots. This domain stands out as one of the most significant areas driving progress in the field of robotic systems [10].
Introducing a new product for use in 4.0 environments requires considering the minimum requirements of Industry 4.0. Industry 4.0, by proposing a decentralized architecture instead of the traditional computer-integrated manufacturing (CIM) structure and introducing CPSs, enables close communication and data exchange among all components in real time [11]. As a result, for example, the ability of the device to communicate in the physical and cyber space is one of the necessary prerequisites. On the other hand, the capacity to comprehend and infer the environment, which is made possible by a variety of sensors and can be improved using AI approaches, is crucial for having a flexible robotic system such as MMs that can adapt effectively in changing and dynamic contexts. Therefore, MM developers are making progress and researching in order to prepare them as much as possible to find their way to real environments according to the current demands of industries. TRL is an approach to realize the degree of readiness of a concept for implementation under real conditions. Looking at MMs from a TRL perspective will assist in evaluating their suitability to integrate into 4.0 manufacturing systems.

1.3. Problem Statement

With the rapid evolution and adoption of Industry 4.0, there is a mounting emphasis on operational flexibility and adaptability in manufacturing environments. MMs have emerged as pivotal assets in addressing this demand, offering unique capabilities that transcend traditional robotics. However, while MMs inherently possess characteristics suitable for the Industry 4.0 paradigm, the issue of their operational and structural integration into a digitized production system remains. To fully harness the potential of MMs in Industry 4.0, it is imperative to identify and address areas where they must evolve. This review delves into the advancements necessary for MMs, ensuring their seamless and efficient deployment within the transformative landscape of Industry 4.0.

1.4. Motivation and Contribution

The motivation behind this review stems from the growing need to integrate agile, efficient, and adaptable robotic systems within modern factories. In the middle of the huge transition to Industry 4.0, understanding and leveraging the potential of MMs becomes vital. The aim of this review is to provide a comprehensive overview of MMs, their trajectory in the industry, and a roadmap for their future development. Our contribution lies in a meticulous analysis, a synthesis of existing knowledge, and insights into their future direction in Industry 4.0 environments.

1.5. Organization of the Paper

The rest of this article is organized as follows: This article investigates the application of MMs in manufacturing environments. Section 2 outlines the methodology the authors adopted for this review. A history of MMs and their application, employment, and integration into the industry are provided in Section 3. Section 4 proposes a taxonomy of several MM development areas required by Industry 4.0 and surveys the literature for efforts to progress in each area. Section 5 discusses the relationship between different development areas and analyzes different MM solutions from the vision of TRL, and finally, the paper is concluded in Section 6.

2. Methodology

To systematically review the developments of MMs in the context of Industry 4.0, our methodology was constructed in a multi-staged manner:
  • Preliminary Search Strategy
The research began by querying key databases, such as Scopus, IEEE, Google Scholar, and ScienceDirect, employing specific search strings. These strings contained terms such as “Mobile Manipulators”, “Industrial Applications”, “Industry 4.0”, “Robotics”, and “Automation”.
2.
Segregated Literature Review
From our initial search, the literature falls into two categories:
  • Industry 4.0-focused: These articles predominantly discussed the core concepts and facets of Industry 4.0 but might not explicitly mention MMs.
  • Mobile Manipulator-focused: Papers that discussed the evolution, functionalities, and challenges of MMs, potentially without linking them directly to Industry 4.0.
3.
Analysis of MM Applications in Industry
For the studies that delved into MMs, a key area of focus was understanding their applications across various industrial sectors. This involved categorizing the sectors where MMs have been implemented, such as manufacturing, logistics, assembly, and more; detailing the specific roles and tasks assigned to MMs in each sector; and highlighting the successes and challenges faced in each application.
4.
Synthesis of Industry 4.0 Recommendations for MMs
From the Industry 4.0-centric literature, the principal areas that point to potential directions for MMs have been filtered. This exploration helped bridge the gap between Industry 4.0 aspirations and concrete MM developments.
5.
Exploration of MMs
MM-centric papers were reviewed from historical and emerging challenges to chart their progression through time.
6.
MMs in the Context of Industry 4.0
After separate investigations, an integrated analysis to understand how MMs are reshaped by Industry 4.0 paradigms was performed. This requires finding research that directly linked MMs with Industry 4.0, assessing the compatibility of current MM plans with Industry 4.0 criteria, and identifying areas where MMs may need more innovation to align with Industry 4.0 guidelines.
The effectiveness of this approach, compared to other methodologies, is to identify gaps related to the widespread adoption of MMs in Industry 4.0 and highlight areas that need more research.

3. Integration and Implementation of MMs in Industrial Environments

After the brief history of MMs, in this section, their journey from research to industry is presented. Then, the industrial application of MMs in real-world situations is reviewed and summarized at the end of Section 3.2. The overview presented in Figure 1 is followed by an introduction to more recent projects (Figure 2) that have contributed to the progress of MMs since 2010, with the findings of each mapped and reviewed in related sections.

3.1. From Research to Industry

Especially today, there is a close relationship between scientific research and the needs of industries. Sometimes, the needs of the industry cause the creation of projects for scientific investigation and find innovative ways and the feasibility of each of them. Sometimes, progress in science leads to finding solutions that were not even thought of before, while they help to improve the condition of factories. However, companies are more conservative in employing novel solutions due to a variety of factors, including significant investment costs, the need to modify an existing and successful system, etc. A crucial step in making MMs more prepared for serious entrance and widespread adoption in industries is the integration and implementation of MMs in laboratory settings or real production systems.
S. Bøgh et al. [3] suggested some elements as the infrastructure of integrating MMs into the manufacturing systems. They believe that finding a common language between academy and industry is a vital infrastructure. New concept development (NCD) is an approach used to achieve it. Regarding this model, based on the main strategical objectives, different opportunities can be identified and analyzed to help select the best out of various ideas that address each opportunity. Then, the concept and development of the required technology can be achieved. They suggested a technology push manufacturing technology (TPMT) model to help identify potential opportunities and their analysis. These methodologies can lead us to find the best applications for new technologies, such as MMs. After this application finding, it is suggested to define modules and skills for MMs because a modular system can provide more flexibility. To showcase the practical applications of our selected technologies in real-world settings, we recommend employing a breakdown approach, wherein smaller demonstrations are conducted instead of a single comprehensive demonstration that may take an extended period. This approach allows for a more focused and targeted display of our technologies’ capabilities, enabling our audience to better understand their potential benefits in specific contexts. A representation of how to achieve proper infrastructure for MM integration is shown in Figure 3.

3.2. Industrial Applications

Similar to traditional industrial robots, MMs often find use in boring, stupid, filthy, and/or hazardous applications, with the added advantages of increased operational flexibility, expanded workspace, and enhanced overall equipment effectiveness. S. Bøgh et al. [3] investigated MMs as industrial assistance and classified their applications into logistics, assistive, and service applications (Table 1).
The results of their analysis of MM suitability (in their case LHs) for 566 manual manufacturing tasks from five factories are presented in Figure 4, which shows that logistics, specifically transportation and part feeding, have the highest potential for the immediate implementation of MM technology.
For industrial settings, one of the known MMs, called Little Helper (LH), has seven different versions [12] and was developed at Aalborg University (Figure 5). The project TAPAS included real-world experiments with MMs, such as LH and omniRob, to assess the technology’s readiness for industrial application and their scheduling problems [13]. S. Bøgh et al. [14] believed that MMs are finding their way to more assistive tasks instead of the traditional logistic ones. Thus, they integrated two different types of MMs (LH 3 and omniRob) to collaborate with each other. LH takes part in the assembling operation of rotors, and the omniRob is deployed for logistics (Figure 6) at Grundfos. The duty of scheduling and task planning of the MMs is up to a central mission planner and controller (MPC). The important considerations are cycle time, travelling time of robots (however, they found it hard to detect only the travelling time; thus, they measured a combined average time), their capacity, and manufacturing goals. On the other hand, the environmental information is provided by MES as an input to the MPC (Figure 7). For their experiments, the main initial steps they defined are listed as follows: setting up MMs, setting up and verifying communications, adjusting the workstation, setting up the navigation, programming, and testing. Most of the errors for both MMs were announced to be communication failures and manipulation tasks, and their most serious challenges were in safety, integration with the existing production system, communication problems, and lack of error handling after losing connection.
O. Madsen et al. [15] also covered the simultaneous implementation of two MMs to assist in SQFlex pump production at Grundfos. They relied on skill-based programming and employed the same mission planner system for the parallel navigation of both MMs but without mentioning MES presence. Performance, user friendliness, and economic efficiency were the criteria to help them find the gap between current solutions and demands of the users. This resulted in a cycle time of more than 20 times longer than that observed for humans, as well as a total downtime of 58 min in a half work day due to navigation, assembly process, and communication errors. They decided that the reason for the long cycle time was related to limitations in its scenario, utilization, dexterity, and ability to perform simultaneous quality control. The main challenges they faced were safety, robustness and cycle time, and the reconfigurability and flexibility of MMs and the environment.
I. Nielsen et al. [16] proposed a methodology to implement MMs into cloud manufacturing flexible environments. Their methodology started with the design of MMs. Flexibility, modularity, standardization, autonomy, and dynamic nature were the key indicators to choose the LH for their demonstration. Next, they suggested a multiple-part feeding application. Then, the scheduling problem of MMs was highlighted with a mathematical model in the concept of the Bartender problem. For MM control in the production environment, they also adopted MPC architecture (Figure 7). Finally, for the real-world demonstration, they evaluated their methodology at the CR 1-2-3 impeller production site.
Ghodsian et al. [17] suggested an approach for the successful integration of MMs into 4.0-based industries. They experimented with an MM from the Omron company called “MOMA” (Figure 8) at a laboratory-scaled production system that was supervised by MES [18] for automating the process of feeding raw material. R. Eckholdt Andersen et al. [19] described the implementation of an LH6 that performs part feeding application with a skill-based system (SBS) at the FESTO cyber-physical factory. Iterative design was used to create the LH6 system. The offset of the mobile platform led to the robotic arm’s imprecision, which was countered via a calibration technique. The module provided TCP connection between SBS and the PLC, and two new abilities for calling and listening were developed for seamless integration with SBS. Five different aspects of a part-feeding task were evaluated, and after 25 test runs with nine failures, it was determined that communication between the modules was the main execution bottleneck, and the mobile platform’s errors were caused by navigational errors around a corner close to the target locations.
One of the other MM applications is concerned with the placement and co-manipulation of big pieces on tooling for precise procedures. According to the SOFITEC pilot case of the Sherlock project [20], even though the carbon fiber components of today are not very heavy, a single person cannot manipulate them due to their vast size (up to 7 m) and the distance between workstations. For its deployment, two people are often required, while one person positions the remaining instruments. The remaining employees only assist in following the leader and supporting the weight of the part, with only one operator adding value to the positioning process. The operators clearly work together to complete the assignment, employing force, visual, and speech modes to coordinate their actions. The use of dual-arm MMs for the placement and co-manipulation of massive composite aeronautics parts on precise process tooling has been investigated by [21] (Figure 9).
Another scenario within the Sherlock project concentrates on the assembly line of solar thermal collectors at CALPAK [22]. The operator must put together various thermal collector variations that range in size and weight. The operator must have two-side accessibility while lifting and moving the bulky thermal collectors around to complete the installation. Throughout a shift, these taxing duties must be completed repeatedly. Together with a higher level of exhaustion, chronic pain issues, such hand tendonitis, and back difficulties are also produced for human workers. Sherlock proposed the usage of a high payload collaborative MM. As the operator focuses on small assembly tasks, the high payload robot manages the large payload. AI-enabled onboard sensing devices keep an eye on the operator’s movements, assuring appropriate assembly by examining the order of the various processes. Moreover, augmented reality (AR) visualization tools that show the operator what steps to perform next in the assembling process are helpful.
The assembly of hydraulic pumps and the assistance of manual gas metal arc welding by use of the MM rob@work are two applications that are discussed in [23]. Figure 10 presents the MM applications of logistics and assembly of the KUKA manufacturing system (left) and collaborative assembly at airbus (right) within the project SAPHARI [24].
The ColRobot project integrates advanced robot technology with the needs of users in assembly processes. By using an MM as a “third hand”, the system can deliver kits, tools, and parts and hold work pieces while the operator performs their tasks collaboratively with the robot. Two cases from the automotive [25] and aerospace [26] industries in real-world operating settings were implemented and validated within this project. A ColRobot prototype (KMR IIWA) was presented and tested at ENSAM in [27] for kitting operations of THALES ALENIA SPACE France (TAS-F). Figure 11 shows the ColRobot prototype for fastener tightening and automatic refill in automotive industries [27,28].
BAZAR, a dual-arm MM, was developed at LIRMM (Laboratoire d’informatique, de robotique et de microélectronique de Montpellier) in 2016. It contains two KUKA LWR4+ arms on the top of a Neobotix MPO 700 omni-directional mobile platform. The VERSATILE EU project [29] aimed to investigate the use of MMs in three industry driven applications, the assembly of vehicle dashboards at PSA, the assembly of aircraft wing parts at AIRBUS, and the handling and packaging of shaver handles at BIC. The BAZAR’s introduction and its assistance in a smart logistic use case were presented in [30].
Fetch-and-carry operations in work spaces and settings shared with humans were investigated in the collaborative ISABEL (Innovative Autonomous and Intuitively Operated Service Robot for Efficient Handling and Logistics) project, which is financed by the Federal Ministry of Education and Research. The abilities to load and remove parts from machines, as well as autonomously choose and place items at stations, are priorities. In particular, “life science automation” and “semiconductor manufacturing” are the applications for which this is being performed. At Infineon, the ISABEL robot has undergone successful testing in a production setting. Wafer boxes could be effectively picked up, transported, and fed to equipment in the clean room [31].
Due to its versatility in performing a variety of duties, such as inspection, monitoring, and repair, MMs can find their way into industrial maintenance. In this sector, some applications are required regarding the MAINBOT project, including ubiquity sensing, leakage detection, and surface and interior equipment monitoring [32]. The MAINBOT project involves creating applications for service robots to independently carry out inspection activities on machinery that is organized either horizontally (using ground robots) or vertically (climbing robots) in large industrial plants. In order to achieve the project’s industrial goals, MAINBOT aims to use already-existing robots to implement creative solutions. Specifically, it wants to provide a way to measure various physical parameters at various locations using autonomous robots that can navigate and climb structures, handle sensors, or use specialized non-destructive testing equipment [33]. The strategy used by MAINBOT to accomplish scientific and industrial goals entails analyzing maintenance and inspection needs in large industrial plants, choosing inspection operations based on various criteria, designing modifications in existing MMs to meet the identified requirements, developing and adjusting inspection technologies to be integrated into autonomous MMs, justifying in simulation, integrating robotic platforms and non-destroyable materials, integrating these elements into new and existing robots, and verifying them using a mock-up and, at the end, in real-world case studies. One of these case studies that was carried out at the VALLE energy plant is shown in Figure 12. The tool containing the sensor was positioned perpendicular to the mirror in the actual operation, and the approach maneuver was carried out until the sensor hit the mirror. The toolholder’s three ultrasonic sensors produced signals that were utilized to regulate the trajectory.
IAAM (Institute for Applied Automation and Mechatronics) provides a few multidisciplinary projects that combine applied research with real-world application. FiberRadar is one of them, in which the MM OMNIVIL was used. A quality control technique is being developed for the production of high-strength fiber composite materials as part of the FiberRadar research project. Prior to casting, the approach displays the fiber structure in three dimensions to show any abnormalities and improve the stacking and flow of the fibers. To enable more precise quality control than is now achievable, the IAAM is in charge of creating a transportable measurement system for large-scale components used in the production of wind turbines [35].
With the automobile sector as a possible user, the STAMINA (sustainable and reliable robotics for part handling in manufacturing) project entails creating a fleet of robots that can carry out bin-picking and kitting activities in human-populated settings. The manufacturing line speed, which for example is one vehicle per minute for their use case at PSA, determines the robots’ operating pace [36].
In industries such as aerospace and shipbuilding, where huge components are manufactured in fixed production units, the VALERI (Validation of Advanced, Collaborative Robotics for Industrial Applications) project explores the necessity for MMs. An MM operating alongside human co-workers is recommended in such circumstances, as specialized stationary robotic devices are not cost-effective. The systematic design of such an MM is described by K. Zhou et al. [37], together with hardware and software concerns for load balancing, efficiency, and safety. The two responsibilities of applying sealant and visual inspection in aerospace production are also covered in their article, and a graphical user interface that may be customized is provided for evaluating and validating the system design. It shows that the robot they used for the sealing operation consists of a KUKA lightweight arm mounted on a KUKA omniRob mobile platform. VALERI is a special design of an MM developed for the project of the same name. VALERI consists of a KUKA omniRob mobile platform (with four omnidirectional wheels) and a 7 DoF lightweight robot (KUKA LBR4) on a vertical lift that provides two extra DoFs with a linear axis and a rotational capability, coming to a total of 12 DOFs. Three case applications—sealant, inspection of the applied sealant, and the inspection of braided carbon fiber parts—were selected for VALERI to operate in the aerospace production systems. This project covered the safety issues, sensor technologies specifically designed for safety and interaction with MMs [38], sensor fusion techniques [39], as well as workspace monitoring [40], human–robot collaboration aspects such as the hand-guidance of redundant MMs [41], and control strategies and effective redundancy solutions [42] to perform multiple operations at once to take advantage of the whole robot system’s capabilities [43].
The industrial application of MMs in real-world situations is summarized in Table 2.

4. Industry 4.0: Requirements for Developing Adaptable MMs

Industry 4.0 has revolutionized production and industrial approaches focused on the application of advanced technologies such as AI, machine learning, and the IoT, which lead to a new era of automation and digitization. Robotics is no exception to this, and its development process has changed based on the needs of Industry 4.0. Thus, robots are no longer just tools for performing dangerous or repetitive tasks, but they are now being used in new and innovative ways to improve efficiency and productivity. Safety navigation, part separation and inspection expertise, adherence to safety standards, dependability, sustainability, and the capacity to be use-case independent and adjustable with little programming are the major needs for MMs. MMs must also be manageable by a resource management system for the business, and shop floor employees must be able to utilize and modify them instantly to new handling jobs.
In the following, a few ways in which Industry 4.0 has changed robots are categorized.

4.1. Increased Connectivity and Interoperability

One of the principals of Industry 4.0 is to connect system components in a decentralized architecture. Thanks to developments in IoT and M2M communication technologies, the connectivity of MMs in industrial environments has been enhanced. MMs can now conduct more complicated tasks and work together more effectively with other devices because of this improved connection.
Interoperability frameworks create a stable communication bridge among diverse IIoT devices, each with unique software and protocols. These span organizations, different vendors, and a wide range of cloud and fog/edge service providers with diverse architectures [44]. Viewed from an industrial point of view, interoperability provides a global standard that ensures a distinct data format, API, and communication protocol for data management, whether on local edge devices or cloud servers [45]. Therefore, the smart industry needs a universally accepted applicable standard that can effectively manage IIoT applications in industrial infrastructure. In the context of IoT, several standards and protocols have emerged to facilitate this connectivity and interoperability. A set of established protocols such as HTTP (Hypertext Transfer Protocol), MQTT (Message Queuing Telemetry Transport), and CoAP (Constrained Application Protocol) serve as the backbone for data communication. Notably, the OPC UA (Open Platform Communications Unified Architecture) standard plays a pivotal role in fostering interoperability across various industrial control systems [46]. MMs may more easily be integrated into current production processes thanks to these protocols, which support interoperability between various equipment and systems.

4.2. Data Collection and Analysis

Collecting data and its analysis to achieve useful information in real-time is one of the other important aspects highly recommended by Industry 4.0. Thus, MMs are equipped with a wide range of sensors and data collection tools to collect and transfer data in various required metrics to managerial data storage. Advanced analytics and machine learning algorithms can be used to optimize the performance of MM itself and also to discover the surrounding environment. Gathering and analyzing large amounts of data in real-time, assisting MMs to adapt to changing and dynamic conditions, and optimize their performance are all performed to improve efficiency and productivity.
Utilizing AI methodologies to discover the patterns and trends helped to predict potential issues before occurring. Predictive maintenance is one of the advantages of this analysis. At high levels, complete autonomy is expected based on the wide range of data transfers from all of the system devices. In such systems, self-optimization and decision-making tools are strengthened.

4.3. Improved Flexibility

Flexibility refers to the ability of the system to adapt quickly to the changes in conditions, demands, and requirements. Industry 4.0 is characterized by the use of advanced technologies to create more flexible and adaptable manufacturing systems. Industry 4.0 expects MMs to operate flexibly and to flexibly integrate into the production system, so that any changes in the whole system could be perceived by the MM and it can react to it dynamically. To address this issue, research has been conducted.

4.3.1. Flexible Navigation, Path Planning, Localization, and Mapping

The distinction between preprogramming and real-time programming of the common planning algorithms depends on whether the environment map is known or unknown. Many studies based on structured environments have been conducted in the past, which suggests that CMIM might accomplish localization and navigation by preprogramming. Industry 4.0’s trend has evolved into a more adaptable mechanism, allowing the system to update the map concurrently and therefore improve efficiency. SLAM, or simultaneous localization and mapping, is a popular method for structuring the world at the same time. In tandem with SLAM’s real-time mapping, vision-based line tracking, an element of the “Guided” driving approach, offers an intermediate degree of autonomy. This technique allows mobile robots to follow predetermined paths using visual cues, especially in environments with set structures [47]. Campbell et al. [48] detailed several robot localization methods, including GPS (satellite-based), odometry (wheel rotation measurement), inertial navigation systems (INS, without initial reference but prone to errors), and map-based location.
Motion planning is difficult due to MMs’ distinctive features. Planning algorithms should take into account the behavior of the system to provide optimum plans quickly. Preparing separately for the mobile base and manipulator might result in inferior plans. It has not been thoroughly investigated how to coordinate movements between the mobile base and manipulator during planning, but applying machine learning approaches to determine the MM’s capabilities can assist. System dynamics are not heavily used in the planning algorithms used today; instead, they concentrate on designing geometric paths [49]. The innovative MM (MRP) was developed for flexible manufacturing systems that consider design, navigation, and docking aspects by [50] within the THOMAS project.
Path planning refers to the task of identifying a safe and efficient route from the present position of a vehicle to a target destination while avoiding any obstacles [51]. It is a vital problem, especially according to the control engineers [52]. The mobile robot path planning can be split into two categories of global and local path planning. Global path planning refers to the path generation in a known environment, while local path planning addresses an unknown environment with unexpected moving obstacles that can be observed by the robot’s sensors [53]. A. Montazeri et al. [52] suggested the following four important criteria for a path planning algorithm: optimization, completeness, accuracy, and execution time. G. Spyros [54] also classified the path planning methods into three categories of reactive control, representational world modeling, and their combination. F. Wayne et al. [55] formulated an optimization problem for MMs by separating the degrees of freedom (DOF) for mobility and for the manipulator. They developed a simulated annealing method for solving their model. M. Zhao et al. [56], on the other hand, applied a genetic algorithm. Path planning for a welding MM was considered in the research of W. S. Yoo et al. [57]. For the purpose of controlling an MM with two arms in path tracking and point-to-point motion, M. H. Korayem et al. [58] studied the use of a path planning algorithm in the feedback linearization approach. F. Burget et al. [59] offered a BI2RRT (bidirectional informed rapidly exploring random tree) planning methodology for creating asymptotically optimum pathways for MMs under task restrictions. A* algorithm has been used for the MM’s end effector path planning problem by G. Silva et al. [60]. For a class of hyper-redundant mobile soft manipulators that approach and handle objects while simultaneously avoiding obstacles based on potential field of velocity, S. Mbakop et al. [61] proposed a curvature control technique. Their method was built on the sliding mode concept, which converges in a finite amount of time.
A flexible stochastic approach was provided by M. Haddad et al. [62] for the point-to-point trajectory planning of nonholonomic wheeled MMs moving in a structured workspace while considering geometry, kinematics, and dynamic constraints. In order to assure base motion coordination along the predetermined path while generating the best motion trajectory for the end-effector, extra kinematic constraints and generalized coordinates were chosen in the approach of M. Habibnejad Korayem et al. [63]. The approach for creating a suboptimal trajectory for an MM under mechanical and control restrictions was presented in the study of G. Pajak and I. Pajak [64]. The path of the end-effector was described as a curve that may be parameterized by any scaling parameter. Control constraints, collision avoidance requirements, and limitations related to the existence of mechanical restrictions for a certain manipulator configuration were taken into consideration. The research of M. Giftthaler et al. [65] is concerned with the challenge of kinematic trajectory planning for MMs under holonomic operational-space tracking and non-holonomic constraints. They utilized a constrained SLQ for their work and established experiments for a 26 DoF mobile platform. I. Akli [66] introduced a manipulability percentage index (MPI) in their research to avoid singularity and to place the mobile robot in areas that guarantee regular access.

4.3.2. Flexible Scheduling

The use of a decision-making framework for integrated task scheduling and resource mobility planning in hybrid production systems is discussed in [67]. The modular robot operating system (ROS) framework, an open-source platform that enables the interfacing of multiple robot kinds and robot brands, serves as the foundation for the proposed design, making it open. As a result, it is simple to include new sorts of resources in the decision-making process. The framework supports the scheduling of operations for the assembly of various components by interpreting various assembly sequences using a unified digital world modeling methodology. Using the mobile robot behavior as an assessment measure, such as execution time and travel distance, the system is able to optimize the task plans that are created. The implemented system also offers a number of improvements, including the ability to reconfigure the production system by moving mobile resource platforms to various workstations according to needs, the ability to generate the most practical and efficient robot motion plans, and the ability to enable online access to real-time shopfloor status using the identified obstacles as input. The suggested approach offers a viable response to the problems in hybrid production systems and is suited to small- to medium-sized production systems. Future research should, however, concentrate on improving and fine-tuning the suggested system in order to make it usable for a wider-scale application. The system should be integrated with a factory’s legacy system in this approach. This will make the proposed decision-making framework more practical and relevant to a larger range of production systems by enabling seamless communication between the existing systems and it.
A novel scheduling issue involving a single MM performing feeding duties in a production cell was investigated in [13]. Mission planners must choose the best feeding sequence to reduce the overall traveling time of the MM while taking into consideration the unique characteristics of the robot and a variety of technological limitations in order to complete all tasks within the permitted limit of battery capacity. With the purpose of locating the best solution, a novel mix-integer linear programming model was created. To demonstrate the effectiveness of the suggested methodology, a specific real-world example of an impeller production line composed of four feeders was detailed. The outcome was very appropriately used in actual feeding operations, and it showed that all feeders had no trouble feeding components to the production line. By taking into account a high number of feeders and/or a lengthy planning horizon, the complexity of the issue classified as being NP-hard rises. As a result, a meta-heuristic approach was used to resolve the large-scale mobile robot scheduling problem. Additionally, a rescheduling system based on collected schedules and input from the shop floor should be created to address real-time disruptions.

4.3.3. Flexible Control and Coordination

Control systems include a number of components, such as control type, method, and controller, with the goal of improving the performance of the entire system in terms of tracking, disturbance rejection, resilience, and other factors. In general, there are three different ways to control CMIM: manually, semi-autonomously, and totally autonomously. Manual control, a secure but complex method of system control, has received a lot of attention in studies to this point. Both manual control and autonomous control are benefits of the semi-autonomous control technique. The greatest method to create a completely intelligent industry is through autonomous control, which enables the system to learn and respond autonomously. Table 3 shows the differences between the three control types presented by [5].
According to [68], it can be dangerous to utilize a completely autonomous MM for some industrial tasks, such as material handling and machine tending, since an incorrect representation of the working environment could lead to costly machinery being harmed. In contrast, using a completely teleoperated MM could take a lot of operator time. For this reason, they designed a semi-autonomous MM to perform machine tending duties under human supervision safely and effectively. Using the high-level task description, the robot may create motion plans and provide simulation results to a human for approval. The human operator has the option of giving the robot permission to carry out the automatically created plan or giving the planner more information to improve the plan. The person can choose to use teleoperation to securely complete the activity if the workspace model contains areas with a high level of uncertainty.
Although MMs can be partially pre-programmed and semi-autonomous, the variety of industrial environments may make it difficult for the system to be used in various situations. Additionally, the system’s intelligence at this point is insufficiently advanced to handle independently some issues or unclear data. The future of MMs would be fully autonomous systems, allowing the system to carry out entire tasks on its own. This may increase the maturity of systems in terms of the fourth industrial revolution, but the intelligent system has to be reliable and safe in addition to being able to spot mistakes in both organized and unstructured situations.
In order to create flexible manufacturing systems, research within the project RedRobCo suggested employing a force torque sensor close to the end effector to implement code-free programming and natural hand guiding. Using haptic feedback, the control structure manages kinematic redundant arm configurations and steers clear of them. The article contains laboratory experiments on the MM chimera to show the functionality of the controller design, along with a thorough study of potential singularities [69]. The interest in contactless MM control in delicate settings, such as clean rooms, is discussed within the project CapSize. The study in [70] described a capacitive sensing-based contactless control system that is resistant to mechanical impact, dirt, occlusions, and poor lighting. The sensor can be integrated into a workspace or mounted directly on a robot arm. To recognize gestures, a straightforward model-based method is utilized, making it simple to adapt to diverse geometric restrictions. The article showed the system’s capabilities by regulating an MM’s end-effector velocity in a 3D task space and giving the operator feedback. Additionally, in the CollRob project, Ref. [71] discussed how to program robot systems entirely without writing a single line of code, and it presents a practical method for programming delicate MMs with hand guiding that makes use of a force torque sensor that is mounted near the end effector. The results of laboratory tests were reported, and a detailed explanation of the suggested control method was provided.

4.4. Sensing and Perception

One of the first prerequisites of MMs to work in smart manufacturing systems is the ability to perceive its surroundings and accordingly make decisions. A wide variety of sensors and capturers were developed and are under development. The use of new technologies to improve the perception of MMs is addressed in much of the research.
The first stage for MMs to perceive their surroundings is to determine where they are in relation to their surrounding world. The difficulty in using the calibration technique on MMs is brought on by the variation in error between the mobile platform and stationary manipulators. The eye-in-hand calibration approach was used in the publication [72] using an MM to identify the actual coordinates of objects in the world’s coordinates.
The advancement of hardware (GPUs) and deep learning techniques over the past ten years has greatly benefited the challenging discipline of computer vision known as object detection. With algorithms such as face detectors functioning in many common applications, object detection is increasingly becoming the state-of-the-art AI technique in our modern world. Broadly speaking, object detection is a technique used for locating an object of interest in a photo and determining if it is present. G. Andrianakos et al. [73] addressed employing object detection to monitor assembly-line personnel using machine learning methods. When an assembly task is finished, the system should signal that information. There are two techniques used to determine this. As pieces need to be placed together in order to be assembled, the first one is comparing the locations of the assembly parts (PD). Detecting which object is grasped by a human is the other method (HPD). As the phrase says, it may be difficult to detect for micro parts, while it may be effective for bigger parts. In order to ensure that the proper assembly work is being carried out and to avoid mistakes, the article suggested employing a two-level check technique utilizing the PD and HPD methodologies. The research also emphasized how critical it is to establish a threshold for grabbing likelihood in order to prevent false alarms and the potential advantages of adopting error detection techniques in the industry to speed up production, cut waste, and enhance product quality.
The BACCHUS project (MoBile Robotic PlAtforms for ACtive InspeCtion and Harvesting in AgricUltural AreaS) investigated the use of dual-arm MMs in agricultural areas for active inspection and selective harvesting. Within this project, for effective grasping, I. Sarantopoulos et al. [74,75] proposed approaches to detect the desired object in a cluttered environment and to make enough space around it for easier picking by pushing the surrounding objects. Instant segmentation was investigated by I. Kleitsiotis et al. [76].

4.5. Human–Robot Interaction and Safety

Collaborative robots (cobots) are one significant way that Industry 4.0 has impacted HRI for MMs. Cobots are made to work alongside people, as opposed to traditional robots, which are made to operate without the assistance of humans. Because employees can easily direct the cobot’s motions or even physically engage with it when necessary, HRI has become more natural and intuitive. With the increased interaction between humans and robots, safety has become an even more critical concern. Industry 4.0 has also brought about advancements in safety technology for MMs. For example, some MMs are now equipped with sensors and cameras that can detect and avoid obstacles, as well as software that can predict potential collisions and stop the robot before it occurs.
Depending on the use of the robotic arm, certain criteria must be applied to MMs: (1) The robot arm rests when the mobile platform is moving: The robot arm may be viewed as a load, and the risk assessment for the whole danger must be determined using an analogy to normal mobile robot standards. The precise description of a secure place in which the robot will be carried is essential. Robotic standards must be taken into account for the interfaces on which the report completes its duty. (2) The robot arm performs assembly or processing operations while in motion: The required risk assessment must be conducted for the robot arm using all robotic standards [77]. Following that, the entire application, including the moving platform, robot arm, and surrounding area, must be assessed in accordance with EN ISO 10218 part 2, which addresses the integration of industrial robot applications [78].
A variety of AI-based tools are being developed by researchers so that robots can interact with and comprehend humans more effectively. N. Dimitropoulos et al. [21] categorized these tools into five main classes. (1) The “process perception module” is one of these tools, which makes use of computer vision to recognize the tasks being carried out by human workers. This module can assist the robot in comprehending what the user is doing and modifying its behavior as necessary. (2) The “workstation monitoring module” is another instrument that employs sensors to find impediments and human employees in the workspace. The robot’s motion planners then receive these data and utilize them to create a safe path and prevent collisions. (3) In order to provide the robot with a more thorough grasp of its surroundings, the “shop floor digital representation module” builds a digital version of the workspace. (4) The “task and action planner” aids in workload distribution between human and automated workers by determining the most effective course of action for each activity. (5) Finally, “autonomous learning strategies” allow the robot to modify its behavior in response to input from human workers, making sure it is satisfying their wants and preferences. By combining their efforts, these tools can make it easier for humans and robots to operate together safely and effectively, increasing productivity and lowering the risk of accidents.
Machine learning techniques were used in the ColRobot project to validate workplace monitoring and human identification for flexible safety [79].
Discovering the inefficiencies in hybrid human–robot collaborative workstations and improving them by AI-based solutions and smart mechatronics is one of the remarkable issues addressed by the SHERLOCK project [21]. In this project, several articles focused on HRC [80,81,82,83], such as the work on dual-arm co-manipulation architecture with enhanced communication [84], psychological and physiological acceptance of robots by humans [85], and the use of AI and wearable devices for collaborative assembly [86,87,88]. The project also included using human activity recognition sensors to improve the performance of collaborative MMs [89,90], using machine learning [73], and developing a task and action planning approach in human–robot collaborative cells using AI [91]. HRC for picking and moving common objects with humans was discussed in [92]. The study in [93] reviewed the use of a digital twin (DT) for HRC enhancement.
Safety and HRI are primary goals of the SAPHARI (Safe and Autonomous Physical Human-Aware Robot Interaction) project. A collision-free robot motion was planned, and the robot constantly responded to unexpected dangerous situations by adapting its planned motion, slowing down, or stopping. This was accomplished by continuously monitoring the robot’s environment using multiple depth sensors to gather information about obstacles and predict their motions. These techniques have been put into practice on an omniRob that can pick up, position, and deliver things to people in a shared workspace while enhancing the route and collision avoidance behavior for both the robot platform and manipulator [94]. The project concentrated on two industrial use cases, developed by the industrial partners AIRBUS (Figure 13-left) and KUKA (Figure 13-right), that clearly included intentional physical interaction between a human and a robot coworker. Under the direction of DLR, a professional service scenario for hospitals was designed, including close daily interactions between medical professionals and an aiding robot [95].
SOPHIA (Socio-physical Interaction Skills for Cooperative Human–Robot Systems in Agile Production) mainly aimed to address the problem of HRC. E. Lamon et al. [96] suggested an interface for MMs that enables them to communicate safely while adhering to human commands, utilizing haptic admittance and visual tracking modules. Safety was also addressed in [97], which presented MOCA-S, an MM with a capacitive tactile cover for secure in-person HRI.
By using mobile dual-arm robots that can sense their surroundings and collaborate with other production resources, including human operators, the THOMAS project sought to build a reconfigurable shop floor. The project’s goals included enabling movement on resources and goods, enabling perception of the job and surroundings, dynamic workload balancing, enabling quick programming and task execution, and ensuring secure HRC. The research areas within this project can be categorized into five main areas of focus. Firstly, they introduced an innovative MM presented in Figure 14 [50] and their application in assembly systems [98], and they enhanced the HRI and HRC by introducing wearable devices such as smartwatches [99] and by employing AR-based software [100,101]. The development of a digital world model [102] and DTs for designing and optimizing the design was investigated in [103,104].
OMNIVIL has a self-designed mobile platform with holonomic kinematics for agility in dynamic and unstructured environments. It has three main advancements, one of which is a redundant workspace monitoring system that employs thermal and RGB cameras, lidar sensors, and deep convolutional neural networks to identify and categorize barriers and human employees. The scalable, adaptable zone-based navigation paradigm uses case-based behavior to enhance HRI [106].

4.6. Virtualization

Industry 4.0 enables virtualization for MMs by utilizing various technologies, such as AR and virtual reality (VR). In order to remotely operate MMs and see the manipulator’s activities in real time, these technologies may be utilized to construct virtual representations of the environment and the items in it. DTs also enable systems to optimize product design, improve production processes, and reduce maintenance costs.
Industry 4.0 expects MMs to provide enhanced visualization capabilities, enabling operators to have a better understanding of the task at hand and allowing for the more precise manipulation of objects. This includes the ability to visualize the manipulator’s workspace, detect and track objects, and display augmented information on the environment. Additionally, MMs are expected to be integrated with other Industry 4.0 technologies, such as the Industrial Internet of Things (IIoT), to enable data collection and analysis to optimize performance and productivity. Overall, Industry 4.0 expects MMs to provide a more efficient and effective means of completing tasks, with the help of advanced visualization technologies.
In order to combine and update the virtual environment with real-time data from several modules, including damper, barriers, and person detection, Ref. [103] implemented a DT infrastructure for a flexible assembly line. In order to evaluate HRI through gesture recognition, a scenario was put up in the GAZEBO physics simulation engine and included CAD files, virtual controllers, laser scanner data, simulated stereo camera data, and actual Kinect data.
In order to enable the dynamic behavior of HRC reconfigurable systems, Ref. [104] presented a DT-based system to complete the loop between the design and operation phases. To create the system’s layout and work plans, the DT was combined with an AI decision-making logic. The physical assets and unified interfaces of the DT smart models are dynamically updated during runtime, creating a real-time planning scenario that is utilized when re-design is required. The suggested method aims to get past current restrictions on execution sequencing and the online reconfiguration of hybrid industrial systems. Their DT model provided the data required to optimize the system’s structure by allocating duties to MMs and human operators at various workstations. A group of perception modules are deployed during execution to keep an eye on the execution, the surroundings, and people’s behavior using a variety of sensors. These sensors record pictures in both 2D and 3D. These data are synthesized using the applicable DT data structures and are used to populate the real-time planning scenario as an activity map.
To benefit from the advantages of DT, it is necessary to address the issues with CPS and IoT as well as improvements in simulation environments with physics engines. To create more precise DTs, improved modeling of complicated jobs is also required. Better data flow between the DT’s many modules is also crucial. Key enablers in this respect include further advancements in semiconductor processing and communication technology [93].
In line with Industry 4.0, a contemporary production approach known as “cloud manufacturing” (CMfg) turns traditional manufacturing resources into services by utilizing cloud computing, the IoT, and virtualization, and then it makes them accessible through the Internet. When necessary, the employment of the various manufacturing services may be cost-optimized thanks to an intelligent, cloud-based platform that controls them. The idea of CMfg encompasses every stage of a product’s life cycle, from creation and design through manufacture and testing to maintenance while in use. Manufacturing as a service (MaaS) is the term for the cloud-based provision of production resources, such as hardware and software programs, as well as knowledge-based competences. The best services are chosen, capacities are established, and orders are planned and regulated using CAD data and databases of knowledge-based machines and materials. In this approach, a large number of clients may best access a wide range of providers (even those that are locally distributed), plan their own control and management layer (cloud layer), and manage production capacity, manufacturing processes, operations, and transactions.
The ability of MMs to interact and communicate has developed to the point that they could potentially be included in the overall production network. The aforementioned benefits enable MMs to operate efficiently and effectively in environments for advanced manufacturing, particularly CMfg, which naturally followed the introduction and success of cloud computing. In CMfg, manufacturing resources (MMs) and manufacturing capability (task flexibility and robotic mobility) are offered for requests in distinct sites within factories through centralized management. Moreover, these benefits of MMs help CMfg manufacturing lines, which are intended to be transitory in nature, produce small batches, while also allowing for longer production runs. As a result, the MM technology has enormous promise for the manufacturing sector as a whole and CMfg in particular [16].

4.7. Cyber Security

Cybersecurity is a critical aspect of Industry 4.0, and MMs must comply with industrial cybersecurity standards and regulations to ensure the security and integrity of production processes.
According to Industry 4.0, MMs should have a robust cybersecurity posture to resist against possible threats, including data leaks, hacker attacks, and other malicious activities. To transfer sensitive data to other equipment and systems on the shop floor, such as project specifications, production plans, and other confidential information, and in order to avoid unwanted access to the system, MMs must have secure communication channels.
The security requirements of MMs can be categorized into physical-based and network-based attacks [107]. Network interfaces and unsecured USB ports need to be avoided since they can be used to install malware or steal data. In order to request new jobs and connect with other machines and people, the robot has to be able to engage with external systems such as MES. To guard against unapproved access or data breaches, this communication should be secure. The robot should have safeguards in place to thwart attempts at manipulation by users and operators during secure contact. This covers both the robot’s secure initial commissioning and the secure reprogramming by shop floor staff.
An architecture for MM security was developed and integrated into the CHIMERA in [107]. With only designated channels connecting the subsystems, their security architecture for the CHIMERA robot was built on subsystem isolation. Additionally, they divided the software stack among many pieces of physical equipment, making it more difficult for attackers to breach other subsystems. They deployed AppArmor2 on the devices to provide precise permission for users and processes. An obligatory access control system called AppArmor enables the isolation of certain apps in terms of access to other resources (such as files and devices). They employed it to restrict the alteration of vital system components while yet granting system integrators limited access to the internals of the CHIMERA.

5. Discussion

Hence, a variety of technologies and tools have been established or are being developed in response to the needs and expectations of Industry 4.0 for it to be more efficient and simpler for MMs to be properly integrated in smart production systems. Figure 15 summarizes the tight semantic link between the elements discussed in the preceding section, and the following provides an example to illustrate it.
As was mentioned in the previous section, MMs’ collaboration has drawn particular interest due to their characteristics, and ensuring safety is one of the most crucial conditions of this collaboration. This safety refers to both the MM itself and all the components of the MM environment, such as humans or other supporting machinery and equipment. Many tools are utilized in the field of mobile robots or robotic arms that build an appropriate platform for their connection with people in order to establish safety for the collaboration of MM with humans. On the other hand, several flexible control mechanisms for MMs are recommended. Guidance systems with human hands are one of the control strategies that promote human safety. Nevertheless, in order to use such a technique, the MM must be capable of interpreting its environment in order to identify movements. To do this, MM has to be fitted with sufficient sensors that will allow it to collect and analyze data. The capacity to communicate and interact with its surroundings, including sensors, other machines, and central control systems, is the primary requirement for MMs of this generation.
NASA, the US Department of Defense, and other organizations frequently utilize the technology readiness level (TRL) methodology to determine technological maturity. The TRL is based on a scale of 1 to 9, with 9 being the most advanced technology. The usage of TRLs provides universal, consistent discussions of technological maturity across various technology kinds. The TRL begins at phase one, when the technology is in its concept, and ends at level nine, where it is more developed and has undergone testing and launch. With the use of this technique, management may quickly assess the technology’s maturity and make choices on its development and adoption. It is not a standalone tool; rather, it is one of a number of tools required to monitor the progression of research, development, and testing initiatives inside an organization. This tool is used by investors and international funding organizations to determine the project category that best meets their goals.
Phases one through three of TRL (TRL1: basic principles observed, TRL 2: technology concept formulated, TRL 3: experimental proof of concept) are regarded as the idea levels. The essential notion has been researched, the foundational research has been completed, and a proof of concept has been created. The technology has been developed and authorized in a laboratory or in another pertinent setting, and is now in TRL stages four and five at the prototype level (TRL 4: technology validated in a laboratory, TRL 5: technology validated in a relevant environment). The technology reaches the validation stage in TRL phases six and seven, with functional demonstrations taking place in a pertinent operating setting. The production level is involved in the final TRL phases eight and nine (Figure 16). The technology has been finished, authorized, and successfully tested in real-world settings.
Several studies have been carried out using competition, simulation, or laboratory tests. Real industrial environments, on the other hand, are more complicated and include more people and performance objectives. It is well recognized that it is quite challenging to simulate and utilize the actual industrial environment. Some cutting-edge MMs should be tested in real settings since lab and simulation settings differ greatly from actual circumstances. It would be more practical for the researchers to test the system, receive realistic input, and then progress their research based on it. Mobility, manipulation skills, and the integration of organizing and perception systems have all undergone major advancements. MMs are employed in applications such as logistics, industrial support, warehouse automation, and research. In order to solve issues with robustness, adaptation to dynamic situations, and human–robot interaction, businesses and research institutes are actively developing and enhancing technology. Future developments in machine learning, AI, and sensor technologies are anticipated to substantially improve the performance and capabilities of MMs.
While the focus of this review was specifically on MMs, advancements in the general field of mobile robots and robotic arms were not exhaustively considered. Given the interconnected nature of these fields, some innovations and findings from mobile robots could be applicable to MMs, and these might not have been comprehensively addressed in our review. However, potential applications of the findings for industries aiming to integrate or improve their automation processes use insights related to MM developments. This enables a more informed adoption of automation solutions compatible with Industry 4.0 principles. On the other hand, the identified gaps and emerging trends in MMs can guide researchers and developers in tailoring their future projects, ensuring that the next generation of MMs is better aligned with Industry 4.0 requirements.

6. Conclusions

The ability to respond quickly to customer demands and increase productivity without excessive costs is important for manufacturing in the context of flexibility, which is an essential feature of smart and competitive factories. Emerging technologies, such as cloud operations and industrial artificial intelligence, in the Industry 4.0 era can facilitate the development of flexible production systems. Robotic systems and mobile robots have shown a key role in improving the efficiency and autonomy of manufacturing systems. Combining robotic arm manipulation capabilities with mobile robot mobility allows for the creation of mobile manipulators, which may be employed for a variety of applications to increase the flexibility and effectiveness of the system as a whole. Even though MMs are used in various contexts, in this article, we reviewed their industrial applications. They are especially well suited for intralogistics tasks, such as part feeding inside assembly lines and transportation, as most of the articles investigated. Inspection, maintenance, or other shopfloor operations such as welding, screwing, painting, and spraying are some of the other applications, which are mentioned in the literature. However, these must be modified to meet the new innovative concepts and demands of the manufacturers, as knowledge is progressing.
The developing concept of Industry 4.0 entails combining several technologies, including AI, CPS, cloud computing, IoT, etc., to create smarter factories for the future. Because they provide the production process autonomy and enable it to self-configure, self-supervise, and self-heal, smart factories are essential to Industry 4.0. By enabling devices and services to interact autonomously to fulfill production objectives, CPS is another significant technology used to add autonomy to the production process. IoT is utilized as an integration layer to support autonomous processes for coordination, cooperation, and collaboration, whereas system integration enables cutting-edge technologies to cooperate to boost the manufacturing process’s autonomy. Big data analysis and contemporary human–computer interactions are also essential to Industry 4.0 since they address the variety of actors and data, respectively, and enable transparent human integration into the manufacturing process.
Assessing the design and implementation challenges in MM systems revealed that AI has the potential to advance this topic. In general, AI is a branch of cognitive science with active research programs in fields including robotics, machine learning, and image processing. Mobile robots have been enhanced both at the device and system levels by the techniques and knowledge that have been produced. AI techniques have advanced mobile robot navigation to autonomous driving and obstacle avoidance, which have been investigated a lot in the literature. However, there is a lack of information about MMs with the ability to function in cloud settings at the system level, which can offer on-demand computing services and assistance for rational decision-making throughout the scheduling process with MMs. Thus, MM technology has the potential to help industrial processes become more flexible and productive. The use of autonomous mobile robots (AMRs) for interior positioning and navigation has been made possible by recent advancements in AI and computer capacity. AMRs are more flexible and adaptable than conventional AGVs since they function autonomously and with decentralized decision-making; thus, their utilization as the base of MMs is more common, although there are different types of AMRs. As they are more compact and agile, they can integrate into workplaces more effectively. This increases manufacturing flexibility and assists them to fulfill the needs of the current production process. MMs with AMR platforms can operate alongside people as robot coworkers and as an assistive system.
In this regard, one of the main topics of discussion is safety and communication with humans. For example, wearables technologies such as AR enable people to interact with MMs in a more intelligent way, increasing collaboration and coordination among them to enhance production processes, decrease waiting times, and increase safety and cost efficiency, all of which are important characteristics of Industry 4.0. In general, virtualization and the use of digital models, simulations, and digital twins are essential for MMs. These new improvements enhance the need for MMs to be equipped with cybersecurity systems. The main and fundamental field of achieving all the mentioned features depends on the installation and use of suitable sensors and how to receive data from them, as well as communication with other components to access and exchange information and analyze data instantly.
This research not only deepens our understanding of MMs within the realm of Industry 4.0 but also sets the stage for their more profound societal impacts. As manufacturing processes are made more adaptable and efficient, a faster response to market demands can be facilitated by industries, potentially leading to a reduction in resource wastage and the fostering of more sustainable production cycles. Furthermore, with the enhanced human–robot interaction facilitated by MMs, a more inclusive work environment is anticipated, where human tasks are complemented by machines, paving the way for new job roles and opportunities.
As a relatively new and growing technology, MMs need more improvements to enter and establish a foothold in production systems on a large scale. However, the most important thing to achieve such a goal is extensive experimental tests at the level of real systems that are rarely mentioned. The basic challenges in the few who have mentioned this issue are safety and HRI, communication stability, robustness, communication, and battery. This is why this technology is still in TRL 6 or 7, except for special cases in terms of readiness level. Consequently, it is crucial to concentrate more on the battery and energy issues, as well as the stability and dependability of the technologies utilized on MMs in future research in order to really deploy them.

Author Contributions

Conceptualization, N.G. and K.B.; methodology, N.G., A.O. and K.B.; validation, K.B., A.O., V.G. and A.A.; formal analysis, N.G., K.B., A.O., V.G. and A.A.; writing—original draft preparation, N.G.; writing—review and editing, N.G., K.B., A.O., V.G. and A.A.; visualization, N.G.; supervision, K.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

AbbreviationDescription
AIArtificial Intelligence
AMRAutonomous Mobile Robots
ARAugmented Reality
CIMComputer Integrated Manufacturing
CMfgCloud Manufacturing
cobotsCollaborative robots
CPSCyber-Physical Systems
DOFDegrees of Freedom
DTDigital Twin
IIoTIndustrial Internet of Things
IoTInternet of Things
LH(s)Little Helper(s)
MM(s)Mobile Manipulator(s)
ROSRobot Operating System
TRLTechnology Readiness Level
UAV(s)Unmanned Aerial Vehicle(s)
VRVirtual Reality

References

  1. Jain, A.; Jain, P.K.; Chan, F.T.S.; Singh, S. A review on manufacturing flexibility. Eur. J. Oper. Res. 2013, 51, 5946–5970. [Google Scholar] [CrossRef]
  2. Gao, Z.; Wanyama, T.; Singh, I.; Gadhrri, A.; Schmidt, R. From industry 4.0 to robotics 4.0—A conceptual framework for collaborative and intelligent robotic systems. Procedia Manuf. 2020, 46, 591–599. [Google Scholar] [CrossRef]
  3. Bøgh, S.; Hvilshøj, M.; Kristiansen, M.; Madsen, O. Autonomous industrial mobile manipulation (AIMM): From research to industry. In Proceedings of the 42nd International Symposium on Robotics, Chicago, IL, USA, 21–24 March 2011; p. 9. [Google Scholar]
  4. Srinivasa, S.S.; Berenson, D.; Cakmak, M.; Collet, A.; Dogar, M.R.; Dragan, A.D.; Knepper, R.A.; Niemueller, T.; Strabala, K.; Weghe, M.V.; et al. Herb 2.0: Lessons learned from developing a mobile manipulator for the home. Proc. IEEE 2012, 100, 2410–2428. [Google Scholar] [CrossRef]
  5. Sereinig, M.; Werth, W.; Faller, L.M. A review of the challenges in mobile manipulation: Systems design and RoboCup challenges: Recent developments with a special focus on the RoboCup. Elektrotech. Informationstech. 2020, 137, 297–308. [Google Scholar] [CrossRef]
  6. Chebab, Z.-E.; Fauroux, J.-C.; Bouton, N.; Mezouar, Y.; Sabourin, L. Autonomous Collaborative Mobile Manipulators: State of the Art. In Proceedings of the TrC-IFToMM Symposium on Theory of Machines and Mechanisms, Izmir, Turkey, 14–17 June 2015. [Google Scholar]
  7. Yang, M.; Yang, E.; Zante, R.C.; Post, M.; Liu, X. Collaborative mobile industrial manipulator: A review of system architecture and applications. In Proceedings of the ICAC 2019—2019 25th IEEE International Conference on Automation and Computing, Lancaster, UK, 5–7 September 2019. [Google Scholar] [CrossRef]
  8. Sinnemann, J.; Boshoff, M.; Dyrska, R.; Leonow, S.; Mönnigmann, M.; Kuhlenkötter, B. Systematic literature review of applications and usage potentials for the combination of unmanned aerial vehicles and mobile robot manipulators in production systems. Prod. Eng. 2022, 16, 579–596. [Google Scholar] [CrossRef]
  9. Fernández-Caramés, T.M.; Blanco-Novoa, O.; Froiz-Míguez, I.; Fraga-Lamas, P. Towards an Autonomous Industry 4.0 Warehouse: A UAV and Blockchain-Based System for Inventory and Traceability Applications in Big Data-Driven Supply Chain Management. Sensors 2019, 19, 2394. [Google Scholar] [CrossRef] [PubMed]
  10. Bonci, A.; Cheng, P.D.C.; Indri, M.; Nabissi, G.; Sibona, F. Human-Robot Perception in Industrial Environments: A Survey. Sensors 2021, 21, 1571. [Google Scholar] [CrossRef]
  11. Yu, C.; Xu, X.; Lu, Y. Computer-Integrated Manufacturing, Cyber-Physical Systems and Cloud Manufacturing—Concepts and relationships. Manuf. Lett. 2015, 6, 5–9. [Google Scholar] [CrossRef]
  12. Staal, A.S.; Salvatierra, C.G.; Albertsen, D.D.; Mahendran, M.; Ravichandran, R.; Thomsen, R.F.; Hansen, E.B.; Bøgh, S. Towards a collaborative omnidirectional mobile robot in a smart cyber-physical environment. Procedia Manuf. 2020, 51, 193–200. [Google Scholar] [CrossRef]
  13. Dang, Q.; Nielsen, I.E.; Steger-Jensen, K. Scheduling a Single Mobile Robot for Feeding Tasks in a Manufacturing Cell. In Proceedings of the International Conference on Advances in Production Management Systems (APMS), Stavanger, Norway, 26–28 September 2011; pp. 1–8. [Google Scholar]
  14. Bogh, S.; Schou, C.; Rühr, T.; Kogan, Y.; Dömel, A.; Brucker, M.; Eberst, C.; Tornese, R.; Sprunk, C.; Tipaldi, G.D.; et al. Integration and assessment of multiple mobile manipulators in a real-world industrial production facility. In Proceedings of the Joint Conference of ISR 2014—45th International Symposium on Robotics and Robotik 2014—8th German Conference on Robotics, ISR/ROBOTIK, Munich, Germany, 2–3 June 2014; VDE: Berlin, Germany, 2014; pp. 305–312. [Google Scholar]
  15. Madsen, O.; Bøgh, S.; Schou, C.; Andersen, R.S.; Damgaard, J.S.; Pedersen, M.R.; Krüger, V. Integration of mobile manipulators in an industrial production. Ind. Robot. 2015, 42, 11–18. [Google Scholar] [CrossRef]
  16. Nielsen, I.; Dang, Q.V.; Bocewicz, G.; Banaszak, Z. A methodology for implementation of mobile robot in adaptive manufacturing environments. J. Intell. Manuf. 2017, 28, 1171–1188. [Google Scholar] [CrossRef]
  17. Ghodsian, N.; Benfriha, K.; Olabi, A.; Gopinath, V.; Arnou, A.; Charrier, Q. Toward designing an integration architecture for a mobile manipulator in production systems: Industry 4.0. Procedia CIRP 2022, 109, 443–448. [Google Scholar] [CrossRef]
  18. Benfriha, K.; El-Zant, C.; Charrier, Q.; Bouzid, A.H.; Wardle, P.; Belaidi, I.; Loubère, S.; Ghodsian, N.; Aoussat, A. Development of an advanced MES for the simulation and optimization of industry 4.0 process. Int. J. Simul. Multidiscip. Des. Optim. 2021, 12, 23. [Google Scholar] [CrossRef]
  19. Andersen, R.E.; Hansen, E.B.; Cerny, D.; Madsen, S.; Pulendralingam, B.; Bøgh, S.; Chrysostomou, D. Integration of a Skill-based Collaborative Mobile Robot in a Smart Cyber-physical Environment. Procedia Manuf. 2017, 11, 114–123. [Google Scholar] [CrossRef]
  20. Co-Manipulation of Large Parts by Dual-Arm Mobile Manipulator—Sherlock Project. Available online: https://www.sherlock-test.eu/?page_id=3613#top (accessed on 30 March 2023).
  21. Dimitropoulos, N.; Michalos, G.; Makris, S. An outlook on future hybrid assembly systems—The Sherlock approach. Procedia CIRP 2020, 97, 441–446. [Google Scholar] [CrossRef]
  22. Assembly of Solar Thermal Collectors—Sherlock Project. Available online: https://www.sherlock-test.eu/?page_id=3607 (accessed on 30 March 2023).
  23. Helms, E.; Sehraft, R.D.; Hägele, M. Rob@work: Robot assistant in industrial environments. In Proceedings of the IEEE International Workshop on Robot and Human Interactive Communication, Berlin, Germany, 27 September 2002; pp. 399–404. [Google Scholar] [CrossRef]
  24. De Luca, A. SAPHARI Project Presentation. 2012. Available online: http://www.saphari.eu/images/presentations/saphari_projectpresentation.pdf (accessed on 8 March 2023).
  25. COLROBOT Demonstration for the Automotive Industry. Available online: https://ec.europa.eu/research/participants/documents/downloadPublic?documentIds=080166e5c1dfbaaf&appId=PPGMS (accessed on 1 March 2023).
  26. ColRobot Prototype in Aerospace Industry. Available online: https://ec.europa.eu/research/participants/documents/downloadPublic?documentIds=080166e5c12064a7&appId=PPGMS (accessed on 1 March 2023).
  27. ColRobot. Demonstration of the ColRobot in Aerospace Industry. 2020. Available online: https://ec.europa.eu/research/participants/documents/downloadPublic?documentIds=080166e5c13f8bb7&appId=PPGMS (accessed on 1 March 2023).
  28. ColRobot. COLROBOT Demonstration in Automotive Industry. no. 688807. 2020. Available online: https://ec.europa.eu/research/participants/documents/downloadPublic?documentIds=080166e5c128a917&appId=PPGMS (accessed on 1 March 2023).
  29. Innovative Robotic Applications for Highly Reconfigurable Production Lines—VERSATILE|VERSATILE Project|Fact Sheet|H2020|CORDIS|European Commission. Available online: https://cordis.europa.eu/project/id/731330 (accessed on 8 March 2023).
  30. Cherubini, A.; Passama, R.; Navarro, B.; Sorour, M.; Khelloufi, A.; Mazhar, O.; Tarbouriech, S.; Zhu, J.; Tempier, O.; Crosnier, A.; et al. A collaborative robot for the factory of the future: BAZAR. Int. J. Adv. Manuf. Technol. 2019, 105, 3643–3659. [Google Scholar] [CrossRef]
  31. ISABEL. Available online: http://www.projekt-isabel.de/?content=aktuelles (accessed on 29 March 2023).
  32. Mobile Robots for Inspection and Maintenance Activities in Extensive Industrial Plants|MAINBOT Project|Fact Sheet|FP7|CORDIS|European Commission. Available online: https://cordis.europa.eu/project/id/285245 (accessed on 29 March 2023).
  33. Maurtua, I.; Susperregi, L.; Fernández, A.; Tubío, C.; Perez, C.; Rodríguez, J.; Felsch, T.; Ghrissi, M. MAINBOT—Mobile robots for inspection and maintenance in extensive industrial plants. Energy Procedia 2014, 49, 1810–1819. [Google Scholar] [CrossRef]
  34. Maurtua, I. Mobile Robots for Inspection and Maintenance Activities in Extensive Industrial Plants—Report. 2014. Available online: https://cordis.europa.eu/project/id/285245/reporting (accessed on 29 March 2023).
  35. Engemann, H.; Cönen, P.; Dawar, H.; Du, S.; Kallweit, S. A robot-assisted large-scale inspection of wind turbine blades in manufacturing using an autonomous mobile manipulator. Appl. Sci. 2021, 11, 9271. [Google Scholar] [CrossRef]
  36. Caverot, A.-G.B.G.; Ezéquel, M.; Krüger, V. FP7 STAMINA—Sustainable and Reliable Robotics for Part Handling in Manufacturing Automation. 2014. Available online: https://cordis.europa.eu/project/id/610917 (accessed on 29 March 2023).
  37. Zhou, K.; Ebenhofer, G.; Eitzinger, C.; Zimmermann, U.; Walter, C.; Saenz, J.; Castaño, L.P.; Hernández, M.A.F.; Oriol, J.N. Mobile manipulator is coming to aerospace manufacturing industry. In Proceedings of the 2014 IEEE International Symposium on Robotic and Sensors Environments (ROSE) Proceedings, Timisoara, Romania, 16–18 October 2014; pp. 94–99. [Google Scholar] [CrossRef]
  38. Saenz, J.; Penzlin, F.; Vogel, C.; Fritzsche, M. VALERI—A collaborative mobile manipulator for aerospace production. In Advances in Cooperative Robotics, Proceedings of the 19th International Conference on Climbing and Walking Robots and the Support, Technologies for Mobile Machines, CLAWAR 2016, London, UK, 12–14 September 2016; World Scientific: Singapore, 2016; pp. 186–195. [Google Scholar] [CrossRef]
  39. Ubezio, B.; Sharma, S.; van der Meer, G.; Taragna, M. Kalman filter based sensor fusion for a mobile manipulator. In Proceedings of the ASME Design Engineering Technical Conference, Anaheim, CA, USA, 18–21 August 2019. [Google Scholar] [CrossRef]
  40. Saenz, J.; Vogel, C.; Penzlin, F.; Elkmann, N. Safeguarding Collaborative Mobile Manipulators—Evaluation of the VALERI Workspace Monitoring System. Procedia Manuf. 2017, 11, 47–54. [Google Scholar] [CrossRef]
  41. Ritter, C.; Sharma, S. Hand-Guidance of a Mobile Manipulator Using Online Effective Mass Optimization. In Proceedings of the 2019 19th International Conference on Advanced Robotics (ICAR), Belo Horizonte, Brazil, 2–6 December 2019; pp. 192–197. [Google Scholar] [CrossRef]
  42. Sharma, S.; Scheurer, C. Generalized unified closed form inverse kinematics for mobile manipulators with reusable redundancy parameters. In Proceedings of the ASME Design Engineering Technical Conference, Cleveland, OH, USA, 6–9 August 2017. [Google Scholar] [CrossRef]
  43. Scheurer, C.; Fiore, M.D.; Sharma, S.; Natale, C. Industrial implementation of a multi-task redundancy resolution at velocity level for highly redundant mobile manipulators. In Proceedings of the 47th International Symposium on Robotics, ISR 2016, Munich, Germany, 21–22 June 2016; pp. 109–117. [Google Scholar]
  44. Sinche, S.; Raposo, D.; Armando, N.; Rodrigues, A.; Boavida, F.; Pereira, V.; Silva, J.S. A survey of IoT management protocols and frameworks. IEEE Commun. Surv. Tutor. 2019, 22, 1168–1190. [Google Scholar] [CrossRef]
  45. Hazra, A.; Adhikari, M.; Amgoth, T.; Srirama, S.N. A comprehensive survey on interoperability for IIoT: Taxonomy, standards, and future directions. ACM Comput. Surv. (CSUR) 2021, 55, 9. [Google Scholar] [CrossRef]
  46. Pivoto, D.G.S.; de Almeida, L.F.F.; da Rosa Righi, R.; Rodrigues, J.J.P.C.; Lugli, A.B.; Alberti, A.M. Cyber-physical systems architectures for industrial internet of things applications in Industry 4.0: A literature review. J. Manuf. Syst. 2021, 58, 176–192. [Google Scholar] [CrossRef]
  47. Armesto, L.; Tornero, J. Automation of industrial vehicles: A vision-based line tracking application. In Proceedings of the 2009 IEEE Conference on Emerging Technologies & Factory Automation, Palma de Mallorca, Spain, 22–25 September 2009; Available online: https://ieeexplore.ieee.org/abstract/document/5347051/ (accessed on 8 September 2023).
  48. Campbell, S.; O’Mahony, N.; Carvalho, A.; Krpalkova, L.; Riordan, D.; Walsh, J. Where am I? Localization techniques for Mobile Robots A Review. In Proceedings of the 2020 6th International Conference on Mechatronics and Robotics Engineering, ICMRE 2020, Barcelona, Spain, 12–15 February 2020; pp. 43–47. [Google Scholar] [CrossRef]
  49. Sandakalum, T.; Ang, M.H. Motion Planning for Mobile Manipulators—A Systematic Review. Machines 2022, 10, 97. [Google Scholar] [CrossRef]
  50. Outón, J.L.; Villaverde, I.; Herrero, H.; Esnaola, U.; Sierra, B. Innovative mobile manipulator solution for modern flexible manufacturing processes. Sensors 2019, 19, 5414. [Google Scholar] [CrossRef] [PubMed]
  51. Klančar, G.; Zdešar, A.; Blažič, S.; Škrjanc, I. Autonomous Guided Vehicles. In Wheeled Mobile Robotics; Elsevier: Amsterdam, The Netherlands, 2017; pp. 387–418. [Google Scholar] [CrossRef]
  52. Montazeri, A.; Can, A.; Imran, I.H. Unmanned aerial systems: Autonomy, cognition, and control. In Unmanned Aerial Systems: Theoretical Foundation and Applications: A Volume in Advances in Nonlinear Dynamics and Chaos (ANDC); Academic Press: Cambridge, MA, USA, 2021; pp. 47–80. [Google Scholar] [CrossRef]
  53. Liu, H. Introduction. In Robot Systems for Rail Transit Applications; Elsevier: Amsterdam, The Netherlands, 2020; pp. 1–36. [Google Scholar] [CrossRef]
  54. Tzafestas, S.G. Mobile Robot Path, Motion, and Task Planning. In Introduction to Mobile Robot Control; Elsevier: Amsterdam, The Netherlands, 2014; pp. 429–478. [Google Scholar] [CrossRef]
  55. Carriker, W.F.; Khosla, P.K.; Krogh, B.H. Path Planning for Mobile Manipulators for multiple task execution. IEEE Trans. Robot. Autom. 1991, 7, 813–817. [Google Scholar] [CrossRef]
  56. Zhao, M.; Ansari, N.; Hou, E.S.H. Mobile manipulator path planning by a genetic algorithm. J. Robot. Syst. 1994, 11, 143–153. [Google Scholar] [CrossRef]
  57. Yoo, W.S.; Kim, J.D.; Na, S.J. A study on a mobile platform-manipulator welding system for horizontal fillet joints. Mechatronics 2001, 11, 853–868. [Google Scholar] [CrossRef]
  58. Korayem, M.H.; Esfeden, R.A.; Nekoo, S.R. Path planning algorithm in wheeled mobile manipulators based on motion of arms. J. Mech. Sci. Technol. 2015, 29, 1753–1763. [Google Scholar] [CrossRef]
  59. Burget, F.; Bennewitz, M.; Burgard, W. BI2RRT*: An efficient sampling-based path planning framework for task-constrained Mobile manipulation. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Daejeon, Republic of Korea, 9–14 October 2016; pp. 3714–3721. [Google Scholar] [CrossRef]
  60. Silva, G.; Costa, P.; Rocha, L.; Lima, J. Path planning optimization for a mobile manipulator. In AIP Conference Proceedings; AIP Publishing: Melville, NY, USA, 2019; Volume 2116, pp. 1–5. [Google Scholar] [CrossRef]
  61. Wang, H.J.; Liu, X.P.; Wang, G.; Han, S. Optimization of Mobile Manipulator Sorting Path Based on Improved Genetic Algorithm. Beijing Youdian Daxue Xuebao/J. Beijing Univ. Posts Telecommun. 2020, 43, 34–40. [Google Scholar] [CrossRef]
  62. Haddad, M.; Hanchi, S.; Lehtihet, H.E. Point-to-point trajectory planning of wheeled mobile manipulators with stability constraint. Extension of the random-profile approach. Eur. J. Mech. A/Solids 2009, 28, 477–493. [Google Scholar] [CrossRef]
  63. Korayem, M.H.; Rahimi, H.N.; Nikoobin, A. Mathematical modeling and trajectory planning of mobile manipulators with flexible links and joints. Appl. Math. Model. 2012, 36, 3229–3244. [Google Scholar] [CrossRef]
  64. Pajak, G.; Pajak, I. Sub-optimal trajectory planning for mobile manipulators. Robotica 2015, 33, 1181–1200. [Google Scholar] [CrossRef]
  65. Giftthaler, M.; Farshidian, F.; Sandy, T.; Stadelmann, L.; Buchli, J. Efficient kinematic planning for mobile manipulators with non-holonomic constraints using optimal control. In Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore, 29 May–3 June 2017; pp. 3411–3417. [Google Scholar] [CrossRef]
  66. Akli, I. Trajectory planning for mobile manipulators including Manipulability Percentage Index. Int. J. Intell. Robot. Appl. 2021, 5, 543–557. [Google Scholar] [CrossRef]
  67. Kousi, N.; Dimosthenopoulos, D.; Matthaiakis, A.S.; Michalos, G.; Makris, S. AI based combined scheduling and motion planning in flexible robotic assembly lines. Procedia CIRP 2020, 86, 74–79. [Google Scholar] [CrossRef]
  68. Al-Hussaini, S.; Thakar, S.; Kim, H.; Rajendran, P.; Shah, B.C.; Marvel, J.A.; Gupta, S.K. Human-Supervised Semi-Autonomous Mobile Manipulators for Safely and Efficiently Executing Machine Tending Tasks. arXiv 2020, arXiv:2010.04899. [Google Scholar]
  69. Weyrer, M.; Brandstötter, M.; Husty, M. Singularity avoidance control of a non-holonomic mobile manipulator for intuitive hand guidance. Robotics 2019, 8, 14. [Google Scholar] [CrossRef]
  70. Stetco, C.; Muhlbacher-Karrer, S.; Lucchi, M.; Weyrer, M.; Faller, L.-M.; Zangl, H. Gesture-based Contactless Control of Mobile Manipulators using Capacitive Sensing. In Proceedings of the 2020 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Dubrovnik, Croatia, 25–28 May 2020; pp. 1–6. [Google Scholar] [CrossRef]
  71. Weyrer, M.; Brandstötter, M.; Mirkovic, D. Intuitive hand guidance of a force-controlled sensitive mobile manipulator. In Mechanisms and Machine Science; Springer International Publishing: New York, NY, USA, 2019; pp. 361–368. [Google Scholar] [CrossRef]
  72. Zhou, Z.; Li, L.; Wang, R.; Zhang, X. Experimental Eye-in-hand Calibration for Industrial Mobile Manipulators. In Proceedings of the 2020 IEEE International Conference on Mechatronics and Automation, ICMA 2020, Beijing, China, 13–16 October 2020; pp. 582–587. [Google Scholar] [CrossRef]
  73. Andrianakos, G.; Dimitropoulos, N.; Michalos, G.; Makris, S. An approach for monitoring the execution of human based assembly operations using machine learning. Procedia CIRP 2020, 86, 198–203. [Google Scholar] [CrossRef]
  74. Sarantopoulos, I.; Kiatos, M.; Doulgeri, Z.; Malassiotis, S. Split Deep Q-Learning for Robust Object Singulation. In Proceedings of the IEEE International Conference on Robotics and Automation, Paris, France, 31 May–31 August 2020; pp. 6225–6231. [Google Scholar] [CrossRef]
  75. Sarantopoulos, I.; Kiatos, M.; Doulgeri, Z.; Malassiotis, S. Total singulation with modular reinforcement learning. IEEE Robot. Autom. Lett. 2021, 6, 4118–4125. [Google Scholar] [CrossRef]
  76. Kleitsiotis, I.; Mariolis, I.; Giakoumis, D.; Likothanassis, S.; Tzovaras, D. Anisotropic Diffusion-Based Enhancement of Scene Segmentation with Instance Labels. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Springer International Publishing: New York, NY, USA, 2021; pp. 383–391. [Google Scholar] [CrossRef]
  77. Markis, A.; Papa, M.; Kaselautzke, D.; Rathmair, M.; Sattinger, V.; Brandstötter, M. Safety of Mobile Robot Systems in Industrial Applications. In Proceedings of the ARW OAGM Workshop 2019, Steyr, AT, USA, 9–10 May 2019; pp. 26–31. [Google Scholar]
  78. ISO 10218-2:2011; Robots and Robotic Devices—Safety Requirements for Industrial Robots—Part 2: Robot Systems and Integration. ISO: Geneve, Switzerland, 2011. Available online: https://www.iso.org/obp/ui/#iso:std:iso:10218:-2:ed-1:v1:en (accessed on 30 March 2023).
  79. Bexten, S.; Scholle, J.; Saenz, J.; Walter, C.; Elkmann, N. Validation of workspace monitoring and human detection for soft safety with collaborative mobile manipulator using machine learning techniques in the ColRobot project. In Proceedings of the ISR 2018, 50th International Symposium on Robotics, Munich, Germany, 20–21 June 2018; pp. 191–198. Available online: https://ieeexplore.ieee.org/abstract/document/8470596 (accessed on 28 February 2023).
  80. Michalos, G.; Karagiannis, P.; Dimitropoulos, N.; Andronas, D.; Makris, S. Human Robot Collaboration in Industrial Environments. In Intelligent Systems, Control and Automation: Science and Engineering; Springer Science and Business Media B.V.: Berlin, Germany, 2022; pp. 17–39. [Google Scholar] [CrossRef]
  81. Haninger, K. Robot Inference of Human States: Performance and Transparency in Physical Collaboration. In Intelligent Systems, Control and Automation: Science and Engineering; Springer Science and Business Media B.V.: Berlin, Germany, 2022; pp. 55–69. [Google Scholar] [CrossRef]
  82. Haninger, K.; Hegeler, C.; Peternel, L. Model Predictive Control with Gaussian Processes for Flexible Multi-Modal Physical Human Robot Interaction. In Proceedings of the IEEE International Conference on Robotics and Automation 2022, Philadelphia, PA, USA, 23–27 May 2022; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2022; pp. 6948–6955. [Google Scholar] [CrossRef]
  83. Eimontaite, I. Human–Robot Collaboration Using Visual Cues for Communication. In Intelligent Systems, Control and Automation: Science and Engineering; Springer Science and Business Media B.V.: Berlin, Germany, 2022; pp. 71–85. [Google Scholar] [CrossRef]
  84. Ibarguren, A.; Eimontaite, I.; Outón, J.L.; Fletcher, S. Dual arm co-manipulation architecture with enhanced human–robot communication for large part manipulation. Sensors 2020, 20, 6151. [Google Scholar] [CrossRef]
  85. Eimontaite, I.; Jaksic, C.; Fletcher, S.; Johnson, T.; Oostveen, A.-M. Will Operators Work in Close Proximity to Industrial Robots? A Study of Acceptance Using Psychological and Physiological Responses. SSRN Electron. J. 2020. [Google Scholar] [CrossRef]
  86. Dimitropoulos, N.; Togias, T.; Zacharaki, N.; Michalos, G.; Makris, S. Seamless human–robot collaborative assembly using artificial intelligence and wearable devices. Appl. Sci. 2021, 11, 5699. [Google Scholar] [CrossRef]
  87. Dimitropoulos, N.; Togias, T.; Michalos, G.; Makris, S. Operator support in human-robot collaborative environments using AI enhanced wearable devices. Procedia CIRP 2020, 97, 464–469. [Google Scholar] [CrossRef]
  88. Ramasubramanian, A.K.; Mathew, R.; Preet, I.; Papakostas, N. Review and application of Edge AI solutions for mobile collaborative robotic platforms. Procedia CIRP 2022, 107, 1083–1088. [Google Scholar] [CrossRef]
  89. Ramasubramanian, A.K.; Aiman, S.M.; Papakostas, N. On using human activity recognition sensors to improve the performance of collaborative mobile manipulators: Review and outlook. Procedia CIRP 2020, 97, 211–216. [Google Scholar] [CrossRef]
  90. Haninger, K.; Radke, M.; Vick, A.; Kruger, J. Towards High-Payload Admittance Control for Manual Guidance With Environmental Contact. IEEE Robot. Autom. Lett. 2022, 7, 4275–4282. [Google Scholar] [CrossRef]
  91. Evangelou, G.; Dimitropoulos, N.; Michalos, G.; Makris, S. An approach for task and action planning in Human-Robot Collaborative cells using AI. Procedia CIRP 2020, 97, 476–481. [Google Scholar] [CrossRef]
  92. Ramasubramanian, A.K.; Papakostas, N. Operator—Mobile robot collaboration for synchronized part movement. Procedia CIRP 2020, 97, 217–223. [Google Scholar] [CrossRef]
  93. Ramasubramanian, A.K.; Mathew, R.; Kelly, M.; Hargaden, V.; Papakostas, N. Digital Twin for Human-Robot Collaboration in Manufacturing: Review and Outlook. Appl. Sci. 2022, 12, 4811. [Google Scholar] [CrossRef]
  94. Frese, C.; Zube, A.; Frey, C. Workspace monitoring and planning for safe mobile manipulation. arXiv 2020, arXiv:2006.01546. [Google Scholar]
  95. SAPHARI—Safe and Autonomous Physical Human-Aware Robot Interaction—Results. Available online: http://www.saphari.eu/index.php?option=com_content&view=article&id=189&Itemid=125 (accessed on 29 March 2023).
  96. Lamon, E.; Fusaro, F.; Balatti, P.; Kim, W.; Ajoudani, A. A visuo-haptic guidance interface for mobile collaborative robotic assistant (MOCA). In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Las Vegas, NV, USA, 24 October 2020–24 January 2021; pp. 11253–11260. [Google Scholar] [CrossRef]
  97. Leonori, M.; Gandarias, J.M.; Ajoudani, A. MOCA-S: A Sensitive Mobile Collaborative Robotic Assistant Exploiting Low-Cost Capacitive Tactile Cover and Whole-Body Control. IEEE Robot. Autom. Lett. 2022, 7, 7920–7927. [Google Scholar] [CrossRef]
  98. Kousi, N.; Michalos, G.; Aivaliotis, S.; Makris, S. An outlook on future assembly systems introducing robotic mobile dual arm workers. Procedia CIRP 2018, 72, 33–38. [Google Scholar] [CrossRef]
  99. Gkournelos, C.; Karagiannis, P.; Kousi, N.; Michalos, G.; Koukas, S.; Makris, S. Application of wearable devices for supporting operators in human-robot cooperative assembly tasks. Procedia CIRP 2018, 76, 177–182. [Google Scholar] [CrossRef]
  100. Kousi, N.; Stoubos, C.; Gkournelos, C.; Michalos, G.; Makris, S. Enabling human robot interaction in flexible robotic assembly lines: An augmented reality based software suite. Procedia CIRP 2019, 81, 1429–1434. [Google Scholar] [CrossRef]
  101. Lotsaris, K.; Gkournelos, C.; Fousekis, N.; Kousi, N.; Makris, S. AR based robot programming using teaching by demonstration techniques. Procedia CIRP 2020, 97, 459–463. [Google Scholar] [CrossRef]
  102. Kousi, N.; Gkournelos, C.; Aivaliotis, S.; Michalos, G.; Makris, S. Dynamic, Model-based Reconfiguration for Flexible Robotic Assembly Lines. In Proceedings of the Fifteenth International Conference on Autonomic and Autonomous Systems (ICAS 2019), Athens, Greece, 2–6 June 2019; pp. 15–20, ISBN 978-1-61208-712-2. [Google Scholar]
  103. Kousi, N.; Gkournelos, C.; Aivaliotis, S.; Giannoulis, C.; Michalos, G.; Makris, S. Digital twin for adaptation of robots’ behavior in flexible robotic assembly lines. Procedia Manuf. 2019, 28, 121–126. [Google Scholar] [CrossRef]
  104. Kousi, N.; Gkournelos, C.; Aivaliotis, S.; Lotsaris, K.; Bavelos, A.C.; Baris, P.; Michalos, G.; Makris, S. Digital twin for designing and reconfiguring human–robot collaborative assembly lines. Appl. Sci. 2021, 11, 4620. [Google Scholar] [CrossRef]
  105. Outón, J.L.; Merino, I.; Villaverde, I.; Ibarguren, A.; Herrero, H.; Daelman, P.; Sierra, B. A real application of an autonomous industrial mobile manipulator within industrial context. Electronics 2021, 10, 1276. [Google Scholar] [CrossRef]
  106. Engemann, H.; Du, S.; Kallweit, S.; Cönen, P.; Dawar, H. Omnivil—An autonomous mobile manipulator for flexible production. Sensors 2020, 20, 7249. [Google Scholar] [CrossRef]
  107. Dieber, B.; Breiling, B. Security Considerations in Modular Mobile Manipulation. In Proceedings of the 3rd IEEE International Conference on Robotic Computing, IRC 2019, Naples, Italy, 25–27 February 2019; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2019; pp. 70–77. [Google Scholar] [CrossRef]
Figure 1. Timeline of existing MMs from 1984 to 2010 [3].
Figure 1. Timeline of existing MMs from 1984 to 2010 [3].
Sensors 23 08026 g001
Figure 2. A timeline of different projects that contributed to MM development.
Figure 2. A timeline of different projects that contributed to MM development.
Sensors 23 08026 g002
Figure 3. A representation of how to achieve proper infrastructure for MM integration inspired by [3].
Figure 3. A representation of how to achieve proper infrastructure for MM integration inspired by [3].
Sensors 23 08026 g003
Figure 4. Suitability of utilizing MMs for each class of industrial operations.
Figure 4. Suitability of utilizing MMs for each class of industrial operations.
Sensors 23 08026 g004
Figure 5. Little helpers from the first generation to the seventh one (from left to right) adopted from [12].
Figure 5. Little helpers from the first generation to the seventh one (from left to right) adopted from [12].
Sensors 23 08026 g005
Figure 6. Little Helper 3 from Aalborg University (left); omniRob from KUKA (right).
Figure 6. Little Helper 3 from Aalborg University (left); omniRob from KUKA (right).
Sensors 23 08026 g006
Figure 7. The controlling system proposed by [14] for integrating MMs into production systems.
Figure 7. The controlling system proposed by [14] for integrating MMs into production systems.
Sensors 23 08026 g007
Figure 8. MOMA from OMRON adopted from [17].
Figure 8. MOMA from OMRON adopted from [17].
Sensors 23 08026 g008
Figure 9. Using MM to carry large parts with human cooperation adopted from [21].
Figure 9. Using MM to carry large parts with human cooperation adopted from [21].
Sensors 23 08026 g009
Figure 10. SAPHARI project: industrial applications required at KUKA (left) and aircraft assembly requirement of Airbus (right) adopted from [24].
Figure 10. SAPHARI project: industrial applications required at KUKA (left) and aircraft assembly requirement of Airbus (right) adopted from [24].
Sensors 23 08026 g010
Figure 11. ColRobot prototype for automotive industries adopted from [25].
Figure 11. ColRobot prototype for automotive industries adopted from [25].
Sensors 23 08026 g011
Figure 12. Mirror reflectivity measurement at the VALLE energy plant by MAINBOT adopted from [34].
Figure 12. Mirror reflectivity measurement at the VALLE energy plant by MAINBOT adopted from [34].
Sensors 23 08026 g012
Figure 13. SAPHARI demonstrations: (left) Airbus use case, (right) Kuka use case adopted from [95].
Figure 13. SAPHARI demonstrations: (left) Airbus use case, (right) Kuka use case adopted from [95].
Sensors 23 08026 g013
Figure 14. MM designed in the THOMAS project adopted from [105].
Figure 14. MM designed in the THOMAS project adopted from [105].
Sensors 23 08026 g014
Figure 15. Semantic link between the key principles to consider for their integration into Industry 4.0-based manufacturing systems.
Figure 15. Semantic link between the key principles to consider for their integration into Industry 4.0-based manufacturing systems.
Sensors 23 08026 g015
Figure 16. Technology readiness levels.
Figure 16. Technology readiness levels.
Sensors 23 08026 g016
Table 1. Classification of MM industrial applications.
Table 1. Classification of MM industrial applications.
Mobile Manipulators Applications
Assistive TasksLogistics TasksService Tasks
Machine tendingTransportationMaintenance, Repair and overhaul (MRO)
Assembly/Pre-assemblyPart feeding (multi)Cleaning
InspectionPart feeding (Single)
Process execution
Table 2. A summary of industrial applications of MMs.
Table 2. A summary of industrial applications of MMs.
CitationApplicationIndustryProjectMMYear
[3]Multiple-part feedingGrundfos Little Helper2011
[14]Assembly, machine tending, quality controlGrundfosTAPASLH3 and omniRob2014
[15]Assembly, quality control, logisticsGrundfosTAPASTwo LHs2015
[16]Multiple-part feedingCR 1-2-3 impeller line LH2017
[19]Part feedingFesto cyber-physical factory LH62017
[21]Placement of common object with humanAerospaceSHERLOCK 2014
[22]High payload assemblyCALPAKSHERLOCK 2023
[23]Assembly of hydraulic pumps and the assistance of manual gas metal arc weldingHydraulic pumpsMORPHArob@work2002
[24]Logistics and assemblyAutomotive, aerospaceSAPHARIomniRob2012
[27]KittingTAS-FColRobotKMR IIWA2020
[28]Fastener tightening and automatic refillAutomotive industriesColRobotColRobot prototype2020
[30]Smart logistics, assembly of vehicle dashboards, assembly of aircraft wing parts, and handling and packaging of shaver handles PSA, AIRBUS, BICVERSATILEBAZAR2019
[31]Fetch-and-carryClean roomISABELISABEL2023
[35]Quality controlProduction of wind turbinesFiberRadarOMNIVIL2021
[36]Bin-picking, kittingPSASTAMINA 2014
[37]Applying sealant and visual inspectionAerospace, shipbuildingVALERIVALERI2014
[32,33]Industrial maintenanceVALLLE energy plantMAINBOTMAINBOT2014, 2023
Table 3. A comparison of different MM control strategies adopted from [5].
Table 3. A comparison of different MM control strategies adopted from [5].
System ControlDescriptionBenefitsDrawbacks
ManualFully controlled by humansTimely error handlingCan be complicated
Semi-automaticPartial human controlMore robustMay be inefficient
AutomaticNo human interventionEfficientDecision costs can be high
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ghodsian, N.; Benfriha, K.; Olabi, A.; Gopinath, V.; Arnou, A. Mobile Manipulators in Industry 4.0: A Review of Developments for Industrial Applications. Sensors 2023, 23, 8026. https://doi.org/10.3390/s23198026

AMA Style

Ghodsian N, Benfriha K, Olabi A, Gopinath V, Arnou A. Mobile Manipulators in Industry 4.0: A Review of Developments for Industrial Applications. Sensors. 2023; 23(19):8026. https://doi.org/10.3390/s23198026

Chicago/Turabian Style

Ghodsian, Nooshin, Khaled Benfriha, Adel Olabi, Varun Gopinath, and Aurélien Arnou. 2023. "Mobile Manipulators in Industry 4.0: A Review of Developments for Industrial Applications" Sensors 23, no. 19: 8026. https://doi.org/10.3390/s23198026

APA Style

Ghodsian, N., Benfriha, K., Olabi, A., Gopinath, V., & Arnou, A. (2023). Mobile Manipulators in Industry 4.0: A Review of Developments for Industrial Applications. Sensors, 23(19), 8026. https://doi.org/10.3390/s23198026

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop