1. Introduction
Metal powder recycling has become an essential component of the circular economy, offering an innovative solution to conserving valuable resources while minimizing waste and environmental impacts. With the rising demand for metals due to rapid industrialization and technological advancements, there is a need for efficient and sustainable recycling methods [
1]. Metal powder recycling, which encompasses the collection, sorting, and processing of waste metal powders, holds great potential for resource recovery and reuse across various industries [
2].
The recycling process typically begins with collecting waste metal powders generated during manufacturing processes, such as additive manufacturing, metal injection molding, and powder metallurgy. These powders are then sorted by composition and properties using techniques like magnetic separation, air classification, and sieving. Once sorted, they undergo further processing, including decontamination, size reduction, and consolidation, to enable their reuse [
3].
Recycled metal powders have found valuable applications in industries such as aerospace, automotive, and electronics, where they can replace primary resources in manufacturing components and products. By integrating recycled metal powders, these industries can significantly reduce their carbon footprint, material costs, and reliance on virgin materials, fostering a more sustainable and circular economy [
4].
Current research on additive manufacturing of recycled metal powder primarily revolves around three aspects: metal powder recovery, recycled powder treatment, and mechanical properties of manufactured parts. However, a limitation exists as most studies focus on a limited set of metals and address only specific stages of the overall powder recovery, treatment, and reuse process. To address this, developing a comprehensive system encompassing the entire process for commonly used metal powders, from recovery to reuse, holds immense potential to enhance convenience and efficiency in the powder additive manufacturing industry. Such a system would promote sustainable manufacturing, environmental protection, and cost reduction. This paper aims to develop a comprehensive additive manufacturing system for recycled metal powder. Based on the system’s framework and the associated processes and parameters, future researchers can recycle metal powders and create additive components. These components can then be tested for performance and selected for suitable applications, as suggested by the system, ultimately contributing to more sustainable manufacturing practices.
Once the additive manufacturing system for recycled metal powder is established, a knowledge graph for this system is subsequently constructed. Knowledge graphs are potent tools that represent and organize information in a structured, interconnected manner [
5]. They offer numerous benefits across various domains, such as search engines, artificial intelligence, and data analysis. Key advantages of knowledge graphs include:
(1) In-depth semantic understanding. Knowledge graphs enable a deeper comprehension of concepts and their relationships, facilitating the understanding of complex topics and delivering more accurate search results.
(2) Advanced search capabilities. By comprehending the relationships between entities, knowledge graphs enhance search engines’ contextual and intent-based relevancy.
(3) Data integration and interoperability. Knowledge graphs merge data from diverse sources, formats, and domains, simplifying the creation of a unified information view and promoting data sharing and collaboration.
(4) Refined AI and machine learning. Knowledge graphs contribute to context-aware AI models with improved natural language understanding and processing, making them more effective in tasks like recommendation systems, chatbots, and question-answering systems.
(5) Intuitive visualization and exploration. Knowledge graphs facilitate complex information visualization, allowing users to interact with data in more meaningful ways.
(6) Expedited decision-making. By offering a comprehensive information view, knowledge graphs enable organizations to make better-informed decisions swiftly.
(7) Personalized experiences. Knowledge graphs help understand user preferences and behaviors, leading to personalized experiences in applications like e-commerce, content recommendations, and targeted advertising.
(8) Scalability. Knowledge graphs can scale horizontally and vertically, integrating new data sources, entities, and relationships as they arise.
(9) Flexibility and adaptability. Knowledge graphs can easily adapt to data or requirement changes, making them versatile information management tools.
(10) Standardization and reusability. Knowledge graphs employ standardized ontologies and vocabularies, ensuring consistency and reusability across various applications and domains.
Researchers benefit greatly from the knowledge graph when working with metal powder recycling, processing, and reuse. Beyond the system and knowledge graph, the recycling process for 316 L stainless steel powders, guided by the knowledge graph method, is executed. Subsequently, image processing is employed to evaluate the process’s effectiveness. This serves as an appropriate example of recycled powder processing and analysis using the knowledge graph developed in this study. Finally, ChatGPT [
6] and BERT training [
7] are implemented to enhance the knowledge graph’s accuracy.
2. Additive Manufacturing System of Recycled Metal Powder
The additive manufacturing system of recycled metal powder encompasses metal powder variety and property, metal powder process, metal powder manufacturing, metal powder manufacturing component property, and metal powder applications.
2.1. Metal Powder Variety and Property
The commonly used alloys for additive manufacturing include Al alloy, Ni alloy, Cu alloy, Ti alloy, Fe alloy, and Mg alloy. The metal powder property includes sphericity, powder size distribution, modulus of elasticity, porosity, and purity.
2.2. Metal Powder Process
The methods and parameters of the metal powder process are presented in
Figure 1 [
8,
9,
10,
11,
12,
13,
14,
15,
16,
17,
18,
19,
20].
2.3. Metal Powder Manufacturing
The processed powders can be used for manufacturing the products by the following AM technology, such as powder bed fusion, direct energy deposition, material extrusion, material jetting, sheet lamination [
21,
22,
23,
24,
25].
2.4. Metal Powder Manufacturing Component Property
Several test methods assess additive manufactured components’ properties, including compression, tensile, fatigue, hardness, impact, microstructure analysis, three-point bending, creep, and dynamic mechanical analysis (DMA).
2.5. Metal Powder Applications in Vehicle Field
After printing from powders to additive products, the pre-treatment before use is an important step in ensuring the quality and functionality of the product. After that, manufactured products have a wide range of applications in the vehicle field, such as dashboards, vents, pipes, air spoilers, signs, brackets, housing and trunk covers, and more.
4. BERT Training for Improving Accuracy of Knowledge Graph
4.1. A Pre-Trained Bert
The BERT model has achieved good results in the field of natural language processing, but it is mainly used to understand and represent texts. Due to the computational power, I used weights pre-trained by others.
The Test of Pre-Trained Bert
This is very limited and requires a lot of computational power and data sets to train and adjust parameters. For example, when I ask it simple questions, such as: In metal powder recycling, can you tell me ways for in situ monitoring? It would answer questions as if they were chatting.
4.2. KeyBERT
KeyBERT is a minimal and easy-to-use keyword extraction technique that leverages BERT embeddings to create keywords and keyphrases that are most like a document.
KeyBERT is a simple but powerful method for extracting keywords and keyphrases from a document. It uses BERT-embeddings and cosine similarity to find the sub-phrases in a document that are most like the document itself.
To use KeyBERT, first, BERT embeddings are extracted to get a document-level representation. Then, word embeddings are extracted for N-gram words and phrases. Finally, cosine similarity is used to find the words and phrases that are most like the document. These words and phrases can be identified as the keywords and keyphrases that best describe the entire document.
Although there are already many methods available for keyword generation, KeyBERT provides a quick and easy solution that can be used without much expertise in natural language processing. While there are more complex and sophisticated approaches that use BERT-embeddings, KeyBERT is a useful tool for those who need a basic method for extracting keywords and keyphrases from a document.
4.2.1. The Test of KeyBERT
KeyBERT is a minimal and easy-to-use keyword extraction technique that leverages BERT embeddings to create keywords and keyphrases that are most like a document, as illustrated in
Figure 4.
4.2.2. The Parameter of KeyBERT
To ensure diverse results, we selected the top 2 × n most similar words/phrases of the document. Then, we extracted all possible combinations of the top n words from these selections and selected the combination that had the least similarity to each other, based on cosine similarity.
Maximal Marginal Relevance:
To generate diverse keywords/keyphrases, we can use Maximal Marginal Relevance (MMR) based on cosine similarity. This method aims to maximize the similarity to the document while minimizing the similarity between selected keywords. This results in a list of keywords with high diversity.
4.3. BERT Text Classifier Processes Papers
Text summarization is the process of converting a long text to a summary. Let’s say we have a Wikipedia article, but we don’t want to read the full article—we just want an overview of the article. At this point, summary generation helps us get an overview of the text. Abstract tasks are classified into abstractive summarization and extractive summarization. In the abstract, the words or phrases contained in the target abstract are not in the original text, which usually need to be generated by text rewriting and other operations. Abstracted summary is formed by copying and reorganizing the most important content (usually sentences) in the document. So how to obtain and select important sentences in the document is the key to extract summary.
Traditional extraction summary methods include Lead-3 and TextRank. Traditional deep learning methods generally use LSTM or GRU model to judge and select important sentences. In this project, pre-training language model BERT is used to perform extraction summary.
4.3.1. The Test of KeyBERT
First, divide the paper into appropriate text fragments. You can divide it by paragraphs, sentences, or other appropriate units of text.
Secondly, each text fragment is classified using a trained BERT classifier.
4.3.2. The Parameter of KeyBERT
BERT continues to conduct the text summary tasks.
We know that BERT can get a per-tag representation, but here we don’t need a per-tag representation, but a per-sentence representation.
Because the abstracted summary only selects the important sentences. If we could get a representation of each sentence, we could feed the representation of the sentence into a classifier and have the classifier tell us whether the sentence is important or not.
So, the question is how do we get the representation of the sentence? Can we use the corresponding representation of the [CLS] tag as the representation of the sentence? Yes! But there’s a small problem. We only added the [CLS] tag at the beginning of the first sentence, but in the text summary task, we input multiple sentences into the BERT model, and we needed a representation of all the sentences.
Therefore, we modified the input data format and added a [CLS] tag to the beginning of each sentence so that we can get the representation of each sentence through this tag.
Suppose we have three sentences: sent one, sent two, and sent three. The first step, of course, is to divide the words and then add a [CLS] mark to the beginning of each sentence.
Sentence Coding Layer
Due to the MLM pre-training mechanism of the BERT model, its output vector is the vector of each token. Even though delimiters can distinguish between different sentences of input, having only two labels (sentence A or sentence B) is quite different from separating multiple sentences in an extract summary. Therefore, the input of the BERT model is modified as follows.
Insert the [CLS] tag before and after each sentence in the document, and the output vector after the [CLS] tag before each sentence is entered into the model, as the sentence vector representation of that sentence. For example, the document is “I love Nanjing. I like NLP. I study summaries.”, the input sequence is “[CLS] I love Nanjing. [CLS] I love NLP. [CLS] I study abstracts. (SEP)”.
We used segment embeddings to distinguish multiple sentences in the document and set the segment embeddings for odd and even sentences to and respectively.
Summary Judgment Layer
After obtaining the sentence vector of each sentence in the document from the sentence coding layer, three summary judgment layers were constructed to obtain the importance of each sentence under the document-level characteristics. For each sentence, the final predicted score was calculated, and the loss of the model was the binary cross entropy relative to the gold label.
The simple classifier only added a linear full connection layer to the BERT output and obtained the prediction score using a sigmoid function, as follows.
Add additional transformer layer after BERT output to further extract document-level features focused on summary tasks, as follows.
The sentences vector of the sentence, the PosEmb function is the function of adding position information to the sentence vector, the MHAtt function is the multi-head attention function, and is the number of layers in Transformer. Finally, there is still a full connection layer of sigmoid function, adding additional LSTM layers to BERT output to further extract document-level features focused on summary tasks.
BERTSUM with Classifier
We know that in the extract summary, we chose the important sentences. We already know how to obtain the representation of a sentence from the above. Now, we input these representations into a simple binary classifier to determine whether the input sentence could be included in the summary. This classifier layer is often referred to as the digest layer.
The classifier returns the probability that each sentence will be added to the summary.
For each sentence in the document, we received the sentence representation, and then enter it into the summary layer to get the probability that it can be added to the summary.
Obviously, only a Sigmoid classifier is needed to calculate this probability. By minimizing the binary loss between true probability and predicted probability, we can fine-tune both the pre-trained BERT model and the summary layer.
5. Effect Detection of Metal Powder Process
5.1. Object Detection Algorithm-yolov5
yolov5 (You Only Look Once version 5) is an object detection algorithm and an iteration of the original YOLO architecture [
29]. It is a real-time object detection system designed for fast and accurate detection of multiple objects in images and videos. The yolo series has a very big advantage of small computation, and its original purpose of yolov5 network design was to build a small network with low requirements on the server, so that training and conclusions can be easily drawn. Although yolov5 is weak in accuracy, it is stronger than yolov4 in volume and processing speed. Based on the above considerations, the yolov5 framework is chosen.
5.2. Detection
5.2.1. Preparation for Detection
Dataset
The dataset is obtained through an experiment of recycled 316 L metal powder process including SEM photos of recycled 316 L steel powders and processed powders.
We conducted two step processes 20 times with recycled 316 L stainless steel powders, as shown in
Figure 5. The first step was ball milling. Milling time was 1 h, rotation speed was 300 RPM, and the ball size was 5 mm. The second step process was pickling, and Kallings-No. 2 solution (30%HCL + 10%Cucl
2) was selected. After the ball milling and pickling processes, the 316 L powders exhibited improved sphericity and reduced impurities.
Detection Environment
The hardware device used in the detection is a laptop with an NVIDIA GeForce RTX 3060 Laptop GPU. It uses an Nvidia 3060 graphics card with 16 gigabytes of total memory. I used a graphics card for network training and testing, and a CPU. The CPU is 12th Gen Intel(R) Core (TM) i7-12700H.
It has 14 cores and 20 threads, 2.30 GHz CPU frequency, 16gb memory, and 500 GB disk storage space. The system of the computer is Windows 11.
5.2.2. Data Processing
Characteristics of the Data Set
As we can see from
Figure 6, the powder in SEM is very jumbled and overlapping. Some powders are very large, and some powders are very small and irregular. Not easy to detect.
On the other hand, the data set is not enough because there are only a few pictures, which is not enough for deep learning training.
Extend Dataset
To address the issue of limited data sets, one can begin by capturing SEM images of individual metal powders, focusing on those with consistent sphericity to enhance the model’s ability to recognize this attribute. Gradually, the data set can be expanded by including images featuring two, three, and four spheres, allowing the model to identify multiple powders. Incorporating oval and irregular shapes for more comprehensive training results in a dataset comprising three categories: spherical, oval, and irregular. By collecting over a hundred samples for each shape, a total of approximately 500 images can be amassed.
It is important to avoid capturing images of numerous powders simultaneously to prevent potential overlapping or complexity, which could increase the model’s detection error rate. Instead, limiting the number of powder images in each sample helps to maintain accuracy and simplicity.
5.2.3. Detection Result and Discussion
Several different models are for training: yolov5n, yolov5n6, yolov5m, yolov5m6, yolov5l, yolov5l6, yolov5s, yolov5s6, yolov5x, yolov5x6. Here are their results.
Results of yolov5n and yolov5n6
100epoches were trained separately, and the results are shown in
Table 3.
yolov5n6’s improvement is quite large, almost ten percent, and relatively good.
Results of yolov5m and yolov5m6
100epoches were trained separately, and the results are shown in
Table 4.
The improvement of yolov5m6 is not bad, reaching 96.9%, an increase of 6 percentage points.
Results of yolov5l and yolov5l6
100epoches were trained separately, and the results are shown in
Table 5.
The accuracy of yolov5l6 is 96.2%, an improvement of 4 percentage points.
Results of yolov5s and yolov5s6
100epoches were trained separately, and the results are shown in
Table 6.
The accuracy rate of yolov5s6 reached 94.4%, an increase of 2 percentage points. oval has the greatest improvement and the highest accuracy (97.1%)
Results of yolov5x and yolov5x6
100epoches were trained separately, and the results are shown in
Table 7.
yolov5x6 achieved 97.8% accuracy, an improvement of 5 percentage points. oval has the greatest improvement and the highest accuracy, with 98.6%
Figure 7 and
Figure 8 are a graph of the confusion matrix and the training accuracy loss function. It can be seen in
Figure 8 that the losses for train/box, train/obj, train/cls, val/box, val/obj, and val/cls show a significant initial decrease with increasing training iterations, eventually stabilizing. Remarkably, these losses approach 0 after 100 training sessions. Additionally, metrics such as precision, recall, and mAP progressively improve with the number of sessions, converging towards 1 at 100 sessions. These outcomes validate our choice of 100 training sessions as it led to high-accuracy training results.
Figure 9 is the screenshot of the training results.
Figure 9 demonstrates the favorable accuracy of the training results, enabling precise identification of sphere, oval, and irregular powders. This capability is valuable in evaluating the quality of the processed powder.
Overall, the training got better with each layer of the network, and the sixth generation was generally 3 to 5 percent better than the first.
5.2.4. Detection of Model
yolov5x and yolov5x6 models with the highest accuracy for detection were selected, and the effect was very good, as shown in
Figure 10.
5.3. Analysis of Detection Results
The yolov5 series models test the sphericity in SEM images of metal powder. Three distinct shapes, sphere, oval, and irregular have been examined, and impressive results have been obtained.
In the detection using the sixth-generation model of yolov5, the accuracy rate typically hovers around 93 or 94 percent, with 97 or 98 percent for some types exhibiting high accuracy, yielding exceptional results. Spherical and oval shapes, which have the highest number of samples and the best detection effect, generally achieve more than 93 percent accuracy. Irregular shapes are less accurate but still reach 90 percent accuracy.
When it comes to individual powder, the accuracy is remarkably high, attaining 98 percent. However, in the case of multiple powders, the accuracy is not as impressive, possibly due to insufficient training of the multiple powder datasets.
The sphericity detection effect is outstanding, as the three types of sphericities are well-distinguished, resulting in excellent outcomes.
After the sphericity detection effect was verified well, the detection method was carried out on pictures of recycled powders and processed powders, and the sphericity of the processed powders is better and looks well.
In
Figure 11, some researchers utilized unprocessed, poor quality 316 L powders for manufacturing [
30]. These powders exhibit surface impurities, low sphericity, and potential internal defects, leading to manufactured parts with compromised mechanical properties, increased cracking, and reduced service life and performance. In contrast, our processed powders result in products that meet industry standards.
Directly discarding the powder can lead to environmental pollution, while producing new powder can be detrimental to the environment and increase costs. Our system, however, offers a satisfactory solution by enabling circular manufacturing. This approach not only safeguards the environment but also reduces overall costs, making it an effective and environmentally responsible solution.
6. Conclusions
In this study, we developed a vehicle additive manufacturing system utilizing recycled metal powders and constructed a related knowledge graph to promote sustainable manufacturing through recycling, processing, and reusing metal powders. This work holds significant value for future researchers aiming to understand the entire process, from metal powder recovery to its manufacturing and application. Additionally, we employed ChatGPT and BERT training to enhance the accuracy of the knowledge graph. To demonstrate the knowledge graph’s practicality, we applied its methods to the recycling process of 316 L stainless steel. Subsequent image processing revealed that the powders were effectively processed. This research significantly contributes to the achievement of sustainable manufacturing for electric vehicles, yielding cost reduction and promoting environmental friendliness. However, this study has certain limitations. While it includes commonly used recycled metal powders, it does not encompass newer, popular metals like high entropy alloys, shape memory alloys, and others. Additionally, the metal recovery and treatment methods employed in this study represent only commonly used approaches, potentially yielding less satisfactory results. To address these limitations, our future research endeavors will focus on two key aspects. Firstly, we aim to expand the scope of our study by incorporating relevant content related to the more popular metals used in recent years. This expansion will enhance the system’s applicability and relevance. Secondly, we will continue to explore and develop advanced metal recovery and treatment methods to significantly improve the quality of treated powders. By doing so, we can further optimize the established system, ensuring better performance and more robust outcomes for the additive manufacturing industry.