Construction of an Event Knowledge Graph Based on a Dynamic Resource Scheduling Optimization Algorithm and Semantic Graph Convolutional Neural Networks
Abstract
:1. Introduction
- Targeting the dynamic demand of resources for multi-scenario tasks during knowledge graph construction. For problem (a), we propose a resource management and scheduling technique based on virtualization technology using Kernel-based Virtual Machine–Quick Emulator (KVM-QEMU) and Kubernetes technology. KVM-QEMU virtualization technology enables the virtualization of hardware resources and improves the efficiency of resource utilization. Kubernetes container orchestration technology has a united scheduling feature that can use Graphics Processing Unit (GPU) resources at the same time to make scheduling work well with different types of resources, like Central Processing Unit (CPU) and GPU. The proposed dynamic computational resource scheduling method increases GPU and CPU use by 25% and 9%.
- To improve the accuracy and standardization of information extracted from online social media for on-campus traffic safety events, we propose a general ontology model for knowledge graphs of traffic safety events in universities to solve problem (b). The model can provide standard definitions and construct multi-source knowledge structures so that knowledge graphs regarding traffic safety events in universities can be made. In addition, the methodology takes full account of the dynamic spatial and temporal information between events. We construct a knowledge graph ontology model of university traffic events based on multi-source heterogeneous data.
- To adapt to the needs of online public opinion scenarios, for problem (c), we propose a joint extraction method for entity relations based on graph convolutional neural networks. The method first fuses the global semantic dependency analysis graph embedding information with syntactic analysis graph embedding information to further improve the accuracy of the recognition of distant entities. Next, a multi-layer semantic graph convolutional neural network is constructed to find deeper, semantically hidden knowledge about how entities are related. Finally, a multi-feature fusion attention mechanism is designed to enhance the accuracy of model triple classification. The method effectively enhances the problem of entity boundary ambiguity in triple overlapping and relation extraction. Among them, the F1 values were improved by 1.3% and 0.4% on the NYT and WebNLG English datasets, respectively.
2. Related Work
2.1. Virtualization Management and Scheduling Technology
2.2. Ontology Modeling Methodology
2.3. Entity Relationship Joint Extraction Model
3. Methodology
3.1. Virtualized Resource Management and Scheduling Design
3.2. Ontology Modeling Design
3.3. Event Extraction Model Design
3.3.1. Graph Embedding Representation Improvement
3.3.2. Multi-Layer Semantic Graph Convolutional Network Design
3.3.3. Multi-Feature Fusion Attention Mechanism Design
4. Experiment
4.1. Experimental Datasets and Evaluation Metrics
4.2. Experimental Environment Setting
4.3. Experimental Comparison Model
4.4. Experimental Results and Analysis
4.5. Ablation Experiment
4.6. Question Analysis
4.7. Graph Visualization
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Appendix A
Appendix A.1. Architecture Design of Knowledge Graph Construction for Traffic Safety Events in University
Appendix A.2. Architecture Design of Virtualized Resources and Scheduling Technology
Appendix A.3. Design of Knowledge Graph Entities and Attribute Labels for Traffic Safety Events in the University
Serial Number | Entity and Attribute Tag Name | Entity and Attribute Label Meaning | Example |
---|---|---|---|
1 | Location | Geographic location of the event | A university in a city in a province |
2 | Time | Time of event | November 2010 |
3 | Source of information | Relevant websites where the event was reported | Dahe Network |
4 | Event subject | People information | Third-year university student |
5 | Event data | Number of persons involved in the event, reasons for the event, etc. | 1 victim, car driving against traffic, etc. |
6 | Emergency solutions | Emergency response plan for traffic safety events | Ambulance rescue, police vehicle response, etc. |
7 | Model methodology | Modeling methods that are relevant to the study of traffic safety events | Machine learning and other methods |
Appendix A.4. Relationship Types and Samples of Knowledge Graphs for Traffic Safety Events in the University
Serial Number | Relationship Type Name | Example |
---|---|---|
1 | Published content | <Dahernet, Published Content, Detailed Information on Traffic Safety Events on University Grounds> |
2 | Date of occurrence | <An event, Time of occurrence, November 2010> |
3 | Place of occurrence | <An event, Place of occurrence, A university in a city in a province> |
4 | Event objects | <An event, Object of the event, Member of the community/student> |
5 | Cause of occurrence | <An event, The reason for it, A car driving against the traffic> |
6 | Type of accident | <An event, Type of accident, Automobile accident> |
7 | Processing department | <An event, Handling department, Public Security Bureau>, <An event, Handling department, Hospital> |
8 | Result | <An event, The result of the process, The arrest of the suspect> |
9 | Reference plan | <An event, A reference plan, A measure to deal with a past case> |
10 | Model methodology | <An event, Modeling methods, Machine learning, Statistical analysis, etc.> |
Appendix A.5. NYT and WebNLG Dataset Download Links
References
- Sun, L.L.; Liu, D.; Chen, T.; He, M.T. Road traffic safety: An analysis of the cross-effects of economic, road and population factors. Chin. J. Traumatol. 2019, 22, 290–295. [Google Scholar] [CrossRef] [PubMed]
- Wang, L.; Wang, Y.; Shi, L.; Xu, H. Analysis of risky driving behaviors among bus drivers in China: The role of enterprise management, external environment and attitudes towards traffic safety. Accid. Anal. Prev. 2022, 168, 106589. [Google Scholar] [CrossRef] [PubMed]
- Gan, L.; Ye, B.; Huang, Z.; Xu, Y.; Chen, Q.; Shu, Y. Knowledge graph construction based on ship collision accident reports to improve maritime traffic safety. Ocean. Coast. Manag. 2023, 240, 106660. [Google Scholar] [CrossRef]
- Cvitković, I.; Vilke, S.; Krpan, L.; Brlek, P. Removing regulatory features of traffic control in school zones. Transp. Res. Procedia 2022, 60, 228–234. [Google Scholar] [CrossRef]
- Yan, S.; Su, Q.; Gong, Z.; Zeng, X. Fractional order time-delay multivariable discrete grey model for short-term online public opinion prediction. Expert Syst. Appl. 2022, 197, 116691. [Google Scholar] [CrossRef]
- Sayed, A. Use of Machine Learning and Natural Language Processing to Enhance Traffic Safety Analysis. Ph.D. Thesis, The University of Wisconsin-Milwaukee, Milwuakee, WI, USA, 2022. [Google Scholar]
- Zhang, X.; Zhang, J. Classification and topic tracking of college students’ cybersecurity education based on the internet. J. Comput. Methods Sci. Eng. 2023; in press. [Google Scholar]
- Telima, M.; El Esawey, M.; El-Basyouny, K.; Osama, A. The use of crowdsourcing data for analyzing pedestrian safety in urban areas. Ain Shams Eng. J. 2023, 14, 102140. [Google Scholar] [CrossRef]
- Schwalbach, J.; DeAngelis, C.A. School sector and school safety: A review of the evidence. Educ. Rev. 2022, 74, 882–898. [Google Scholar] [CrossRef]
- Chen, X.; Jia, S.; Xiang, Y. A review: Knowledge reasoning over knowledge graph. Expert Syst. Appl. 2020, 141, 112948. [Google Scholar] [CrossRef]
- Ji, S.; Pan, S.; Cambria, E.; Marttinen, P.; Philip, S.Y. A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Trans. Neural Netw. Learn. Syst. 2021, 33, 494–514. [Google Scholar] [CrossRef]
- Zhu, G.; Zhang, M.; Xi, Y. Knowledge graph-based prediction of evolutionary outcomes of urban rail transit emergencies. J. Electron. Inf. 2023, 45, 949–957. [Google Scholar]
- Sun, X.; Mengm, Y.; Wang, W. Recognition of microblog traffic events based on knowledge graph and target detection. Data Anal. Knowl. Discov. 2020, 4, 136–147. [Google Scholar]
- Song, Y.; Li, W.; Dai, G.; Shang, X. Advancements in Complex Knowledge Graph Question Answering: A Survey. Electronics 2023, 12, 4395. [Google Scholar] [CrossRef]
- Munir, S.; Jami, S.I.; Wasi, S. Towards the modelling of Veillance based citizen profiling using knowledge graphs. Open Comput. Sci. 2021, 11, 294–304. [Google Scholar] [CrossRef]
- Ge, Y.; Tian, Y.C.; Yu, Z.G.; Zhang, W. Memory sharing for handling memory overload on physical machines in cloud data centers. J. Cloud Comput. 2023, 12, 1–20. [Google Scholar] [CrossRef]
- Li, J.Y.; Du, K.J.; Zhan, Z.H.; Wang, H.; Zhang, J. Distributed differential evolution with adaptive resource allocation. IEEE Trans. Cybern. 2022, 53, 2791–2804. [Google Scholar] [CrossRef] [PubMed]
- Carrión, C. Kubernetes scheduling: Taxonomy, ongoing issues and challenges. ACM Comput. Surv. 2022, 55, 1–37. [Google Scholar] [CrossRef]
- ALshalabi, H.; Tiun, S.; Omar, N.; Ali Alezabi, K.; Al-Aswadi, F.N. The Effectiveness of Arabic Stemmers Using Arabized Word Removal. Int. J. Inf. Sci. Manag. 2022, 20, 87–102. [Google Scholar]
- Spoladore, D.; Sacco, M.; Trombetta, A. A review of domain ontologies for disability representation. Expert Syst. Appl. 2023, 228, 120467. [Google Scholar] [CrossRef]
- Wang, F.; Yang, J.; Xu, L.L. Research on ontology construction for fire emergency management. J. Intell. 2020, 39, 914–925. [Google Scholar]
- Wang, T.; Zheng, L.; Lv, H.; Zhou, C.; Shen, Y.; Qiu, Q.; Li, Y.; Li, P.; Wang, G. A distributed joint extraction framework for sedimentological entities and relations with federated learning. Expert Syst. Appl. 2023, 213, 119216. [Google Scholar] [CrossRef]
- Upadhyay, P.; Balalau, O.; Manolescu, I. Open Information Extraction with Entity Focused Constraints; Findings of the Association for Computational Linguistics; EACL: Dubrovnik, Croatia, 2023; pp. 1255–1266. [Google Scholar]
- Yang, J.; Wu, Z.; Wu, R. Micro-Expression Spotting Based on VoVNet, Driven by Multi-Scale Features. Electronics 2023, 12, 4459. [Google Scholar] [CrossRef]
- Zhu, X.; Zhou, G.; Chen, J.; Lu, J.; Xiang, Y. A single-stage joint entity relationship extraction method based on enhanced sequence labeling strategy. Comput. Sci. 2023, 50, 184–192. [Google Scholar]
- Lee, C.V.G.E.; Pierleoni, A. Improving Distantly Supervised Document-Level Relation Extraction Through Natural Language Inference. DeepLo 2022, 2022, 14. [Google Scholar]
- Ding, X.; Zhou, G.; Lu, J.; Chen, J. Research on document-level relationship extraction methods for enhanced entity representation. Comput. Sci. 2023, 50, 157–162. [Google Scholar]
- Omotehinwa, T.O. Examining the developments in scheduling algorithms research: A bibliometric approach. Heliyon 2022, 8, e09510. [Google Scholar] [CrossRef] [PubMed]
- Abbasi, R.; Martinez, P.; Ahmad, R. An ontology model to represent aquaponics 4.0 system’s knowledge. Inf. Process. Agric. 2022, 9, 514–532. [Google Scholar] [CrossRef]
- Polenghi, A.; Roda, I.; Macchi, M.; Pozzetti, A.; Panetto, H. Knowledge reuse for ontology modelling in Maintenance and Industrial Asset Management. J. Ind. Inf. Integr. 2022, 27, 100298. [Google Scholar] [CrossRef]
- Li, Z.; Liu, X.; Wang, X.; Liu, P.; Shen, Y. Transo: A knowledge-driven representation learning method with ontology information constraints. World Wide Web 2023, 26, 297–319. [Google Scholar] [CrossRef]
- Agrawal, G.; Deng, Y.; Park, J.; Liu, H.; Chen, Y.-C. Building Knowledge Graphs from Unstructured Texts: Applications and Impact Analyses in Cybersecurity Education. Information 2022, 13, 526. [Google Scholar] [CrossRef]
- Shang, Y.M.; Huang, H.; Mao, X. Onerel: Joint entity and relation extraction with one module in one step. In Proceedings of the AAAI Conference on Artificial Intelligence 36, Vancouver, BC, Canada, 22 February–1 March 2022; pp. 11285–11293. [Google Scholar]
- Liu, Y.; Wei, S.; Huang, H.; Lai, Q.; Li, M.; Guan, L. Naming entity recognition of citrus pests and diseases based on the BERT-BiLSTM-CRF model. Expert Syst. Appl. 2023, 234, 121103. [Google Scholar] [CrossRef]
- Bokolo, B.G.; Liu, Q. Deep Learning-Based Depression Detection from Social Media: Comparative Evaluation of ML and Transformer Techniques. Electronics 2023, 12, 4396. [Google Scholar] [CrossRef]
- Ali, A.; Zhu, Y.; Zakarya, M. Exploiting dynamic spatio-temporal graph convolutional neural networks for citywide traffic flows prediction. Neural Netw. 2022, 145, 233–247. [Google Scholar] [CrossRef] [PubMed]
- Yang, X.; Li, W.; Chen, Y.; Guo, Y. Construction of a COVID-19 Pandemic Situation Knowledge Graph Considering Spatial Relationships: A Case Study of Guangzhou, China. ISPRS Int. J.-Geo-Inf. 2022, 11, 561. [Google Scholar] [CrossRef]
- Lai, T.; Cheng, L.; Wang, D.; Ye, H.; Zhang, W. RMAN: Relational multi-head attention neural network for joint extraction of entities and relations. Appl. Intell. 2022, 52, 3132–3142. [Google Scholar] [CrossRef]
- Zhao, K.; Xu, H.; Cheng, Y.; Li, X.; Gao, K. Representation iterative fusion based on heterogeneous graph neural network for joint entity and relation extraction. Knowl.-Based Syst. 2021, 219, 106888. [Google Scholar] [CrossRef]
- Zeng, D.; Zhang, H.; Liu, Q. CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learning. In Proceedings of the AAAI Conference on Artificial Intelligence 34, New York, NY, USA, 7–12 February 2020; pp. 9507–9514. [Google Scholar]
- Nayak, T.; Ng, H.T. Effective modeling of encoder-decoder architecture for joint entity and relation extraction. In Proceedings of the AAAI Conference on Artificial Intelligence 34, New York, NY, USA, 7–12 February 2020; pp. 8528–8535. [Google Scholar]
- Wei, Z.; Su, J.; Wang, Y.; Tian, Y.; Chang, Y. A Novel Cascade Binary Tagging Framework for Relational Triple Extraction. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Seattle, WA, USA, 5–8 July 2020; pp. 1476–1488. [Google Scholar]
- Wang, Z.; Yang, L.; Yang, J.; Li, T.; He, L.; Li, Z. A Triple Relation Network for Joint Entity and Relation Extraction. Electronics 2022, 11, 1535. [Google Scholar] [CrossRef]
- Sui, D.; Zeng, X.; Chen, Y.; Liu, K.; Zhao, J. Joint entity and relation extraction with set prediction networks. IEEE Trans. Neural Netw. Learn. Syst. 2023; in press. [Google Scholar] [CrossRef]
- Wang, Y.; Sun, C.; Wu, Y.; Zhou, H.; Li, L.; Yan, J. ENPAR: Enhancing entity and entity pair representations for joint entity relation extraction. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics, Kyiv, Ukraine, 19–23 April 2021; pp. 2877–2887. [Google Scholar]
- Sun, L.; Dou, Y.; Yang, C.; Zhang, K.; Wang, J.; Philip, S.Y.; He, L.; Li, B. Adversarial attack and defense on graph data: A survey. IEEE Trans. Knowl. Data Eng. 2022, 35, 7693–7711. [Google Scholar] [CrossRef]
- Liang, C.; Yang, J.; Du, R.; Hu, W.; Tie, Y. Non-Uniform Motion Aggregation with Graph Convolutional Networks for Skeleton-Based Human Action Recognition. Electronics 2023, 12, 4466. [Google Scholar] [CrossRef]
- Monteil, J.B.; Iosifidis, G.; DaSilva, L.A. Learning-based Reservation of Virtualized Network Resources. IEEE Trans. Netw. Serv. Manag. 2022, 19, 2001–2016. [Google Scholar] [CrossRef]
Dataset | Number of Samples in the Training Set | Number of Samples in the Validation Set | Test Set Sample Size | Types of Predefined Relationships |
---|---|---|---|---|
NYT | 56,195 | 5000 | 5000 | 24 |
WebNLG | 5019 | 500 | 703 | 171 |
Node Type | Resource Type | Default Algorithm Resource Utilization | Improved Algorithm Utilization |
---|---|---|---|
Master | GPU | 50% | 75% |
CPU | 18% | 27% | |
Random access memory (RAM) | 6% | 18% | |
Node1 | GPU | 50% | 50% |
CPU | 31% | 26% | |
Random access memory (RAM) | 12% | 21% |
Model | NYT Datasets | WebNLG Datasets | ||||
---|---|---|---|---|---|---|
P (%) | R (%) | F1 (%) | P (%) | R (%) | F1 (%) | |
CopyMTL | 0.727 | 0.692 | 0.709 | 0.578 | 0.601 | 0.589 |
WDec | 0.843 | 0.764 | 0.802 | - | - | - |
CasRel | 0.897 | 0.895 | 0.896 | 0.934 | 0.901 | 0.918 |
TpLinker | 0.913 | 0.925 | 0.919 | 0.918 | 0.920 | 0.919 |
SPN4RE | 0.933 | 0.917 | 0.925 | 0.931 | 0.936 | 0.934 |
ENPAR | 0.936 | 0.920 | 0.928 | 0.934 | 0.916 | 0.925 |
OneRel | 0.928 | 0.929 | 0.928 | 0.941 | 0.944 | 0.943 |
Ours | 0.958 | 0.924 | 0.941 | 0.945 | 0.951 | 0.947 |
Model | NYT Datasets | WebNLG Datasets |
---|---|---|
F1 (%) | F1 (%) | |
Baseline | 0.928 | 0.943 |
+ | 0.930 | 0.936 |
+ | 0.933 | 0.940 |
+ | 0.940 | 0.946 |
++ | 0.937 | 0.945 |
+++ | 0.941 | 0.947 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Liu, X.; Zhang, L.; Zheng, Q.; Wei, F.; Wang, K.; Zhang, Z.; Chen, Z.; Niu, L.; Liu, J. Construction of an Event Knowledge Graph Based on a Dynamic Resource Scheduling Optimization Algorithm and Semantic Graph Convolutional Neural Networks. Electronics 2024, 13, 11. https://doi.org/10.3390/electronics13010011
Liu X, Zhang L, Zheng Q, Wei F, Wang K, Zhang Z, Chen Z, Niu L, Liu J. Construction of an Event Knowledge Graph Based on a Dynamic Resource Scheduling Optimization Algorithm and Semantic Graph Convolutional Neural Networks. Electronics. 2024; 13(1):11. https://doi.org/10.3390/electronics13010011
Chicago/Turabian StyleLiu, Xing, Long Zhang, Qiusheng Zheng, Fupeng Wei, Kezheng Wang, Zheng Zhang, Ziwei Chen, Liyue Niu, and Jizong Liu. 2024. "Construction of an Event Knowledge Graph Based on a Dynamic Resource Scheduling Optimization Algorithm and Semantic Graph Convolutional Neural Networks" Electronics 13, no. 1: 11. https://doi.org/10.3390/electronics13010011
APA StyleLiu, X., Zhang, L., Zheng, Q., Wei, F., Wang, K., Zhang, Z., Chen, Z., Niu, L., & Liu, J. (2024). Construction of an Event Knowledge Graph Based on a Dynamic Resource Scheduling Optimization Algorithm and Semantic Graph Convolutional Neural Networks. Electronics, 13(1), 11. https://doi.org/10.3390/electronics13010011