Proximal Policy Optimization Based Intelligent Energy Management for Plug-In Hybrid Electric Bus Considering Battery Thermal Characteristic
Round 1
Reviewer 1 Report
I have no concerns about this paper. Good and comprehensive explanation of control methods for EMS management in PHEB.
Author Response
Response to Reviewer 1 Comments
Point 1: I have no concerns about this paper. Good and comprehensive explanation of control methods for EMS management in PHEB.
Response 1: Thank you for your evaluation and recognition.
Author Response File: 
Author Response.docx
Reviewer 2 Report
the paper untitled "Proximal Policy Optimization based Intelligent Energy Management for Plug-in Hybrid Electric Bus Considering Battery Thermal Characteristic ", presents a good study in relation to the power anagment insie an electric vehicle and using an intelligent control tool.
the PPO based EMS strategy looks novel and intersting, i have only one comment about this tool. Actually im afraid about the responce time of this overall control loop. Can authors discuss this point and give some statitics about the rapidity if the EMS execustion and say what is the necessary conditions that must be applied on the overall control system.
the reference list needs to be updated by some usufull references which can ameliorate the state of art o this work. I suggest some works in relation to this field
1. A Novel Energy Optimization Approach for Electrical Vehicles in a Smart City. Energies 2019, 12, 929, doi:10.3390/EN12050929.
2. Electric Vehicle Model Based on Multiple Recharge System and a Particular Traction Motor Conception. IEEE Access 2021, 9, 49308–49324, doi:10.1109/ACCESS.2021.3068262.
3. . Energy Optimization Method for Connected Vehicles on a Cloud Database. In Proceedings of the 2018 International Symposium on Advanced Electrical and Communication Technologies (ISAECT); marroco, 2018; pp. 1–5.
4. . Power Management and Control of a Hybrid Electric Vehicle Based on Photovoltaic , Fuel Cells , and Battery Energy Sources. Sustain. 2022, 14, 2551.
5.. Efficient Power Management Strategy of Electric Vehicles Based Hybrid Renewable Energy. Sustain. 2021, 13, 1–20, doi:10.3390/su13137351.
Author Response
Response to Reviewer 2 Comments
Point 1: The paper untitled "Proximal Policy Optimization based Intelligent Energy Management for Plug-in Hybrid Electric Bus Considering Battery Thermal Characteristic ", presents a good study in relation to the power management inside an electric vehicle and using an intelligent control tool.
the PPO based EMS strategy looks novel and interesting, i have only one comment about this tool. Actually I’m afraid about the responce time of this overall control loop. Can authors discuss this point and give some statitics about the rapidity if the EMS execustion and say what is the necessary conditions that must be applied on the overall control system. EMS management in PHEB.
Response 1: Thank you for your insightful comments. For "the responce time of this overall control loop", I will explain as follows. As shown in Table 7, the PPO-Penalty takes 1,435 seconds for 200 training sessions, which is 200 repeated driving cycles. So running one driving cycle generally takes 1435/200=7.175 seconds. This is the time standard that can meet the requirements of real-time online control for the EMS of HEVs. In contrast, the 9504 seconds consumed by the DP algorithm is the time spent on running one driving cycle. It can be seen that although DP algorithm has optimal control performance, it consumes a lot of computing time and cannot meet the real-time control requirements of vehicles. Therefore, PPO algorithms play a significant role in application in the overall control system.
Point 2: The reference list needs to be updated by some useful references which can ameliorate the state of art o this work. I suggest some works in relation to this field.
Response 2: Thank you very much for the novel references you provided, which gave us the opportunity to contact the more cutting-edge technology of this research. I have read these references carefully and quoted some of them appropriately in my paper, which greatly enriched the content of the paper. For details, please refer to the revised version.
Author Response File: Author Response.docx
Reviewer 3 Report
The authors did a great job in presenting and justifying the unique merits of proposed PPO-based EMSs by incorporating battery temperature and fuel consumption simulations. Sufficient theoretical details were provided and extensive simulations were performed. The takeaways are straightforward and the language is easy-to-read. Overall this qualifies for a scientific research paper with novelty and good reasoning.
Author Response
Response to Reviewer 3 Comments
Point 1: The authors did a great job in presenting and justifying the unique merits of proposed PPO-based EMSs by incorporating battery temperature and fuel consumption simulations. Sufficient theoretical details were provided and extensive simulations were performed. The takeaways are straightforward and the language is easy-to-read. Overall this qualifies for a scientific research paper with novelty and good reasoning.
Response 1: Thank you for your recognition of our work. Your recognition is what keeps me going. I will continue to deeply study the research related to energy management of hybrid electric vehicles.
Author Response File: Author Response.docx
Reviewer 4 Report
The article “Proximal Policy Optimization based Intelligent Energy Management for Plug-in Hybrid Electric Bus Considering Battery Thermal Characteristics” explores the optimum energy management system for plug-in hybrid electric buses. The article’s main contribution is to obtain optimum efficiency by incorporating battery thermal characteristics into the approach while developing an energy management strategy (EMS) with the proximal policy optimization (PPO) approach for hybrid electric buses. The importance of energy efficiency studies with algorithms and machine learning is also evident in the existing literature. The data obtained will be very useful in practical applications in the field. I believed that if further research mentioned in the Conclusion section can be studied, its effectiveness in practice will be extremely high.
Overall, this manuscript is clear, concise, and well-written. The introduction contains relevant and theoretical information. Sufficient information is provided for readers to understand the rationale for this manuscript and previous studies. The methodology is appropriate and reproducible and the analyzes are adequate. However, since many abbreviations are used in the text, it would be helpful for readability to provide careful explanations of these abbreviations in the text. For example, I guess SOC means "State Of Charge" but I did not see any explanation in the text. I believe that the publication of the manuscript in World Electrical Vehicle Journal after minor revisions will contribute to electrical vehicle studies.
Author Response
Response to Reviewer 4 Comments
Point 1: The article “Proximal Policy Optimization based Intelligent Energy Management for Plug-in Hybrid Electric Bus Considering Battery Thermal Characteristics” explores the optimum energy management system for plug-in hybrid electric buses. The article’s main contribution is to obtain optimum efficiency by incorporating battery thermal characteristics into the approach while developing an energy management strategy (EMS) with the proximal policy optimization (PPO) approach for hybrid electric buses. The importance of energy efficiency studies with algorithms and machine learning is also evident in the existing literature. The data obtained will be very useful in practical applications in the field. I believed that if further research mentioned in the Conclusion section can be studied, its effectiveness in practice will be extremely high.
Overall, this manuscript is clear, concise, and well-written. The introduction contains relevant and theoretical information. Sufficient information is provided for readers to understand the rationale for this manuscript and previous studies. The methodology is appropriate and reproducible and the analyzes are adequate. However, since many abbreviations are used in the text, it would be helpful for readability to provide careful explanations of these abbreviations in the text. For example, I guess SOC means "State Of Charge" but I did not see any explanation in the text. I believe that the publication of the manuscript in World Electrical Vehicle Journal after minor revisions will contribute to electrical vehicle studies.
Response 1: Thank you very much for your valuable advice. We have checked all the abbreviations in this paper and made some additions. For example, the full name of SOC mentioned is "State Of Charge". The specific modification contents are respectively reflected in line 4,75, 81 and 111 of the article and please refer to the revised paper for details. In addition, taking these opinions into account, we will further study the mentioned research in Conclusion section and gradually apply the theoretical research and simulation results to the actual scenarios.
Author Response File: Author Response.docx
Round 2
Reviewer 2 Report
all my remarks were answered and this is make the work more acceptable.
