A Method to Develop the Driver-Adaptive Lane-Keeping Assistance System Based on Real Driver Preferences
Abstract
:1. Introduction
- Extracting metrics for describing naturalistic driving characteristics based on action point theory (hereafter, these metrics will be referred to as “naturalistic driving characteristic metrics”);
- Introducing subjective and objective evaluation methods to obtain the test drivers’ real preferences to the LKA system, making model training possible;
- Instead of having the LKA system directly mimic the driver’s naturalistic driving characteristics, employing machine learning models to train a model using the driver’s individual driving characteristics and their real preferred LKA system characteristics and integrating the model-predicted drivers’ real preferences into the LKA system.
2. Methods
2.1. Research Roadmap
2.2. Lateral Naturalistic Driving Characteristic Analysis Method
2.2.1. Traditional Descriptive Statistics Method
2.2.2. Descriptive Statistics Method Based on Action Point Theory
- Lane-Keeping Steering Starting Point, LKSSP:
- Lane-Keeping Lateral Maximum Deviation Point, LKMDP:
- Lane-Keeping Steering Ending Point, LKSEP:
2.3. Method for Obtaining Drivers’ Real Preferences
2.3.1. The Working Process of LKA System
- Intervention timing: This refers to the situation at the moment when LKA system initiates its intervention ;
- Intervention process: This refers to the process from the moment when the LKA system initiates its intervention to the moment when the LKA system ends its intervention due to the vehicle returning to the center of the lane.
2.3.2. Method for Constructing Evaluation Samples
2.3.3. The Subjective Questionnaires for LKA System and Objective Metrics
2.4. Method for Training Driver Preference Prediction Model
3. Tests
3.1. Test Conditions and Procedure
3.2. Test Platform
3.3. Test Drivers
4. Result
4.1. Driver’s Real Preference for the LKA System
4.1.1. Driver’s Preference Regarding LKA Intervention Timing
4.1.2. Driver’s Preference for LKA Intervention Process
4.2. Predictive Performance of DPPM
4.3. Discussion of Results
5. System Integration and Validation Test of DALKA
5.1. LKA Decision and Control Module
- When the system confirms that the driver has activated the LKA system, it receives the status “If at least one lane line can be effectively detected” from the environment-perception module. If the status is “No,” indicating insufficient conditions for activating the LKA system, the system again enters the off state with set to 0;
- If the environment-perception module confirms effective lane line detection, it evaluates the risk of the vehicle deviating from the lane by checking if the current DLC satisfies Equation (10):Here, is the LKA intervention control threshold, calculated as Equation (11):and are the key metrics obtained from Section 4.1, influencing drivers’ preferences for LKA intervention timing, computed using DPPM. If Equation (10) is not met, the LKA system remains standby with set to 0;
- If Equation (10) is satisfied, it is necessary to determine whether the driver has the intention of actively steering. We adopted the method proposed in refs. [34,35] to judge the driver’s intention to steer actively based on the steering wheel torque threshold , as shown in Equation (12). If Equation (12) is not satisfied, is set to 0. Otherwise, the LKA system initiates its intervention, and is set to 1.
5.2. Validation Test of DALKA System
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
No. | Description of Metrics | Symbol | Unit |
---|---|---|---|
1 | DLC when LKA initiates intervention | m | |
2 | Lane-relative velocity when initiating intervention | m/s | |
3 | TLC when LKA initiates intervention | s | |
4 | Maximum steering wheel torque change rate | N·m/s | |
5 | Maximum steering wheel torque | N·m | |
6 | Average steering wheel torque | N·m | |
7 | Maximum steering wheel rotation speed | deg/s | |
8 | Maximum steering wheel rotation angle | deg | |
9 | Average steering wheel rotation angle | deg | |
10 | Minimum TLC | s | |
11 | Minimum DLC | m | |
12 | Maximum DLC | m | |
13 | Average DLC | m | |
15 | Maximum yaw rate | deg/s | |
16 | Average yaw rate | deg/s | |
17 | Maximum lane-relative velocity | m/s | |
18 | Average lane-relative velocity | m/s | |
19 | Intervention duration | s | |
20 | Maximum steering wheel torque | N·m | |
21 | Average steering wheel torque | N·m·s |
Test Category | Test Procedure |
---|---|
Naturalistic driving data-collection test | ① Have the driver operate the driving simulator for at least 10 min to familiarize themselves with the test environment. Inform them in advance about the location of the lane boundaries to minimize the perceptual differences between the simulated and real environments. |
② Ask the driver to simulate their real driving process as closely as possible, but keep the vehicle within the center lane with continuous traffic flow on both sides of the lane. | |
③ Data collection is ended after 1 h. |
Test Category | Test Procedure |
---|---|
Test of LKA intervention timing | ① The vehicle is controlled along the center of the lane. The LKA system does not initiate intervention as the vehicle remains within the lane center. |
② Choose one evaluation sample for LKA intervention timing shown in Table 1. By applying crosswinds in virtual environment, make the vehicle deviate from the lane with preset . | |
③ Initiate the LKA system intervention when the vehicle deviates to a certain degree, controlling the vehicle to return to the center of the lane. Subsequently, end the LKA system intervention and return to the state of procedure ①. | |
④ Repeat procedures ① to ③ multiple times, allowing the driver to fully experience the LKA intervention timing. | |
⑤ Let the driver give subjective ratings to the evaluation questions in Table 3 based on his current experience of LKA intervention timing. | |
⑥ Select another LKA intervention timing sample shown in Table 1, and repeat procedures ① to ⑤ until subjective ratings have been collected for all evaluation samples. | |
⑦ Randomly select several evaluation samples for test driver and ask him to give subjective ratings repletely, ensuring consistent ratings for same evaluation sample. Repeat this procedure until the driver’s ratings stabilize. | |
Test of LKA intervention process | ① The vehicle is controlled along the center of the lane. The LKA system does not initiate intervention as the vehicle remains within the lane center. |
② Choose one evaluation sample for LKA intervention process shown in Table 2. By applying crosswinds in virtual environment, make the vehicle deviate from the lane with preset . | |
③ Initiate the LKA system intervention when the vehicle deviates to a certain degree, controlling the vehicle to return to the center of the lane. Subsequently, end the LKA system intervention and return to the state of procedure ①. | |
④ Repeat procedures ① to ③ multiple times, allowing the driver to fully experience the LKA intervention process; | |
⑤ Let the driver give subjective ratings of the evaluation questions in Table 3 based on his current experience of LKA intervention process. | |
⑥ Select another LKA intervention process sample shown in Table 2, and repeat procedures ① to ⑤ until subjective ratings have been collected for all evaluation samples. | |
⑦ Randomly select several evaluation samples for test driver and ask him to give subjective ratings repletely, ensuring consistent ratings of same evaluation sample. Repeat this procedure until the driver’s ratings stabilize. |
References
- Eichelberger, A.H.; McCartt, A.T. Toyota Drivers’ Experiences with Dynamic Radar Cruise Control, Pre-Collision System, and Lane-Keeping Assist. J. Saf. Res. 2016, 56, 67–73. [Google Scholar] [CrossRef]
- Li, G.; Eben Li, S.; Cheng, B. Field Operational Test of Advanced Driver Assistance Systems in Typical Chinese Road Conditions: The Influence of Driver Gender, Age and Aggression. Int. J. Automot. Technol. 2015, 16, 739–750. [Google Scholar] [CrossRef]
- Lin, N.; Zong, C.; Tomizuka, M.; Song, P.; Zhang, Z.; Li, G. An Overview on Study of Identification of Driver Behavior Characteristics for Automotive Control. Math. Probl. Eng. 2014, 2014, 569109. [Google Scholar] [CrossRef]
- Wahab, A.; Toh, G.W.; Kamaruddin, N. Understanding Driver Behavior Using Multi-Dimensional CMAC. In Proceedings of the 2007 6th International Conference on Information, Communications & Signal Processing, Singapore, 10–13 December 2007. [Google Scholar] [CrossRef]
- Luo, Q. Research on Lane Departure and Lane-changing Model for Highway Driving Safety Warning. Ph.D. Thesis, South China University of Technology, Guangzhou, China, 2014. [Google Scholar]
- Jia, L. Research of Key Technologies for Lane Departure Warning System Considering the Driver Characteristics. Ph.D. Thesis, Huazhong University of Science and Technology, Wuhan, China, 2011. [Google Scholar]
- Ye, X. Adaptive Lane Keeping Assistance System Design Based on Driver’s Behavior. Master’s Thesis, Politecnico di Torino, Torino, Italy, 2019. [Google Scholar]
- Hu, S. Research on Vehicle Driving Safety Warning Model for Driver Assistant System. Ph.D. Thesis, South China University of Technology, Guangzhou, China, 2017. [Google Scholar]
- Zhang, L. A Vehicle Longitudinal Driving Assistance System Based on Self-Learning Method of Driver Characteristics. Ph.D. Thesis, Tsinghua University, Beijing, China, 2009. [Google Scholar]
- Ding, J. Driver-Adaptive Lane Keeping Assistance Control. Ph.D. Thesis, Tsinghua University, Beijing, China, 2015. [Google Scholar]
- Lefèvre, S.; Carvalho, A.; Gao, Y.; Tseng, H.E.; Borrelli, F. Driver Models for Personalised Driving Assistance. Veh. Syst. Dyn. 2015, 53, 1705–1720. [Google Scholar] [CrossRef]
- Lefevre, S.; Gao, Y.; Vasquez, D.; Tseng, H.E.; Bajcsy, R.; Borrelli, F. Lane Keeping Assistance with Learning-Based Driver Model and Model Predictive Control. In Proceedings of the 12th International Symposium on Advanced Vehicle Control, Tokyo, Japan, 22–26 September 2014. [Google Scholar]
- Lehsing, C.; Jünger, L.; Bengler, K. Don’t Drive Me My Way: Subjective Perception of Autonomous Braking Trajectories for Pedestrian Crossings. In Proceedings of the Tenth International Symposium on Information and Communication Technology—SoICT 2019, Ha Noi, Vietnam, 4–6 December 2019; ACM Press: New York, NY, USA, 2019. [Google Scholar]
- Käthner, D.; Griesche, S. Should my vehicle drive as I do? A methodology to determine drivers’ preference for automated driving styles. In Proceedings of the TeaP 2017, Dresden, Germany, 26–29 March 2017. [Google Scholar]
- Chen, J.; Chen, H.; Lan, X.; Yosuke, N.; Atsushi, I. Study on Discrepancy Between Drivers’ Favorable LKA Intervention Timing Characteristics and Their Naturalistic Driving Characteristics. Qiche Gongcheng/Automot. Eng. 2021, 43, 842–850. [Google Scholar] [CrossRef]
- Ran, W.; Chen, H.; Xia, T.; Nishimura, Y.; Guo, C.; Yin, Y. Online Personalized Preference Learning Method Based on In-Formative Query for Lane Centering Control Trajectory. Sensors 2023, 23, 5246. [Google Scholar] [CrossRef]
- Liu, K. Assessment and Analysis of Individual Driving Behavior. Master’s Thesis, North China University of Technology, Guangzhou, China, 2017. [Google Scholar]
- Guo, K. Drivers-Vehicle Close-Loop Simulation of Handling by “Preselect Optimal Curvature Method”. Automot. Eng. 1984, 3, 1–16. [Google Scholar]
- Reński, A. Identification of Driver Model Parameters. Int. J. Occup. Saf. Ergon. 2001, 7, 79–92. [Google Scholar] [CrossRef]
- Wang, W.; Xi, J.; Chen, H. Modeling and Recognizing Driver Behavior Based on Driving Data: A Survey. Math. Probl. Eng. 2014, 2014, 245641. [Google Scholar] [CrossRef]
- Jiang, Y. Research on Personalized Driver Assistance Algorithm for Intelligent Vehicle. Ph.D. Thesis, Jilin University, Changchun, China, 2019. [Google Scholar]
- Leutzbach, W.; Wiedemann, R. Development and Applications of Traffic Simulation Models at the Karlsruhe Institut Fur Verkehrwesen. Traffic Eng. Control 1986, 27, 270–278. [Google Scholar]
- Bifulco, G.N.; Pariota, L.; Brackstione, M.; Mcdonald, M. Driving Behaviour Models Enabling the Simulation of Advanced Driving Assistance Systems: Revisiting the Action Point Paradigm. Transp. Res. Part C Emerg. Technol. 2013, 36, 352–366. [Google Scholar] [CrossRef]
- Dang, J.; Chen, H.; Li, Q.; Watanabe, T.; Hayama, R.; Lou, L. A Method to Set the Target On-Centre Steering Force Characteristic. Proc. Inst. Mech. Eng. Part D J. Automob. Eng. 2016, 230, 1670–1686. [Google Scholar] [CrossRef]
- Bernsteiner, S.; Lindvai-Soos, D.; Holl, R.; Eichberger, A. Subjective Evaluation of Advanced Driver Assistance by Evaluation of Standardized Driving Maneuvers; SAE Technical Paper; SAE International: Warrendale, PA, USA, 2013; Volume 2. [Google Scholar] [CrossRef]
- Mammar, S.; Glaser, S.; Netto, M. Time to Line Crossing for Lane Departure Avoidance: A Theoretical Study and an Experimental Setting. IEEE Trans. Intell. Transp. Syst. 2006, 7, 226–241. [Google Scholar] [CrossRef]
- van Winsum, W.; Brookhuis, K.A.; de Waard, D. A Comparison of Different Ways to Approximate Time-to-Line Crossing (TLC) during Car Driving. Accid. Anal. Prev. 2000, 32, 47–56. [Google Scholar] [CrossRef]
- Dang, J. Steering Characteristics Optimization Based on the Correlations between Subjective and Objective Evaluations. Ph.D. Thesis, Tongji University, Shanghai, China, 2017. [Google Scholar]
- Lan, X. Research on Application of Driver Lane Keeping Characteristic in LKA. Master’s Thesis, Tongji University, Shanghai, China, 2018. [Google Scholar]
- Fang, K. 正交与均匀试验设计 (Orthogonal vs. Uniform Experimental Design), 1st ed.; Science Press: Beijing, China, 2001; pp. 83–112. [Google Scholar]
- Zhong, B. Research on Driver Preference for LKA Intervention Process Based on Objective and Subjective Evaluation. Master’s Thesis, Tongji University, Shanghai, China, 2019. [Google Scholar]
- Zhong, B.; Chen, H.; Chen, J.; Lan, X.; Liu, Q.; Nishimura, Y.; Ando, K. Study on Important Indices Related to Driver Feelings for LKA Intervention Process; SAE Technical Paper; SAE International: Warrendale, PA, USA, 2018. [Google Scholar] [CrossRef]
- Zhou, Z. Machine Learning, 1st ed.; Tsinghua University Press: Beijing, China, 2016; pp. 171–191. [Google Scholar]
- He, X. Study on Subjective and Objective Evaluation of Driver’s Steering Override Strategy for LKAS. Master’s Thesis, Tongji University, Shanghai, China, 2019. [Google Scholar]
- He, X.; Chen, H.; Chen, J.; Ran, W.; Nishimura, Y.; Ando, K. Evaluation and Optimization of Driver Steering Override Strategy for LKAS Based on Driver’s Acceptability; SAE Technical Paper; SAE International: Warrendale, PA, USA, 2018. [Google Scholar] [CrossRef]
- Xu, S.; Peng, H. Design, Analysis, and Experiments of Preview Path Tracking Control for Autonomous Vehicles. IEEE Trans. Intell. Transp. Syst. 2020, 21, 48–58. [Google Scholar] [CrossRef]
- Lei, J.; Wu, H.; Yang, J.; Zhao, J. Sliding Mode Lane Keeping Control Based on Separation of Translation and Rotation Movement. Optik 2016, 127, 4369–4374. [Google Scholar] [CrossRef]
- Zhou, X.; Wang, Z.; Wang, J. Popov-H∞ Robust Path-Tracking Control of Autonomous Ground Vehicles with Consideration of Sector-Bounded Kinematic Nonlinearity. J. Dyn. Syst. Meas. Control 2021, 143, 111004. [Google Scholar] [CrossRef]
- Tian, Y.; Yao, Q.; Wang, C.; Wang, S.; Liu, J.; Wang, Q. Switched Model Predictive Controller for Path Tracking of Autonomous Vehicle Considering Rollover Stability. Veh. Syst. Dyn. 2022, 60, 4166–4185. [Google Scholar] [CrossRef]
- Chen, Y.; Hu, C.; Wang, J. Human-Centered Trajectory Tracking Control for Autonomous Vehicles with Driver Cut-in Behavior Prediction. IEEE Trans. Veh. Technol. 2019, 68, 8461–8471. [Google Scholar] [CrossRef]
- Viadero-Monasterio, F.; Nguyen, A.-T.; Lauber, J.; Boada, M.J.L.; Boada, B.L. Event-Triggered Robust Path Tracking Control Considering Roll Stability Under Network-Induced Delays for Autonomous Vehicles. IEEE Trans. Intell. Transp. Syst. 2023, 24, 14743–14756. [Google Scholar] [CrossRef]
- Liu, H.; Liu, C.; Hao, L.; Zhang, D. Stability Analysis of Lane-Keeping Assistance System for Trucks under Crosswind Conditions. Appl. Sci. 2023, 13, 9891. [Google Scholar] [CrossRef]
- Zhao, B. Research on the Requirement of Adapting the Planned Path of LCCS to Drivers Based on Subjective Evaluation. Master’s Thesis, Tongji University, Shanghai, China, 2021. [Google Scholar]
No. | Unit: m | Unit: m/s |
---|---|---|
1 | 0.0 | 0.15 |
2 | 0.1 | 0.10 |
3 | 0.2 | 0.05 |
4 | 0.3 | 0.20 |
5 | 0.4 | 0.45 |
6 | 0.5 | 0.35 |
7 | 0.6 | 0.25 |
8 | 0.7 | 0.50 |
9 | 0.8 | 0.40 |
10 | 0.9 | 0.30 |
No. | Unit: m/s | Unit: m | |
---|---|---|---|
1 | 0.20 | 90 | 0.3 |
2 | 0.35 | 85 | 0.7 |
3 | 0.50 | 80 | 0.2 |
4 | 0.15 | 75 | 0.6 |
5 | 0.30 | 70 | 0.1 |
6 | 0.45 | 65 | 0.5 |
7 | 0.10 | 60 | 0.0 |
8 | 0.25 | 55 | 0.4 |
9 | 0.40 | 50 | 0.8 |
Category | Subjective Evaluation Question | Scoring Range | Acceptable Range | Optimal Score |
---|---|---|---|---|
LKA intervention timing | : Is the intervention timing acceptable? | [−4,4] | [−1,1] | 0 |
LKA intervention process | : Is the process of vehicle returning to road center acceptable? | [−4,4] | [−1,1] | 0 |
: During the intervention, is the minimum distance to lane line acceptable? | [−4,4] | [−1,1] | 0 |
No. of Driver | Job | Age Unit: Years | Driving Experience Unit: Years |
---|---|---|---|
1 | Researcher | 25 | 4 |
2 | Researcher | 24 | 5 |
3 | Researcher | 24 | 4 |
4 | Researcher | 26 | 4 |
5 | Researcher | 25 | 5 |
6 | Engineer | 38 | 10 |
7 | Engineer | 30 | 3 |
8 | Other | 25 | 3 |
9 | Other | 35 | 8 |
10 | Engineer | 25 | 4 |
11 | Researcher | 24 | 3 |
No. of Driver | Unit: m | Unit: s |
---|---|---|
1 | 0.31 | 0.68 |
2 | 0.66 | 0.62 |
3 | 0.32 | 0.77 |
4 | 0.42 | 0.70 |
5 | 0.39 | 1.08 |
6 | 0.74 | 0.30 |
7 | 0.66 | 0.65 |
8 | 0.35 | 0.39 |
9 | 0.89 | 0.39 |
10 | 0.26 | 0.60 |
No. of Driver | Unit: deg/s | Unit: m |
---|---|---|
1 | 0.45 | 0.51 |
2 | 0.54 | 0.51 |
3 | 0.03 | 0.36 |
4 | 0.11 | 0.47 |
5 | 0.27 | 0.56 |
7 | 0.34 | 0.27 |
9 | 0.34 | 0.19 |
11 | 0.36 | 0.35 |
No. of Driver | Subjective Ratings of Fixed-Characteristic LKA System Unit: - | Does the Driver Find the Fixed-Characteristic LKA System Acceptable? | Subjective Ratings of DALKA System Unit: - | Does the Driver Find the DALKA System Acceptable? |
---|---|---|---|---|
1 | 3.67 | No | 4.08 | Yes |
2 | 3.83 | No | 4.58 | Yes |
3 | 4.17 | Yes | 4.83 | Yes |
4 | 4.17 | Yes | 4.75 | Yes |
5 | 4.67 | Yes | 4.83 | Yes |
6 | 4.83 | Yes | 5.00 | Yes |
7 | 4.50 | Yes | 4.50 | Yes |
8 | 5.00 | Yes | 5.00 | Yes |
9 | 4.33 | Yes | 4.33 | Yes |
10 | 4.67 | Yes | 4.50 | Yes |
11 | 4.58 | Yes | 4.33 | Yes |
12 | 4.33 | Yes | 4.00 | Yes |
Average | 4.40 | 83% | 4.56 | 100% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Chen, J.; Chen, H.; Lan, X.; Zhong, B.; Ran, W. A Method to Develop the Driver-Adaptive Lane-Keeping Assistance System Based on Real Driver Preferences. Sensors 2024, 24, 1666. https://doi.org/10.3390/s24051666
Chen J, Chen H, Lan X, Zhong B, Ran W. A Method to Develop the Driver-Adaptive Lane-Keeping Assistance System Based on Real Driver Preferences. Sensors. 2024; 24(5):1666. https://doi.org/10.3390/s24051666
Chicago/Turabian StyleChen, Jiachen, Hui Chen, Xiaoming Lan, Bin Zhong, and Wei Ran. 2024. "A Method to Develop the Driver-Adaptive Lane-Keeping Assistance System Based on Real Driver Preferences" Sensors 24, no. 5: 1666. https://doi.org/10.3390/s24051666
APA StyleChen, J., Chen, H., Lan, X., Zhong, B., & Ran, W. (2024). A Method to Develop the Driver-Adaptive Lane-Keeping Assistance System Based on Real Driver Preferences. Sensors, 24(5), 1666. https://doi.org/10.3390/s24051666