The results are presented according to the different data collection methods: first, the results of the questionnaires for drivers, then the results of the interviews with pedestrians, and, finally, the results of the interviews with experts from the automotive industry. The data are presented according to the questions the respondents replied to.
3.1. Questionnaire for Drivers
The majority of the respondents (53 out of 70, i.e., 81%) have already heard of driver assistance systems installed in modern cars (
Table 3). To the greatest degree, the respondents seemed to be aware of a facility aiding drivers with parking maneuvers, i.e., Automated Parking. The respondents also frequently mentioned Adaptive Cruise Control (ACC), designed to adjust the speed in order to maintain a safe distance from a vehicle ahead.
Systems designed “to ensure that the vehicle stays in its lane”, known as Lane Keeping Assistance, also appear to be popular and widely used by the drivers. Systems intended to help monitoring blind spots in the adjacent lanes (blind spot monitors) so that the drivers do not miss road users were known to some of the interviewees as well. The respondents also found the Anti-lock Braking System (ABS) and the Electronic Stability Program (ESP), or the Forward Collision Warning (FCW), useful. The Adaptive Light Control, the Pedestrian Protection System, the Traffic Sign Recognition, and “the seat belt reminder system” (commonly not listed as ADAS), a commonplace feature by now, were also mentioned (
Table 4).
The majority of the respondents (43 out of 70, i.e., 61%) stated that they had personal experience with driving a car equipped with ADAS (
Table 3). The respondents replied that they had experience especially with Automated Parking, sensors which issue audio warnings (in general not connected to any specific ADAS), and “beeps notifying the driver about engaging in a reversing maneuver of objects alongside and behind the vehicle” (Forward Collison Warning, Lane Departure Warning). Adaptive Cruise Control (ACC), too, was often brought up as “a great thing that they very often use”. Blind spot monitors and Emergency Braking Assistants were also mentioned. Hill Descent Control, Adaptive Light Control, “seat belt reminders”, and “ice and snow warnings” (these last two not usually mentioned as ADAS) appeared in the responses only sporadically (
Table 4).
An automated pedestrian detection system that would, for example, warn the driver both “on the dashboard and on the head-up display” predominated in the respondents’ answers to the question as to which assistance system should be able to help drivers avoid collisions with pedestrians, or which assistance system they would appreciate. In particular, the drivers would appreciate sensors that would warn them “during low visibility and in night-time conditions” and systems that “would monitor road shoulders and estimate the risk of a pedestrian stepping into” the road. In addition, systems featuring audio signals to alert the driver about pedestrian crossings or forward collision warning facilities were mentioned. According to one survey participant, it would be useful to alert the driver about the presence of pedestrians by “vibrations in the steering wheel”. Another respondent came up with the idea of using “infrared radiation to detect pedestrians in a night-time setting” or direct “interaction of vehicles with traffic systems” such as pedestrian crossings with traffic lights. Other respondents, on the other hand, criticized the prospects of any other systems, arguing that the “interference of such assistance systems with driving may also be counterproductive, as it may compromise concentration and attention on the driver’s part”.
A smaller proportion of the respondents (10 out of 70, i.e., 14%) reported their personal experience with the assistance system mounted in the car that they were driving helped them to avoid a collision with a pedestrian (
Table 3). The respondents stated that they were helped in avoiding a collision with a pedestrian by an “automatic pedestrian detection system” (Pedestrian Protection System) or an assistance system alerting the driver about objects in the vicinity of the car. By means of the vehicle-mounted equipment, they received a “warning on the head-up display and an audio signal”. The anti-lock braking system (ABS) helped them in emergency braking. Finally, they would welcome an assistance facility that would alert the driver about pedestrians by “making the steering wheel vibrate and producing an acoustic signal” (
Table 4).
The respondents believe that the Pedestrian Protection System works very well. The specific functionality that was mentioned most often was the combination of visual and acoustic signals, i.e., parallel activation of a warning icon or indicator on the dashboard and “an audio signal similar to the one emitted when one is coming too near to a car ahead”. They would also appreciate the pedestrian being shown on the head-up display. Some would prefer a vibration in the steering wheel over an acoustic alert, while some, on the contrary, find this totally unsuitable. Others would prefer a combination of both such warnings. It was often brought up that an unpleasant sound or a “headphone jammer”, for example, might suffice. To a smaller degree, the respondents suggested only a visual pedestrian alert on the dashboard or windshield. On the other hand, they also mentioned quite frequently “the automatic slowing down of the car” in combination with sensory warnings. Their idea was that “the fuel supply should be stopped at least enough to prevent the car from accelerating”. One of the participants noted that what matters is that “the driver takes notice of the warning without him having to pay attention to anything other than the current traffic” rather than the method itself.
3.2. Questionnaire for Pedestrians
The respondents who stated that they had already heard of driver assistance systems (39 respondents out of 60, i.e., 65%) were asked which car driver assistance technologies they knew (
Table 5). Most frequently, the study participants mentioned parking systems (Automated Parking) involving sensors and cameras for automated parking. Numerous responses referred to blind spot monitors, Forward Collision Warning, Automated Braking System (ABS), or Adaptive Cruise Control. Lane departure warning systems and those monitoring a safe distance from the vehicle ahead also featured frequently in the answers. The respondents were also aware of other car-mounted assistance facilities, such as devices providing for the automated detection of pedestrians (Pedestrian Protection System), systems designed to monitor driver fatigue (Driver Drowsiness Detection), Hill descent control, Night vision, and obstacle avoidance assistants such as FCW (
Table 6).
For the next question, the respondents were asked how, in their opinion, an automated pedestrian detection system should work. The great majority of the responses referred to combinations of visual, audio, and tactile impulses warning the driver against an imminent collision with a pedestrian appearing near the roadway. Some would prefer “a warning signal (pedestrian icon) flashing on the dashboard and the head-up display”, supported at night-time by a simultaneous warning sound. Others argued that just a single alert, such as a “loud beep”, or, conversely, only a flashing “pedestrian sign on the dashboard” would be totally sufficient. There were also opinions that “vibrations and beeping might distract the driver’s attention”, but others opted for a “combination of a vibrating steering wheel and acoustic signals”. Suggestions for “the car being automatically slowed down after the sounding-off of a warning signal” represented the opinions of only a few. The alternative combining of all the stimuli, i.e., “an acoustic signal together with a message shown on the head-up display and a vibrating steering wheel and driver’s seat warnings”, was favored by the respondents only sporadically. In general, the respondents found any sensory warning “optimal; nevertheless, the device should be calibrated in such a way as not to distract the driver unnecessarily by alerting him constantly about pedestrians”. Thus, it is necessary to find a form of warning that would be easily detectable and quickly understood by the driver. Ideally, it should “make him able to take quick and correct action rather than over-reacting and panicking”.
The respondents were asked whether they would agree with some advanced technological devices being used to monitor the movement of pedestrians near the roadway and whether such data could be used with autonomous vehicles. They were also asked to provide the reasoning for their agreement or disagreement. The study participants’ responses suggested very sporadic approval of such measures. They would agree with their “location being tracked via their telephone or their personal ID bearing a mandatory chip provided that it would improve their safety”. However, the majority of the responses were negative. Some even considered such technology useless, “as everybody is responsible for himself or herself and it should especially apply to using a road or pavement”. Other respondents were concerned about misuse, which logically ensues from the application of such systems. “Simply anything can be misused.” The respondents brought up risks such as those associated with the tracking of the movement of people, the compromising of personal freedom, and other forms of commercial use. In addition, they reflected on “having to carry such a device on themselves at the time, which would be limiting and unpleasant, like a ball and chain”. The research participants also pondered the technical feasibility of such an approach: “How would this system apply, for example, to foreigners, older citizens, or children and animals?” Some respondents believe that “a driver could become so accustomed to the help provided by assistance programs that he would pay less attention to driving and overlook pedestrians who might not have the chip”. Others asked similar questions, such as whether “one could rely on pedestrians’ 100% discipline, that they did not forget” to take their smart device or wallet along with them. Moreover, what if the pedestrians “got used to this phenomenon to such a degree that they became less alert and relied more on technology”? It was also said that pedestrians’ and drivers’ responsibilities related to road safety should not be “taken over by technology”, that it would make more sense to “put chips in footwear”, and to find other technical solutions or “introduce the obligation to wear reflective elements”. Some of the responses included very strict views, such as that “if an autonomous vehicle is to be allowed to participate in road traffic, it would have to be able to recognize a pedestrian safely even without additional devices with which the pedestrian would be equipped”. That is, the autonomous system should be “reliable even if the other party does not fulfil its obligation”.
Finally, the respondents were asked to answer the question whether it was important for them that semi- or fully automated cars should be identified in such a way as to be recognizable by pedestrians. A slight majority of the respondents (33 out of 57) from among the pedestrians prefer that those vehicles should be identified, while the remaining 24 respondents do not find it necessary (
Table 5).
3.3. Expert Interviews
We approached development managers, technological designers, and engineering trainers from five different companies that engage in the development or implementation of in-car assistance systems and asked them about their opinions on the systems intended to enhance the safety of pedestrians.
When asked about the driver assistance systems focusing primarily on pedestrian safety, the expert from TÜV SÜD Czech Republic noted “what is referred to as a braking assistant, which, for several years now, has been mandatory equipment of all European passenger cars and comes under the pedestrian protection domain in legislative terms”. In addition, he indicated the Automatic Emergency Braking system (AEB), designed to detect an obstacle ahead of the car and automatically activate the braking system. While this assistance facility is no longer a required component of car equipment, it is not unusual that people demand to have this item installed for an extra charge. The expert added that thanks to the new EU regulation on general safety, within the next decade we can expect that AEB will become an integral part of the equipment of all newly-produced passenger cars. The technical project leader for Porsche Engineering Services, s.r.o., and the expert from Hella CZ, rank among proponents of the primary active safety systems ACC, i.e., Adaptive Cruise Control, which by now have incorporated functions providing for the protection of any pedestrian on the roadway. The expert from the Systems and Functions Department of Valeo R&D Prague pointed out a completely new system, Turning Assistant (available e.g., in the Audi Q7 or Volvo XC90), will be mandatory for lorries from 2022 on and which may be expected in the upcoming years to become another assistance innovation for drivers of passenger cars. Systems such as blind spot monitors, Automatic Parking, or generally cameras should not be omitted either, as their secondary functions can rightly be associated with the protection of pedestrians. The expert from the company KPIT (a global technology company) adds that these functions, and others that use specialized night-vision cameras, too, are generally referred to as “pedestrian detection for day- and night-time” ones.
Let us now describe in greater detail how some of the aforementioned assistance systems work. Generally integrated within the power brake unit, the braking assistant is a function which “compensates for less experienced drivers’ tendency to reduce instinctively the force applied to the brake pedal during an emergency braking maneuver”. In this way, it maximizes the braking performance of the car and reduces its braking distance.
On the other hand, the emergency braking system (also referred to as AEB or Front Assist), as its name implies, is a function designed “to prevent a possible or inevitable collision not only by enhancing the braking action, but also by bringing the vehicle automatically to a complete halt”. “The most advanced systems of today are capable of estimating the danger of a collision with a pedestrian in various situations, as well as the pedestrian’s intention to step into the roadway or not.” The system warns the driver, first generally by an acoustic signal, visually via a display, or, less commonly, by activating a tactile alert. If the driver fails to respond to the warning, the car will initiate the automated braking procedure.
The main function of Adaptive Cruise Control (ACC) is to follow the car ahead and maintain a safe distance from it. In this way, for example, a car can stop on its own behind a car at the end of a queue or at a red light. “The follow-to-stop (-and-go) feature makes it possible for a car to move away autonomously if the car in front of you gets under way… however, this system involves one safety issue: it does not assume that somebody could get out of the car or step into the roadway and get in front of your car.” As an innovation, a pedestrian protection facility is often incorporated, either as an additional advanced feature of the system or in the form of a confirmation button that the driver needs to push to allow the car to drive off on its own.
Systems using windshield cameras, optic LiDARs (Light Detection and Ranging), or regular radar operate on a similar principle. “When detecting an obstacle on a collision course that is motionless or moving at a significantly lower pace, they activate the warning sequence or make an emergency stop.” Moreover, innovations such as Turn Assist indicate to lorry drivers objects on the right-hand side of the vehicle, which is “where they tend to be overlooked while making a right turn, especially under adverse visibility conditions, such as in the dark or rain”.
We also asked what other assistance systems can secondarily contribute to pedestrian safety. The experts indicated that, generally speaking, this applies to all the systems that help drivers maintain a good view out of the car, including “ventilation, wipers, intelligent headlamps, and infracameras”. Additionally, the experts believe that “all the ADAS functions which concern lane-changing or line-keeping and autonomous driving features contribute to the protection of pedestrians by simply regarding them as a traffic element”. Parking and reversing assistants also have major implications for the safety of people around the car. The Driver Monitoring System is beneficial in terms of safety, too. In principle, this assistance facility involves the monitoring of the driver’s alertness. Signals are activated when the driver is found to be inattentive to the situation ahead of the vehicle because of, for example, his or her holding a mobile phone, turning to another person in the car, or being drowsy. “A system is currently under development which, when inattentiveness is detected, should be able to activate the Lane Departure Warning (LDW) system automatically until the driver can resume driving, which would actually be a way of protecting both him or her and any pedestrians on the pavement.” Hence, it can be summarized that, more or less, all the systems which prevent any collision contribute significantly to better pedestrian safety. “On the other hand, an excess of assistance systems may compromise the driver’s attention. It is thus always about the driver, his or her abilities, and the discipline of the pedestrians.”
We were also interested in the direction of the latest development of the systems concerned with pedestrian safety. The expert from Valeo stated that the development was mainly heading towards enhancing the degree of protection for all vulnerable road users by reducing the error rates of the systems. Another expert added that “the primary problem in terms of protecting pedestrians is the early detection of whether he or she intends to step into the roadway”. Efforts are being made to improve the range, quality, and accuracy of radar sensors and cameras, especially those intended to detect stationary objects by, for example, the efficient integration of both radar and camera or infracamera systems. Designers also endeavor to improve software and develop artificial intelligence, leading to data analysis that is as fast and flawless as possible. It is key to arrive at a point of evaluation where the highest possible number of crashes is prevented while maintaining the fluency of traffic. “This is what is the greatest technological challenge of the present.” Autonomous driving cannot be omitted either, although the experts assume that it will be introduced incrementally. It is expected that “different elements of driving will be handed over to the machine step by step while assessing how this proves itself, whether the system is better than a human”. ADAS has five levels of autonomy altogether (see
Figure 1 at the beginning of this paper). At this point, driving assistants can be considered as associated with the first two levels. It is not until the fifth level, L5, that a vehicle is under full autonomous control. The experts also see potential in the car communicating with the infrastructure, although at the moment we lack the relevant infrastructure, and the applicable technologies are still “in nappies”. Additionally, the idea of pedestrians being equipped with devices facilitating their detection while walking on the street seems difficult to conceive of in many respects.
The expert from Hella CZ expects that within the next five years all new cars will feature an Emergency Braking System (AEB). He adds, nevertheless, that the majority of car manufacturers offer such a system as a routine element, at least in mid-class vehicles.
Across all the expert respondents, there was agreement that the main move forward can be expected particularly in technological improvements, greater numbers of sensor devices, and greater reliability of the systems that are already available. “I also assume that they will become accessible for a wider group of people, not only for premium makes,” adds one of the experts. “The improvement of systems will entail the need for significant computing performance on board cars, which will not be cheap, and they will increase the complexity, weight, and price of the car.” It will depend a great deal on the current development of the economic situation and, therefore, he does not dare estimate whether autonomous driving can be expected as soon as within a five-year time frame. “ADAS functions capable of detecting and alerting about pedestrians are already included in luxury cars today,” and so he assumes that “in no more than five years we will be seeing autonomous vehicles without drivers”.
What else can be conceived or done to ensure the maximum protection of pedestrians? The experts believe that pedestrian safety would benefit from better infrastructure. Its improvement would not only require great investment, but might not even be technically possible. Therefore, it is essential to concentrate on ways of improving the scanning of the surroundings of the car, to assess objects with sufficient notice, and to predict contingencies. “In order to take a step forward as regards autonomous driving, it is important to increase the computing capacity of the systems first. Then we can think about what is lacking at present–communication among vehicles.” For example, 5G networks could be useful for data transmission, but the question remains whether the data flow would be fast enough. Today, we already have fully autonomous vehicles which are capable of driving on their own under ideal conditions, but we cannot consider them completely safe, as they cannot communicate among themselves and with their surroundings. Thus, they cannot, for example, exchange warnings about an obstacle in each other’s paths. Radar can see several cars ahead, but not a shielded pedestrian, unfortunately. Bluetooth technologies were tested at one time as a way of tracking pedestrians. A sensor built into the car could detect a pedestrian on the basis of his or her mobile device. “It is more realistic, though, that street cameras will be preferred for this purpose in the future, as they will logically see farther and communicate the information to the passing cars,” concludes the expert.
Furthermore, we were interested in the experts’ opinions about fully or semi-autonomous vehicles in urban traffic being identified as such. The expert from Hella CZ thinks that an autonomous vehicle should be made distinctive in traffic so that pedestrians or other drivers know that the car is self-controlled and the driver thus does not necessarily need to look at the road ahead. He considered the options: “In terms of the color spectrum, there are not many possibilities left. Blue is taken by the rescue and law enforcement services; white is present in lights; yellow is used for signaling; and red is used for rear marker lamps.” One of the few colors of the visible spectrum that is not taken yet is green. One possibility would thus be an RGB strip fitted around the entire vehicle in such a way that after “the right function is turned on, an illuminated string of lights would run along the car, as one could already see on certain autonomous AUDI prototypes”. On the other hand, other experts hold that at this point, it is utterly irrelevant to address the identification of cars which are not here yet, let alone when at the moment the development is more inclined towards semi-autonomous cars, or moreover to be operated on roads that would be off-limits for pedestrians. The identification of the cars is also opposed by an expert who finds it discriminatory and argues that “those cars will adhere to the Traffic Code and their driving will be set very conservatively because of the emphasis on safety”. Such a car, for example, will never put itself in a situation which it will assess as dangerous on the basis of its calculations. This is supported by another expert who notes that “autonomous cars are mainly programmed defensively, which means that they seek to foresee things, and when they see a screened area, for example, they would rather slow down”. “The whole system is primarily designed in such a way as to ensure maximum safety for pedestrians.”
Let us conclude by summarizing our respondents’ ideas of what urban road traffic might look like in about 20 years. “Traffic itself does not seem likely to change because it is determined by people’s need to travel rather than by technical improvement of cars. But if there are autonomous cars, we can expect it to be more fluent”… “Theoretically, the accident rate will go down and, I hope, the air will improve thanks to a greater number of electric cars.” The increase in the number of electromobiles is subscribed to by another expert, who also wishes for car traffic to be pushed out of city centers. Moreover, he expects that what he refers to as “autonomous people-movers” “will start emerging in cities, replacing taxi services, partly public transportation, and, to some degree, individual ownership of cars”. Another expert, too, expressed an optimistic outlook for the future: “In 20 years, there will be more autonomous vehicles and structure paths for pedestrians to walk or cross safely; there will be a lower possibility of accidents and collisions.” Finally, another expert is reluctant to make predictions but expects a growing trend in using car-sharing services. He thinks, however, that “progress is not likely to be so quick as to see any radical changes”. Additionally, if autonomous cars are in use by then, it will still take several years to renew the car fleet.