Next Article in Journal
Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology Using Large Language Models—A Case in Optimizing Intermodal Freight Transportation
Previous Article in Journal
A Unified Knowledge Model for Managing Smart City/IoT Platform Entities for Multitenant Scenarios
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Impact of Privacy Filters and Fleet Changes on Connected Vehicle Trajectory Datasets for Intersection and Freeway Use Cases

by
Enrique D. Saldivar-Carranza
*,
Rahul Suryakant Sakhare
,
Jairaj Desai
,
Jijo K. Mathew
,
Ashmitha Jaysi Sivakumar
,
Justin Mukai
and
Darcy M. Bullock
Joint Transportation Research Program, Lyles School of Civil and Construction Engineering, Purdue University, West Lafayette, IN 47907, USA
*
Author to whom correspondence should be addressed.
Smart Cities 2024, 7(5), 2366-2391; https://doi.org/10.3390/smartcities7050093
Submission received: 6 August 2024 / Revised: 27 August 2024 / Accepted: 28 August 2024 / Published: 30 August 2024

Abstract

:

Highlights

What are the main findings?
  • Data fuzzification to ensure privacy and fleet mix changes in a current commercial connected vehicle (CV) trajectory dataset resulted in a data penetration decrease of ≤0.5%, and almost 70% of analyzed road segments experienced a reduction in the number of CV samples available for analysis when contrasted with a comparable historic CV dataset without fuzz-ified records.
  • Similarly, around 70% of 26,291 intersection movements evaluated showed a reduction in the number of CV trajectories available for analysis.
What are the implications of the main finding?
  • Even though there is a general reduction in the number of samples available for analysis with the current dataset, the authors believe that it provides enough information to derive most relevant trajectory-based mobility studies.
  • The implemented data fuzzification, which consists of the truncation of coordinates within ½ mile of frequently visited destinations (i.e., location blurring), may induce unintended biases for movement level intersection studies. Therefore, estimated intersection performance and the interactions between movements need to be carefully evaluated before taking mitigation ac-tivities.

Abstract

Commercially available crowdsourced connected vehicle (CV) trajectory data have recently been used to provide stakeholders with actionable and scalable roadway mobility infrastructure performance measures. Transportation agencies and automotive original equipment manufacturers (OEMs) share a common vision of ensuring the privacy of motorists that anonymously provide their journey information. As this market has evolved, the fleet mix has changed, and some OEMs have introduced additional fuzzification of CV data around 0.5 miles of frequently visited locations. This study compared the estimated Indiana market penetration rates (MPRs) between historic non-fuzzified CV datasets from 2020 to 2023 and a 5–11 May 2024, CV dataset with fuzzified records and a reduced fleet. At selected permanent interstate and non-interstate count stations, overall CV MPRs decreased by 0.5% and 0.3% compared to 2023, respectively. However, the trend in previous years was upward. Additionally, this paper evaluated the impact on data characteristics at freeways and intersections between the 5–11 May 2024, fuzzified CV dataset and a non-fuzzified 7–13 May 2023, CV dataset. The analysis found that the total number of GPS samples decreased 10% statewide. Of the evaluated 54,284 0.1-mile Indiana freeway, US Route, and State Route segments, the number of CV samples increased for 33.8% and decreased for 65.9%. This study also evaluated 26,291 movements at 3289 intersections and found that the number of available trajectories increased for 28.3% and decreased for 70.4%. This paper concludes that data representativeness is enough to derive most relevant mobility performance measures. However, since the change in available trajectories is not uniformly distributed among intersection movements, an unintended sample bias may be introduced when computing performance measures. This may affect signal retiming or capital investment opportunity identification algorithms.

1. Introduction

Roadway infrastructure is critical for moving an ever-increasing number of people and goods. There are over 4 million miles of public roadways in the United States [1]. In 2023, there were over 3.2 trillion vehicle miles traveled in the country [2], a 13% increase from 2003 [3]. It is estimated that each year, motorists pay over $1000 in wasted time and fuel while traveling the transportation networks [1]. Therefore, it is important for transportation agencies to actively monitor the performance of their managed mobility infrastructure to identify improvement opportunities and determine the best allocation of limited funds.
Interstates, US Routes, State Routes, and arterials serve most of the traffic demand [2]. Several state agencies liaise with Traffic Management Centers (TMCs) to monitor these types of roadways and coordinate incident response [4]. Historically, a network of roadside sensors and intelligent transportation system (ITS) cameras installed statewide, as well as segment-based crowdsourced speed and travel time data, have been used to assess prevailing traffic conditions and identify challenges [5,6]. However, sensors and ITS cameras only provide location-specific information, require regular maintenance, and are difficult to observe on a large scale. Furthermore, crowdsourced probe vehicle speeds and travel time data are usually aggregated, which complicates the detailed analysis of traffic conditions often requiring granular information.
Roadway intersections are another critical component of transportation networks. There are over 400,000 signalized intersections in the United States, which are estimated to contribute up to 10% of all traffic delay on the National Highway System [7]. A properly managed traffic signal can reduce congestion, enhance mobility, and decrease delays and the number of vehicles stops [8,9]. Over the last two decades, agencies have implemented Automated Traffic Signal Performance Measures (ATSPMs) to proactively assess intersection operations. ATSPMs are visualizations and tools derived from traffic signal controller high-resolution (tenth-of-a-second) output and detector data [10,11]. Actionable insights are derived thanks to the data’s high reporting intervals [12]; however, ATSPMs are difficult to scale, and the estimation of performance measures is sensitive to traffic conditions [13] and detector configuration [14].
In recent years, commercial connected vehicle (CV) trajectory data has emerged as an alternative dataset to actively monitor roadway and intersection performance [13,15,16,17]. The main benefit of this dataset is that it allows for the accurate estimation of traffic conditions at a variety of levels, ranging from the analysis of localized intersection movements [13] to nationwide mobility [18].

1.1. Connected Vehicle Trajectory Data

It is anticipated that in 2025, 470 million CVs will be in operation in the US, Europe, and China [19]. A study of perhaps the largest provider of CV data in 2022 reported that, on average, one in every twenty vehicles in the United States provided telematics-based CV data through a data broker that could be used to estimate interstate and arterial performance measures [20].

1.1.1. Description

Crowdsourced CV trajectory data consist of sets of waypoints that describe the journey that equipped vehicles undertake as they traverse the roadways. The waypoint reporting interval for the same vehicle is usually in the order of a few seconds, and the spatial accuracy is usually in the order of 2–3 m. Every waypoint has the following descriptive information attached: latitude, longitude, timestamp, speed, heading, and an anonymous trip identifier. By chronologically linking individual waypoints with the same trajectory identifier, the journey of a vehicle can be obtained.

1.1.2. Applications in Transportation

Commercial CV trajectory data provide accurate information of vehicles’ journeys at virtually any scale. This characteristic makes them a good candidate for a variety of transportation studies.
Sakhare et al. have leveraged the CV dataset to measure and visualize freeway conditions, evaluate incident response, and assess work zone performance [15]. State transportation agencies, such as the Indiana Department of Transportation (INDOT), use CV data, in conjunction with other ITS assets, to monitor roadway performance and safety [21].
CV trajectory data have also been used to evaluate intersections. Various techniques have been developed to derive traffic signal performance measures [13,16,17] with the objective of identifying challenges and signal retiming opportunities [13]. Additionally, CV-derived traffic signal, roundabout, and stop-controlled intersection performance measures have been used to locate statewide capital investment opportunities [22], helping agencies perform data-driven investment decisions.
Other studies have used CV trajectory data for a wide range of purposes. Desai et al. used CV data to assess electric vehicle (EV) usage and charging infrastructure [23]. Alsahfi et al. created an algorithm that can create and update road maps and identify their characteristics from vehicle trajectories [24]. Further research has focused on the estimation of infrastructure characteristics from CV data, such as traffic volumes [25], vehicle miles traveled [26], roadway speeds [27], and traffic signal timing [28,29].

1.2. Motivation and Objective

As the commercial CV data industry matures, the dataset characteristics also evolve with the objective of ensuring the privacy of motorists that anonymously provide their journey information while attempting to maintain the scale and granularity needed for transportation studies. One such change in the CV dataset that occurred in 2024 is the fuzzification of trajectory waypoints. Waypoint fuzzification entails the distortion of selected records to protect sensitive information in a manner that attempts to minimize information loss.
The fuzzification approach implemented in a current CV dataset truncates latitude and longitude coordinates to two decimal points (location blurring) when vehicles are located within 0.5 mi of frequently visited locations. Furthermore, when a waypoint is fuzzified, speed and heading values are not available.
Qualitatively, the impact that this fuzzification has on data availability and distribution is shown in Figure 1. Figure 1 compares 10 min of data collected on the same day-of-week (DOW) and time-of-day (TOD) during the second week of May between a historic 2023 dataset with non-fuzzified waypoints (Figure 1a) and a current 2024 dataset with fuzzified waypoints (Figure 1b). It is important to note that, in addition to the fuzzification difference, the historic dataset is comprised of more OEM fleets than the current dataset, which is by itself expected to affect the level of representativeness.
In Figure 1, the overall waypoint sample size decreased 27% from the historic to the current dataset. Of all waypoints available for the region shown in Figure 1b, 6% are fuzzified (callout i shows the location of the truncated GPS coordinates), and the rest are available for analysis. Areas on and between ramps (RA), signalized intersections (S), and roundabouts (RO) saw fewer sampled waypoints. In particular, RA1 and S1 show a noticeable decrease of traversing vehicles.
As transportation agencies, the private sector, and academia continue to use and invest in CV trajectory data, it is important to assess the impact that privacy filters (i.e., fuzzification) and fleet changes may have on derived studies. Since no previous study has provided such an analysis, the objective of this study is threefold:
  • Evaluate the current CV market penetration rate (MPR) and compare it to previous years’ estimations.
  • Assess the impact of privacy filters and fleet changes on interstate, US Route, and State Route coverage.
  • Evaluate the change on available vehicle trajectories for analysis by movement at traffic signals, roundabouts, and all-way stops.
These analyses provide stakeholders with insights on the data representativeness changes and possible effects on related studies. All assessments are conducted using statewide Indiana CV trajectory data.

2. Market Penetration Rates

The MPR provides agencies with a key metric to answer how representative the data are of the actual traffic and is essential for building confidence in the data. The MPR is the estimated percentage of the vehicles on the roadways that provide their trajectory information.
The MPR of CV data with fuzzified records was evaluated over a week from 5–11 May 2024. The actual traffic volume information was collected from INDOT’s count stations. A majority of the count stations in Indiana use loop detectors [30,31,32] to count and classify vehicles. A total of 28 count stations that were operational during the entirety of the same week, as shown in Figure 2, were chosen for analysis. Of the 28 stations, 10 were along interstates and the remaining 18 were along non-interstate roadways that cover various geographies in Indiana.
A virtual box a quarter-mile long and as wide as the road width was created around every count station. Unique journey identifiers were counted within this box and assumed as the trajectory counts for the CV data. Heading information from individual waypoints from the CV data was used as a filter to exclude journeys along a different route and direction. Since the GPS coordinates of fuzzified records are truncated, they were excluded from the MPR analysis. The MPR for a count station was calculated using the following equation:
P n   C V = T n C V V n   100
where P n   C V is the MPR of count station n, T n C V is the number of unique trajectories from the CV data within the quarter-mile-long bounding box near count station n, and V n is the volume of vehicles from the same count station over the same time period.
Figure 3 and Figure 4 show vehicle volumes, trajectories from CV data, and MPR by count station along interstate and non-interstate roadways. On 10 interstate locations, the vehicle volume ranged from 0.11 to 0.61 million over a week. During the same week, the identified CV trajectories ranged from 5.1 to 25.4 thousand. The MPR ranged from 3.5% to 6%. On 18 non-interstate locations, the vehicle volume ranged from 0.007 to 0.53 million and the identified CV trajectories from 0.28 to 19 thousand. The MPR ranged from 2.4% to 10.2%.
The reported overall MPR for interstate and non-interstate is given by Equation (2):
P r C V =   n     R T n C V n     R V n   100  
where r I n t e r s t a t e ,   N o n - I n t e r s t a t e   , R is the list of count stations along r, and P r C V is the overall MPR of the CV data. Due to the variation in volume at select count stations, total CV trajectories and traffic volumes across the analysis period were considered for the overall MPR calculations. This is also a comparable metric with changing stations and analysis period days across the years. In 2024, the overall MPR on interstates was reported as 4.6% and on non-interstates it was 5%.

MPR Comparison with Previous Years

The 2024 MPR was compared to reported values in previous studies from 2020 to 2023 [20,33]. Table 1 presents a summary of the MPR analysis across the five years. The number of days analyzed during each year and the number of count stations evaluated varied depending upon the availability of the data. However, a minimum of a contiguous one-week period and at least seven count stations by road type were assessed during any of the years. Analysis was conducted during the month of August in 2020 and 2021 and in May for 2022, 2023, and 2024.
The MPR increased every year from 2020 to 2023 along both interstate and non-interstate roadways. Interstate MPR increased from 4.4% to 5.1%, whereas non-interstate MPR increased from 4.6% to 5.3% during this period. The increase may be due to the adoption of newer CVs and/or changes in commercial arrangements in the data supply chain. In 2024, the MPR dropped 0.5% on interstates and 0.3% on non-interstates. The reduction in MPR is possibly due to the fuzzified records, a reduced fleet, and/or a change in the data supply landscape.
Due to changes in operating conditions, maintenance issues, or work zone activity, not all count stations are available across the five years. For comparison of MPR across the years at a count station level, 12 common count station locations were compared from 2021 to 2024. The details of these 12 count stations are shown in Table 2. Highway or roadway details with approximate mile marker (MM) information is also provided in Table 2.
Figure 5 shows MPR values for each of the common 12 count stations from 2021 to 2024, colored by the roadway type. The dotted line represents overall MPR calculated using Equation (2) across all the available stations during that year. The relative position of the count stations remained the same over the years.

3. Interstate, US Route, and State Route Coverage

Observing changes in CV data representativeness on interstates, US Routes, and State Routes is vital for agencies, as these road networks make up a majority of the roadway infrastructure maintained by a state. Knowing the representativeness of CV data will help identify opportunities for utilizing this CV data for continuous roadway mobility monitoring statewide, especially in locations with no existing sensor infrastructure. A total of twelve interstates (pink), four US Routes (blue), and three State Routes (orange) were analyzed in this section, as shown in Figure 6. Interstate 80 (I-80) was excluded from the analysis owing to its full concurrency in the state of Indiana with routes I-94 and I-90.
Each route was divided into tenth-of-a-mile segments (0.1 miles) for the analysis and for consistent comparisons between multiple years of data. A corresponding geospatial polygon for each such 0.1-mile segment was created, and CV data were matched to these segments to determine the exact mile-marker location along a route through which a CV waypoint passed. Following this geospatial matching process, distinct counts of CV journeys (essentially unique journey identifiers) passing through each 0.1-mile segment were computed for two analysis weeks—namely, 7–13 May 2023 (historic, non-fuzzified), and 5–11 May 2024 (current, fuzzified). The 2024 dataset contains fuzzified records that cannot be considered because their GPS coordinates have been truncated and their geospatial representation does not indicate their actual location. Furthermore, their lack of heading information makes it difficult to assign them to specific directions of travel, and the lack of speed information makes them lose significant value for various freeway studies that rely on this characteristic.
The study location for this section is represented by a total of 54,284 0.1-mile segments of roadway in Indiana, with 26,838 of them being on interstates, 17,640 on selected US Routes, and 9806 on selected State Routes. Table 3 shows that nearly 22% of interstate segments, 41% of US Route segments, and 55% of State Route segments observed an increase in CV journeys from 2023 to 2024. A very small percentage of segments showed no change, while an even lower percentage of segments could not be directly compared due to missing data in either of the analysis years.
Figure 7 shows a box-and-whisker diagram of the network level percentage and absolute CV journey changes observed for the three types of routes analyzed. General trends show that the median percentage and absolute change in CV journeys for interstates is the highest, followed by slightly lower changes in US Routes and a median change of nearly 0% on State Route segments.
A cumulative frequency distribution (CFD) of all 0.1-mile segments and their percentage and absolute changes in CV journeys between the two years is shown in Figure 8a and Figure 8b, respectively. Median values for percentage change in journeys range from −4.95% for interstates to −1.96% for US Routes to +0.98% for State Routes. Correspondingly, median values for absolute change in journeys range from −289 for interstates to −37 for US Routes to +10 for State Routes. A number of segments showed reductions in CV journeys of more than 2000, possibly due to construction-related road closures significantly dropping volumes over those segments. Similarly, a number of segments showing increases in CV journeys of more than 2000 were a result of construction work being completed and converting an arterial into an interstate, thus leading to a significant rise in CV traffic passing through that segment.
Figure 9 documents percentage and absolute changes in CV journeys on the three types of routes as a Pareto-sorted column plot with each 0.1-mile segment represented. As evidenced by the zone of no-change gradually moving from left to right for interstates, US Routes, and State Routes, the highest percentage decrease in journeys is seen among interstate segments (78.2%), while the lowest percentage decrease in journeys is seen among State Route segments (44.8%).
Figure 10 shows a map-based visualization of the change in the number of CV journeys across the three types of routes. To remove outliers or minor changes, any segments with percentage changes in CV journeys between −5 and 5% were ignored in Figure 10a–c and any segments with absolute changes in CV journeys between −100 and 100 were removed in Figure 10d–f.
Figure 10a shows that a majority of rural interstate segments showed a decrease in journeys (−50% to −5%). Some segments at the Indiana–Ohio border on I-90 and I-74 showed increases in journeys, which may be attributable to construction projects in 2023 that were completed in 2024 leading to higher volumes or off-interstate construction projects causing additional diverting traffic to utilize the interstate. Segments highlighted in red in Figure 10d–f near the Indianapolis region in central Indiana are majorly attributable to a construction project in the northeast corner of Indianapolis that resulted in reduced or otherwise rerouted traffic through the area.
In general, the slightly lower MPR as documented in the preceding section, coupled with a smaller fleet of OEMs being represented in the CV data and the associated fuzzification can together be assumed to cause the reduction in observed CV journeys in 2024 compared to 2023 for interstate, US Route, and State Route segments. These visuals will be vital for agencies and practitioners in evaluating the usability of this novel form of CV data and identifying any significant changes that may bias year-by-year comparisons with CV data from 2020 to 2023.

4. Intersection Coverage

This section compared the number of vehicle trajectories available for analysis at 2827 signalized intersections, 158 roundabouts, and 304 all-way stops in Indiana between the historic 7–13 May 2023, dataset without fuzzified waypoints and the current 5–11 May 2024, CV dataset with fuzzified waypoints.
For a vehicle trajectory to be available for performance analysis, its movement at the intersection, that is, its direction of travel (i.e., northbound, eastbound, southbound, and westbound) and its turn type (i.e., right, through, and left), need to be identified. Therefore, the trajectory of each sampled vehicle contained in the historic and current CV datasets near the analyzed intersections was analyzed and, if possible, assigned an intersection movement [13].
Similar to the previous section, any fuzzified waypoint has truncated GPS coordinates with missing heading information, making it impossible to determine its trajectory’s movement through the intersection. Therefore, fuzzified waypoints are not available for intersection movement performance analysis. The results of the differences between the two datasets at distinct analysis levels are presented as follows:
  • First, the distribution of the change in available trajectories for analysis at the movement level is discussed.
  • Then, the change in the number of vehicle trajectories by turn type is evaluated.
  • Finally, a statewide qualitative analysis at the intersection level is provided.

4.1. Change by Movement

It is important to evaluate the amount of data available for analysis at the movement level. This is because movement level traffic signal performance measures provide practitioners with insights on the operational conditions in which each of the intersection’s phases serve traffic. Depending on the performance results for all movements at an intersection, signal retiming [13] or capital investment [22] activities may be suggested to improve operations.
The change in the number of trajectories available for analysis ( Δ T i j k ) at intersection i, direction of travel j, and turn type k was calculated as follows:
Δ T i j k = T i j k C T i j k H
where T i j k H and T i j k C are the total number of trajectories assigned direction of travel j and turn type k at intersection i from the historic and current CV datasets, respectively. The percentage change % Δ T i j k was calculated as follows:
% Δ T i j k = Δ T i j k T i j k H 100
Figure 11 summarizes in box-and-whisker plots the distribution of the percentage (Figure 11a) and absolute (Figure 11b) trajectory count changes at the 26,291 movements of the intersections analyzed. All-way stops showed the largest reduction in median percentage change (callout i), followed by roundabouts (callout ii). Signalized intersections had the smallest median reduction (callout iii).
Figure 12 supplements the distribution analysis from Figure 11 by showing the change in available trajectories by movement as CFD diagrams. Traffic signals had the largest proportion of movements, around 12.5%, where the current CV dataset did not provide any trajectory available for analysis (callout i). This phenomenon only occurred for less than 6.25% of roundabout movements (callout ii). Overall, the increase in the availability of trajectories for analysis followed a similar distribution for all intersection types (callout iii).
It is important to note that most absolute changes were within the ±500 trajectory count range (Figure 12b). All-way stops presented the smallest decrease in trajectories available for analysis (callout iv), likely because this type of intersection usually serves fewer vehicles than the others. The information provided in Figure 12 provides valuable insights on the expected number of trajectories available for analysis by intersection type for a week of data.
Figure 13 shows Pareto-sorted bar graphs displaying the percentage and absolute changes on available trajectories for analysis for each evaluated movement. Callouts indicate the percentage of movements where the available trajectories increased (~29%), stayed the same (~1%), and decreased (~70%). The next subsection discusses the changes at the turn type level.

4.2. Change by Turn Type

In addition to the movement level analysis, it is important to evaluate the change in the number of available trajectories for analysis at the turn level (i.e., right, through, and left). The change in the number of trajectories available for analysis ( Δ T k ) that followed turn type k was calculated as follows:
Δ T k = T k C T k H
where T k H and T k C are the total number of trajectories assigned turn type k from the historic and current CV datasets, respectively. The percentage change % Δ T k was calculated as follows:
% Δ T k = Δ T k T k H 100
Table 4 summarizes the change in the number of trajectories available for analysis by turn type. Every category shows a reduction in available trajectories as a consequence of waypoint fuzzification (Figure 1) and MPR reduction (Table 1). Considering all turn types, signalized intersections had the smallest percentage decrease (−11.22%) and roundabouts the largest (−17.66%). In particular, through trips at signalized intersections had the smallest percentage reduction (−10.73%), while through trips at roundabouts had the largest (−19.46%). The following subsection presents the changes at the intersection level.

4.3. Change by Intersection

An evaluation of the change in the number of available trajectories for analysis at the intersection level can help identify overall trends and statewide conditions. The change in the number of trajectories available for analysis ( Δ T i ) at intersection i was calculated as follows:
Δ T i = T i C T i H
where T i H and T i C are the total number of trajectories available for analysis at intersection i from the historic and current CV datasets, respectively. The percentage change % Δ T i was calculated as follows:
% Δ T i = Δ T i T i H 100
Figure 14 qualitatively shows the percentage (Figure 14a–c) and absolute (Figure 14d–f) changes at each analyzed intersection. In general, rural areas displayed less pronounced differences between the datasets. This is likely because those intersections may serve more commuting traffic than urban intersections, which can reduce the impact of fuzzification as fewer vehicles have rural areas as destination. Additionally, most intersections fall within the ≥−50% to <+50% trajectory change categories, which indicates general moderate differences at the intersection level.

5. Discussion

CV trajectory data have demonstrated to be a versatile dataset that can be used to assess mobility under a wide range of scenarios and scales. This study presented a high-level analysis on the impact that data fuzzification and fleet reduction (Figure 1) had on a current commercial CV dataset. An evaluation of the current and historic estimated MPRs showed reductions of 0.5% and 0.3% along interstate and non-interstate roadways, respectively (Table 1). The summary impact at freeways and intersections is summarized below.

5.1. Impact at Freeways

A comparison of the CV data available on 54,284 individual 0.1-mile segments of interstates, US Routes, and State Routes between a week of historic non-fuzzified and a week of current fuzzified data showed that the number of journeys available for analysis increased for 33.8% of segments and decreased for 65.9%.
Although the reductions are non-trivial, for simply computing average segment speeds, the authors do not believe this will significantly impact estimations. For example, Figure 15 shows trajectory-derived heatmaps of sampled vehicle speeds over one mile of I-465 in Indianapolis, Indiana. The vertical axis represents the location on the road and the horizontal axis the DOW and TOD; displayed trajectory segments color-coded based on their speed portray mobility conditions [15]. A similar coverage can be qualitatively concluded by comparing the heatmap generated from a non-fuzzified historic dataset (Figure 15a) and the heatmap generated from the fuzzified current dataset (Figure 15b).

5.2. Impact at Intersections

A comparison of the number of CV trajectories available for movement level analysis at 3289 intersections between a week of historic non-fuzzified and a week of current fuzzified data showed an 11.6% overall reduction (Table 4). Of the 26,291 studied individual movements, the number of trajectories available for analysis increased at 28.3% and decreased at 70.4%. This large and non-uniform reduction in available trajectories for analysis may substantially decrease sampling on particular movements and perhaps bias intersection analysis. This change is a concern, because, in many cases, the movements that are fuzzified going to or from residential or commercial areas are of a significant interest. This is because signal retiming [13] and capital investment [22] opportunity identification algorithms rely on the unbiased sampling of vehicle trajectories at all movements at any intersection.
For example, Figure 16 shows trajectory-derived heatmaps of the estimated Highway Capacity Manual (HCM) level of service (LOS) [13,34] at the minor through movements of a corridor segment with 12 signalized intersections. The vertical axis represents each analyzed intersection, and the horizontal axis represents the TOD. It is evident how data coverage is reduced for the heatmap generated with the current fuzzified dataset (Figure 16b, callout i) when comparing it to the heatmap derived from the historic dataset without fuzzified waypoints (Figure 16a, callout i). Improvement opportunities will now be more difficult to identify for the intersection with decreased coverage (callout i).

5.3. Future Research

This study focused on providing a high-level overview of the impacts that CV data fuzzification and fleet composition changes have on data availability for transportation studies. Future research should provide a more in-depth investigation of the effects that these changes have on specific mobility analyses by type of roadway infrastructure. Subsequent efforts should provide special attention to the impact that data fuzzification has on movement level traffic signal performance estimations, as this granularity of analysis is critical to identify retiming [13] and infrastructure [22] improvement opportunities.
Furthermore, improved alternative data fuzzification techniques may be derived from an intentional dialog between transportation agencies, industry, and academia to further protect motorist privacy while minimizing adverse effects on data availability. Different fuzzification approaches should be extensively evaluated and best practices defined in future studies.

6. Conclusions

Even though there is a general reduction in the amount of data available for analysis in comparison with historic datasets, with MPR values ≥4.6%, the authors believe that the current CV dataset accounts for enough representativeness to derive most relevant mobility performance measures. Furthermore, as MPR follows an upward trend, it is just a matter of time before the current dataset contains more usable data than previous versions.
Of the infrastructure CV coverage analyzed, intersection performance will likely be the most affected by data fuzzification (Figure 1 and Figure 16). This is because the current data filtering approach may induce unintended bias on the amount of data available for analysis by movement at intersections near popular commercial areas or large residential zones.
Although the results of this study are based on data from Indiana, the authors believe that similar trends are likely to be observed in other locations. This is because if the same fuzzification approach and fleet modifications are implemented elsewhere, proportional changes in data availability are expected to be produced.

Author Contributions

Conceptualization, E.D.S.-C., R.S.S., J.D., J.K.M. and D.M.B.; methodology, E.D.S.-C., R.S.S., J.D., J.K.M. and A.J.S.; software, E.D.S.-C., R.S.S., J.D., J.K.M. and A.J.S.; validation, E.D.S.-C., R.S.S. and J.D.; formal analysis, E.D.S.-C., R.S.S., and J.D.; investigation, E.D.S.-C., R.S.S. and J.D.; resources, E.D.S.-C., R.S.S., J.D., J.K.M. and D.M.B.; data curation, E.D.S.-C., R.S.S., J.D., J.K.M., A.J.S. and J.M.; writing—original draft preparation, E.D.S.-C., R.S.S. and J.D.; writing—review and editing, J.K.M. and D.M.B.; visualization, E.D.S.-C., R.S.S., J.D., J.K.M. and A.J.S.; supervision, D.M.B.; project administration, D.M.B.; funding acquisition, D.M.B. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the Joint Transportation Research Program and Pooled Fund Study (TPF-5(519)) led by the Indiana Department of Transportation (INDOT) and supported by the state transportation agencies of California, Connecticut, Georgia, Minnesota, Mississippi, North Carolina, Ohio, Pennsylvania, Texas, Utah, and Wisconsin, and the Federal Highway Administration (FHWA) Operations Technical Services Team. The contents of this paper reflect the views of the authors, who are responsible for the facts and the accuracy of the data presented herein, and do not necessarily reflect the official views or policies of the sponsoring organizations. These contents do not constitute a standard, specification, or regulation.

Data Availability Statement

The datasets presented in this article are not readily available because of commercial restrictions.

Acknowledgments

CV trajectory data from 2020 to 2023 used in this study was provided by Wejo Data Services, Inc. CV trajectory data from 5–11 May 2024, was provided by StreetLight Data, Inc.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. American Society of Civil Engineers. A Comprehensive Assessment of America’s Infrastructure: 2021 Report Card for America’s Infrastructure. 2021. Available online: https://www.infrastructurereportcard.org/ (accessed on 17 July 2024).
  2. FHWA. December 2023 Traffic Volume Trends. Available online: https://www.fhwa.dot.gov/policyinformation/travel_monitoring/23dectvt/ (accessed on 17 July 2024).
  3. FHWA. December 2003 Traffic Volume Trends. Available online: https://www.fhwa.dot.gov/ohim/tvtw/03dectvt/index.htm (accessed on 17 July 2024).
  4. Chu, J.; Radow, L. Behind the Scenes at TMCs. FHWA. Available online: https://highways.dot.gov/public-roads/julyaugust-2012/behind-scenes-tmcs (accessed on 17 July 2024).
  5. Tantillo, M.; Smith, K.; Packard, C.; Lomax, T.; Dhuri, S. Transportation Management Center Performance Dashboards; Department of Transportation: Washington, DC, USA, 2021.
  6. Wuertz, S.C. Indiana Department of Transportation Traffic Management Strategic Deployment Plan Version 2.4; Indiana Department of Transportation: Indianapolis, IN, USA, 2008.
  7. ITE; NOCoE. 2019 Traffic Signal Benchmarking and State of the Practice Report. 2020. Available online: https://transportationops.org/trafficsignals/benchmarkingreport (accessed on 1 January 2024).
  8. National Transportation Operations Coalition. National Traffic Signal Report Card; National Transportation Operations Coalition: Washington, DC, USA, 2012. Available online: https://transportationops.org/publications/2012-national-traffic-signal-report-card#downloads (accessed on 1 January 2024).
  9. Denney, R.W.; Head, L.; Spencer, K. Signal Timing Under Saturated Conditions; United States Federal Highway Administration: Washington, DC, USA, 2008.
  10. Day, C.M.; Bullock, D.M.; Li, H.; Remias, S.M.; Hainen, A.M.; Freije, R.S.; Stevens, A.L.; Sturdevant, J.R.; Brennan, T.M. Performance Measures for Traffic Signal Systems: An Outcome-Oriented Approach; Purdue University: West Lafayette, IN, USA, 2014. [Google Scholar] [CrossRef]
  11. Lattimer, C. Automated Traffic Signals Performance Measures. 2020. Available online: https://ops.fhwa.dot.gov/publications/fhwahop20002/fhwahop20002.pdf (accessed on 24 October 2022).
  12. Guadamuz, R.; Tang, H.; Yu, Z.; Guler, S.I.; Gayah, V.V. Green time usage metrics on signalized intersections and arterials using high-resolution traffic data. Int. J. Transp. Sci. Technol. 2021, 11, 509–521. [Google Scholar] [CrossRef]
  13. Saldivar-Carranza, E.D.; Li, H.; Mathew, J.K.; Desai, J.; Platte, T.; Gayen, S.; Sturdevant, J.; Taylor, M.; Fisher, C.; Bullock, D.M. Next Generation Traffic Signal Performance Measures: Leveraging Connected Vehicle Data; Purdue University: West Lafayette, IN, USA, 2023. [Google Scholar] [CrossRef]
  14. Emtenan, A.M.T.; Day, C.M. Impact of Detector Configuration on Performance Measurement and Signal Operations. Transp. Res. Rec. J. Transp. Res. Board 2020, 2674, 300–313. [Google Scholar] [CrossRef]
  15. Sakhare, R.S.; Desai, J.; Mathew, J.K.; McGregor, J.; Kachler, M.; Bullock, D.M. Measuring and Visualizing Freeway Traffic Conditions: Using Connected Vehicle Data; Purdue University: West Lafayette, IN, USA, 2024. [Google Scholar] [CrossRef]
  16. Waddell, J.M.; Remias, S.M.; Kirsch, J.N. Characterizing Traffic-Signal Performance and Corridor Reliability Using Crowd-Sourced Probe Vehicle Trajectories. J. Transp. Eng. A Syst. 2020, 146, 04020053. [Google Scholar] [CrossRef]
  17. Mahmud, S.; Day, C.M. Evaluation of Arterial Signal Coordination with Commercial Connected Vehicle Data: Empirical Traffic Flow Visualization and Performance Measurement. J. Transp. Technol. 2023, 13, 327–352. [Google Scholar] [CrossRef]
  18. Desai, J.; Mathew, J.K.; Li, H.; Sakhare, R.S.; Horton, D.; Bullock, D.M. National Mobility Analysis for All Interstate Routes in the United States: December 2022; Purdue University: West Lafayette, IN, USA, 2023. [Google Scholar] [CrossRef]
  19. ITSdigest. 470 Million Connected Vehicles On the Road by 2025. Available online: https://www.itsdigest.com/470-million-connected-vehicles-road-2025 (accessed on 2 February 2023).
  20. Sakhare, R.S.; Hunter, M.; Mukai, J.; Li, H.; Bullock, D.M. Truck and Passenger Car Connected Vehicle Penetration on Indiana Roadways. J. Transp. Technol. 2022, 12, 578–599. [Google Scholar] [CrossRef]
  21. FHWA. Every Day Counts: Innovation for a Nation on the Move. 2023. Available online: https://www.fhwa.dot.gov/innovation/everydaycounts/edc_6/ (accessed on 18 July 2024).
  22. Gayen, S. Statewide Identification and Ranking of Signalized Intersections Needing Capacity Improvements; Purdue University: West Lafayette, IN, USA, 2024. [Google Scholar]
  23. Desai, J.; Mathew, J.; Li, H.; Bullock, D. Using connected vehicle data for assessing electric vehicle charging infrastructure usage and investment opportunities. Inst. Transp. Eng. ITE J. 2022, 92, 22–31. Available online: https://drive.google.com/file/d/1-0dHQmbqZk_npqEtyPb1-v8b1OdhEUrU/view (accessed on 17 March 2024).
  24. Alsahfi, T.; Almotairi, M.; Elmasri, R.; Alshemaimri, B. Road Map Generation and Feature Extraction from GPS Trajectories Data. In Proceedings of the 12th ACM SIGSPATIAL International Workshop on Computational Transportation Science, Chicago, IL, USA, 5–8 November 2019; ACM: New York, NY, USA, 2019; pp. 1–10. [Google Scholar] [CrossRef]
  25. Zhan, X.; Zheng, Y.; Yi, X.; Ukkusuri, S.V. Citywide Traffic Volume Estimation Using Trajectory Data. IEEE Trans. Knowl. Data Eng. 2017, 29, 272–285. [Google Scholar] [CrossRef]
  26. Fan, J.; Fu, C.; Stewart, K.; Zhang, L. Using big GPS trajectory data analytics for vehicle miles traveled estimation. Transp. Res. Part C Emerg. Technol. 2019, 103, 298–307. [Google Scholar] [CrossRef]
  27. Ugan, J.; Abdel-Aty, M.; Islam, Z. Using Connected Vehicle Trajectory Data to Evaluate the Effects of Speeding. IEEE Open J. Intell. Transp. Syst. 2024, 5, 16–28. [Google Scholar] [CrossRef]
  28. Islam, Z.; Abdel-Aty, M.; Ugan, J. Signal Phasing and Timing Prediction Using Connected Vehicle Data. Transp. Res. Rec. J. Transp. Res. Board 2024, 2678, 662–673. [Google Scholar] [CrossRef]
  29. Du, Z.; Yan, X.; Zhu, J.; Sun, W. Signal Timing Parameters Estimation for Intersections using Floating Car Data. Transp. Res. Rec. J. Transp. Res. Board 2019, 2673, 189–201. [Google Scholar] [CrossRef]
  30. Klein, L.A.; Mills, M.K.; Gibson, D.R.P. Traffic Detector Handbook, 3rd ed.; Turner-Fairbank Highway Research Center: McLean, VA, USA, 2006; Volume I. Available online: https://rosap.ntl.bts.gov/view/dot/954 (accessed on 23 July 2024).
  31. Chen, C.; Petty, K.; Skabardonis, A.; Varaiya, P.; Jia, Z. Freeway Performance Measurement System: Mining Loop Detector Data. Transp. Res. Rec. J. Transp. Res. Board 2001, 1748, 96–102. [Google Scholar] [CrossRef]
  32. Oh, S.; Ritchie, S.G.; Oh, C. Real-Time Traffic Measurement from Single Loop Inductive Signatures. Transp. Res. Rec. J. Transp. Res. Board 2002, 1804, 98–106. [Google Scholar] [CrossRef]
  33. Hunter, M.; Mathew, J.K.; Cox, E.; Blackwell, M.; Bullock, D.M. Estimation of Connected Vehicle Penetration Rate on Indiana Roadways; TRP Affiliated Reports—Paper 37; Joint Transportation Research Program: West Lafayette, IN, USA, 2021. [Google Scholar] [CrossRef]
  34. Transportation Research Board. Highway Capacity Manual 2010; National Research Council (NRC): Washington, DC, USA, 2010.
Figure 1. Non-fuzzified waypoints available for analysis and fuzzified waypoints sampled during a 10-min period.
Figure 1. Non-fuzzified waypoints available for analysis and fuzzified waypoints sampled during a 10-min period.
Smartcities 07 00093 g001
Figure 2. Locations of twenty-eight count stations in Indiana.
Figure 2. Locations of twenty-eight count stations in Indiana.
Smartcities 07 00093 g002
Figure 3. CV penetration in 2024 across ten interstate count stations in Indiana.
Figure 3. CV penetration in 2024 across ten interstate count stations in Indiana.
Smartcities 07 00093 g003
Figure 4. CV penetration in 2024 across eighteen non-interstate count stations in Indiana.
Figure 4. CV penetration in 2024 across eighteen non-interstate count stations in Indiana.
Smartcities 07 00093 g004
Figure 5. CV penetration comparison over the years across 12 common count stations.
Figure 5. CV penetration comparison over the years across 12 common count stations.
Smartcities 07 00093 g005
Figure 6. Map of Indiana showing routes analyzed—12 interstates, 4 US Routes, and 3 State Routes.
Figure 6. Map of Indiana showing routes analyzed—12 interstates, 4 US Routes, and 3 State Routes.
Smartcities 07 00093 g006
Figure 7. Box-and-whisker diagrams of the network level change on the number of journeys by route type and 0.1-mile segment.
Figure 7. Box-and-whisker diagrams of the network level change on the number of journeys by route type and 0.1-mile segment.
Smartcities 07 00093 g007
Figure 8. CFD of the network level change on the number of journeys by route type and 0.1-mile segment.
Figure 8. CFD of the network level change on the number of journeys by route type and 0.1-mile segment.
Smartcities 07 00093 g008
Figure 9. Pareto-sorted analyzed 0.1-mile route segments ranked by their change in journeys.
Figure 9. Pareto-sorted analyzed 0.1-mile route segments ranked by their change in journeys.
Smartcities 07 00093 g009
Figure 10. Change in the number of journeys at the 0.1-mile route segment level in Indiana.
Figure 10. Change in the number of journeys at the 0.1-mile route segment level in Indiana.
Smartcities 07 00093 g010
Figure 11. Box-and-whisker diagrams of the network level change on the number of analyzed vehicle trajectories by intersection and movement.
Figure 11. Box-and-whisker diagrams of the network level change on the number of analyzed vehicle trajectories by intersection and movement.
Smartcities 07 00093 g011
Figure 12. CFD of the network level change on the number of analyzed vehicle trajectories by intersection and movement.
Figure 12. CFD of the network level change on the number of analyzed vehicle trajectories by intersection and movement.
Smartcities 07 00093 g012
Figure 13. Pareto-sorted analyzed movements ranked by their change in analyzed vehicle trajectories.
Figure 13. Pareto-sorted analyzed movements ranked by their change in analyzed vehicle trajectories.
Smartcities 07 00093 g013
Figure 14. Change in the number of vehicle trajectories analyzed at the intersection level in Indiana.
Figure 14. Change in the number of vehicle trajectories analyzed at the intersection level in Indiana.
Smartcities 07 00093 g014
Figure 15. Speed analysis over one mile of I-465 around Indianapolis, Indiana (Note: IL = inner loop, OL = outer loop).
Figure 15. Speed analysis over one mile of I-465 around Indianapolis, Indiana (Note: IL = inner loop, OL = outer loop).
Smartcities 07 00093 g015
Figure 16. LOS estimation for the minor movements at a 12-intersection corridor.
Figure 16. LOS estimation for the minor movements at a 12-intersection corridor.
Smartcities 07 00093 g016
Table 1. Summary of longitudinal traffic penetration analysis of connected vehicles.
Table 1. Summary of longitudinal traffic penetration analysis of connected vehicles.
InterstateNon-Interstate
2020202120222023202420202021202220232024
Count stations analyzed2129187103229251018
Analysis period
(days)
31317773131777
Total traffic volume (millions)28.560.68.12.13.118.824.62.71.32.2
Average daily volume per station43,70667,33165,05742,79443,72318,94827,32315,50318,09617,857
Total CV trajectories (millions)1.22.70.40.10.10.71.20.10.070.1
Average CV trajector
ies per station
125829583197217511128761319798967901
MPR (%)4.44.44.95.14.64.64.85.15.35.0
Table 2. Count station details.
Table 2. Count station details.
Station No.Count Station IDRoad TypeCountyLocation Description
1952300InterstateGrantI-69 RM 268.2
2954300InterstateLaporteI-94 MM 44.5
3990206InterstateHuntingtonI-69 NB MM 78.2
4990371InterstateMarionI-65 MM 121.5
5954600Non-interstateMarshallUS-31 (SR 10)
6954700Non-interstatePorterSR-49 (N E. 600 N)
7955200Non-interstateRipleyUS-50 (RD 175 W)
8990202Non-interstateElhartUS-6 EB RM 93.6
9990305Non-interstateMarionBinford Blvd
10990502Non-interstateMorgonSR-67 SB RM 80.6
11990505Non-interstateRipleyUS-421 SB RM 29.2
12990607Non-interstateVanderburghUS-41 NB RM 15.3
Table 3. Summary statistics of change in number of journeys for route segments analyzed.
Table 3. Summary statistics of change in number of journeys for route segments analyzed.
Type of RoutesTotal 0.1-Mile SegmentsSegments with Increase in JourneysSegments with No Change in JourneysSegments with Decrease in JourneysSegments That Could Not Be Compared
Interstates26,8385835
(21.7%)
18
(0.1%)
20,976
(78.2%)
9
(0.0%)
US Routes17,6407174
(40.7%)
52
(0.3%)
10,403
(59.0%)
11
(0.0%)
State Routes98065355
(54.6%)
58
(0.6%)
4391
(44.8%)
2
(0.0%)
Total54,28418,364
(33.8%)
128
(0.2%)
35,770
(65.9%)
22
(0.0%)
Table 4. Number of vehicle trajectories analyzed by intersection and turn type.
Table 4. Number of vehicle trajectories analyzed by intersection and turn type.
Intersection TypeTurn Type (k) T k H T k C Δ T k % Δ T k
Traffic signalAll13,774,80312,228,874−1,545,929−11.2%
Right948,878802,500−146,378−15.4%
Through11,138,8469,943,666−1,195,180−10.7%
Left1,687,0791,482,708−204,371−12.1%
RoundaboutAll562,707463,349−99,358−17.7%
Right83,08072,518−10,562−12.7%
Through389,827313,975−75,852−19.5%
Left89,80076,856−12,944−14.4%
All-way stopAll498,109426,220−71,889−14.4%
Right102,93585,202−17,733−17.2%
Through292,083254,043−38,040−13.0%
Left103,09186,975−16,116−15.6%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Saldivar-Carranza, E.D.; Sakhare, R.S.; Desai, J.; Mathew, J.K.; Sivakumar, A.J.; Mukai, J.; Bullock, D.M. Impact of Privacy Filters and Fleet Changes on Connected Vehicle Trajectory Datasets for Intersection and Freeway Use Cases. Smart Cities 2024, 7, 2366-2391. https://doi.org/10.3390/smartcities7050093

AMA Style

Saldivar-Carranza ED, Sakhare RS, Desai J, Mathew JK, Sivakumar AJ, Mukai J, Bullock DM. Impact of Privacy Filters and Fleet Changes on Connected Vehicle Trajectory Datasets for Intersection and Freeway Use Cases. Smart Cities. 2024; 7(5):2366-2391. https://doi.org/10.3390/smartcities7050093

Chicago/Turabian Style

Saldivar-Carranza, Enrique D., Rahul Suryakant Sakhare, Jairaj Desai, Jijo K. Mathew, Ashmitha Jaysi Sivakumar, Justin Mukai, and Darcy M. Bullock. 2024. "Impact of Privacy Filters and Fleet Changes on Connected Vehicle Trajectory Datasets for Intersection and Freeway Use Cases" Smart Cities 7, no. 5: 2366-2391. https://doi.org/10.3390/smartcities7050093

APA Style

Saldivar-Carranza, E. D., Sakhare, R. S., Desai, J., Mathew, J. K., Sivakumar, A. J., Mukai, J., & Bullock, D. M. (2024). Impact of Privacy Filters and Fleet Changes on Connected Vehicle Trajectory Datasets for Intersection and Freeway Use Cases. Smart Cities, 7(5), 2366-2391. https://doi.org/10.3390/smartcities7050093

Article Metrics

Back to TopTop