A Review of Indoor Localization Methods Leveraging Smartphone Sensors and Spatial Context
Abstract
:1. Introduction
2. Indoor Localization Methods Using Single Sensor Data Source
3. Indoor Localization Methods Using Multi-Sensor Data Fusion
3.1. Two-Dimensional Indoor Localization Methods
3.2. Indoor 3D Localization Methods for Multi-Floor Buildings
4. Smartphone-Based Indoor Localization Methods Integrating Spatial Context with Sensor Data
4.1. Methods for Integrating Map Data with Sensor Data
Types of Spatial Context | References | Representation Forms of Map Data | Methods of Acquiring Map Data | Methods of Data Integration |
---|---|---|---|---|
Map data | [57] | Topological map | Not specified. | Use HMM to match pedestrian activity sequences with indoor road network nodes. |
[58] | Grid map | Add CSI (Channel State Information) data to the grid map and associate visual features with locations in the map in the form of feature descriptors. | Provide a reference framework for the localization system by dividing the indoor environment into grids, with each grid storing CSI fingerprints and visual features. | |
[60] | Topological map | Perform sub-region segmentation and define topological relationships for the floor plan. | Topological information in the floor map was input into the algorithm in the form of adjacency relationships between reference points and GSSS values. | |
[61] | Grid map | Extract channel areas from images and generate a binary image to represent walkable areas, providing a simplified map for localization. | Use a PF to project walking data onto a grid map. The particles represent parameters such as position, orientation, and scale, which were continuously updated based on the smartphone’s Inertial Measurement Unit (IMU) data. | |
[62] | 3D reality map | 3D reconstruction. | Match features from the images captured by the smartphone with those in the real-world 3D map, and use techniques such as the Perspective-n-Point (PnP) algorithm to compute the spatial pose of the smartphone’s camera. |
4.2. Localization Methods Combining Landmark Data and Sensor Data
4.3. Other Methods
5. Discussion
5.1. Comparison of Three Types of Positioning Methods
5.2. Selection and Optimization of Smartphone-Based IndoorLocalization Algorithms
5.3. AI Techniques in Smartphone-Based Indoor Localization
5.4. Optimization Strategies for Key Localization Performance
- (1)
- Real-time performance-influencing factors and evaluation indicators
- (2)
- Ways to improve real-time performance
5.5. Research Gaps
- (1)
- Lack of a unified spatial context application strategy for assisting in sensor-based localization
- (2)
- Rational calculation strategy to support real-time performance under complex data and algorithms
6. Conclusions
- (1)
- The single-sensor localization method can achieve relatively accurate localization in specific environments with low cost and low complexity. Nevertheless, due to the inherent limitations of single sensors, they struggle to meet localization requirements in complex indoor environments.
- (2)
- The multi-sensor data fusion method can significantly improve the accuracy and robustness of indoor localization by integrating sensor data with complementary characteristics. Compared to localization in a 2D localization, multi-floor localization in a 3D space typically requires the integration of specialized sensor data or the employment of more complex methods to fuse multi-source localization data. In both 2D and 3D localization scenarios, multi-sensor fusion demonstrates remarkable advantages in enhancing accuracy and reliability. Nonetheless, multi-sensor fusion algorithms are relatively complex, and the data processing demands high computational power and energy consumption, posing challenges for the application of smartphones in indoor localization.
- (3)
- In the methods that integrate spatial context and sensor data, elements such as maps, landmarks, image data, spatial models, grid data, and graph models play a crucial role. These elements enhance positioning accuracy by providing physical boundaries, obstacle information, visual features, and structured spatial representations, which help correct errors and improve the effectiveness of PF algorithms. However, compared to sensor data, different modalities of architectural spatial context vary in format, content, level of detail, and organization. Therefore, it is essential to explore and innovate application models and methods for integrating architectural spatial context in indoor localization.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Lin, F.; Zhang, L.; Li, G.N.; Wang, Z. Acoustic self-calibrating indoor localization system via smartphones. J. Comput. Res. Dev. 2017, 54, 2741–2751. [Google Scholar] [CrossRef]
- Song, Y.; Yu, W.J.; Cheng, C. Research on indoor geomagnetic positioning based on FCM clustering and location area switching. Mod. Electron. Tech. 2018, 41, 96–100. [Google Scholar] [CrossRef]
- Jiang, C.S.; Liu, J.X. A smartphone-based indoor geomagnetic positioning system. GNSS World China 2018, 43, 9–16. [Google Scholar] [CrossRef]
- Zhang, X.; Liu, T.; Sun, L.P.; Li, Q.Q.; Fang, Z.X. A collaborative visual and inertial indoor multi-pedestrian target positioning method. Geomat. Inf. Sci. Wuhan Univ. 2021, 46, 672–680. [Google Scholar] [CrossRef]
- Wang, Y.K.; Wang, Y.J.; Bi, J.X.; Cao, H.J. The method of indoor positioning based on similarity computation of image gray histogram. Bull. Surv. Mapp. 2018, 25, 63–67. [Google Scholar] [CrossRef]
- Li, N.; Chen, J.B.; Yuan, Y. Indoor pedestrian integrated localization strategy based on WiFi/PDR. J. Chin. Inert. Technol. 2017, 25, 483–487. [Google Scholar] [CrossRef]
- Wang, G.N.; Tian, X.; Wei, G.L.; Zhou, J. Multi-sensor fusion indoor localization method based on RNN. Appl. Res. Comput. 2021, 38, 3725–3729. [Google Scholar] [CrossRef]
- Chen, L.J.; Yang, Z.K.; Shi, W.Y.; Wu, J.B.; Mao, K.J.; Wang, W.L. A multi-sensor integrated indoor 3D navigation system. Chin. J. Sens. Actuators 2018, 31, 551–561. [Google Scholar] [CrossRef]
- Zhao, Z.H.; Tong, Y.F.; Cui, J.Y. Device-independent Wi-Fi fingerprinting indoor localization model based on domain adaptation. J. Commun. 2022, 43, 143–153. [Google Scholar] [CrossRef]
- Yu, J.H.; Yu, M. An indoor positioning method based on smartphone’s four-directional RSS fingerprint. GNSS World China 2021, 46, 48–54. [Google Scholar] [CrossRef]
- Zheng, C.H.; Chen, J.; Zhang, Y.T.; Xue, W. Fusion particle filter and Bluetooth landmark correction localization algorithm. Comput. Eng. Appl. 2020, 273–278. [Google Scholar] [CrossRef]
- Rosiak, M.; Kawulok, M.; Maékowski, M. The effectiveness of UWB-based indoor localization systems for the navigation of visually impaired individuals. Appl. Sci. 2024, 14, 5646. [Google Scholar] [CrossRef]
- Niu, J.W.; Wang, B.W.; Shu, L.; Duong, T.Q.; Chen, Y.F. ZIL: An energy-efficient indoor localization system using Zigbee radio to detect WiFi fingerprints. IEEE J. Sel. Areas Commun. 2015, 33, 1431–1442. [Google Scholar] [CrossRef]
- Fischer, G.; Bordoy, J.; Schott, D.J.; Xiong, W.X.; Gabbrielli, A.; Hoflinger, F.; Fischer, K.; Schindelhauer, C.; Rupitsch, S.J. Multimodal Indoor Localization: Fusion Possibilities of Ultrasonic and Bluetooth Low-Energy Data. IEEE Sens. J. 2022, 22, 5857–5868. [Google Scholar] [CrossRef]
- Rizk, H.; Torki, M.; Youssef, M. CellinDeep: Robust and Accurate Cellular-Based Indoor Localization via Deep Learning. IEEE Sens. J. 2018, 19, 2305–2312. [Google Scholar] [CrossRef]
- Liu, X.D. Design and Implementation of the Miniature Quadruped Robot for Underground Pipelines. Ph.D. Thesis, Chongging University, Chongqing, China, 2018. [Google Scholar]
- Chen, K. Research on Methods of Realtime Location and Mapping and Autonomous Exploration for UAV in Underground Mine. Ph.D. Thesis, University of Science and Technology Beijing, Beijing, China, 2022. [Google Scholar]
- Xu, W.Q.; Huang, Y.C.; Liu, Y.Q.; Shan, J. A smart phone indoor positioning method combining WiFi information and PDR algorithm. J. Geomat. 2022, 70–74. [Google Scholar] [CrossRef]
- Shi, C.Y.; Teng, W.X.; Zhang, Y.; Yu, Y.; Chen, L.; Chen, R.Z.; Li, Q.Q. Autonomous Multi-Floor Localization Based on Smartphone-Integrated Sensors and Pedestrian Indoor Network. Remote Sens. 2023, 15, 2933. [Google Scholar] [CrossRef]
- Zhao, M.; Qin, D.Y.; Guo, R.L.; Wang, X.X. Indoor floor localization based on multi-intelligent sensors. Int. J. Geo-Inf. 2021, 10, 6. [Google Scholar] [CrossRef]
- Wang, X.Y.; Yu, Z.T.; Mao, S.W. Indoor Localization Using Smartphone Magnetic and Light Sensors: A Deep LSTM Approach. Mob. Netw. Appl. 2019, 25, 819–832. [Google Scholar] [CrossRef]
- Chen, Z.H.; Zou, H.; Yang, J.F.; Jiang, H.; Xie, L.H. WiFi Fingerprinting Indoor Localization Using Local Feature-Based Deep LSTM. IEEE Syst. J. 2019, 14, 3001–3010. [Google Scholar] [CrossRef]
- Huang, J.H.; Junginger, S.; Liu, H.; Thurow, K. Indoor Positioning Systems of Mobile Robots: A Review. Robotics 2023, 12, 47. [Google Scholar] [CrossRef]
- Sandamini, C.; Maduranga, M.W.P.; Tilwari, V.; Yahaya, J.; Qamar, F.; Nguyen, Q.N.; Ibrahim, S.R.A. A Review of Indoor Positioning Systems for UAV Localization with Machine Learning Algorithms. Electronics 2023, 12, 1533. [Google Scholar] [CrossRef]
- Rahman, A.B.M.M.; Li, T.; Wang, Y. Recent advances in indoor localization via visible lights: A survey. Sensors 2020, 20, 1382. [Google Scholar] [CrossRef]
- Ouameur, M.A.; Caza-Szoka, M.; Massicotte, D. Machine learning enabled tools and methods for indoor localization using low power wireless network. Internet Things 2020, 12, 100300. [Google Scholar] [CrossRef]
- Alarifi, A.; Al-Salman, A.; Alsaleh, M.; Alnafessah, A.; Al-Hadhrami, S.; Al-Ammar, M.A.; Al-Khalifa, H.S. Ultra wideband indoor positioning technologies: Analysis and recent advances. Sensors 2016, 16, 707. [Google Scholar] [CrossRef]
- Pau, G.; Arena, F.; Gebremariam, Y.E.; You, I. Bluetooth 5.1: An Analysis of Direction Finding Capability for High-Precision Location Services. Sensors 2021, 21, 3589. [Google Scholar] [CrossRef]
- Grumiaux, P.-A.; Kitić, S.; Girin, L.; Guérin, A. A survey of sound source localization with deep learning methods. J. Acoust. Soc. Am. 2022, 152, 107–151. [Google Scholar] [CrossRef]
- Shang, S.; Wang, L.X. Overview of WiFi fingerprinting-based indoor positioning. IET Commun. 2022, 16, 725–733. [Google Scholar] [CrossRef]
- Liu, F.; Liu, J.; Yin, Y.Q.; Wang, W.H.; Hu, D.H.; Chen, P.P.; Niu, Q. Survey on WiFi-based indoor positioning techniques. IET Communications 2020, 14, 1372–1383. [Google Scholar] [CrossRef]
- Wei, Z.; Chen, J.L.; Tang, H.; Zhang, H. RSSI-based location fingerprint method for RFID indoor positioning: A review. Nondestruct. Test. Eval. 2023, 39, 3–31. [Google Scholar] [CrossRef]
- Kordi, K.A.; Roslee, M.; Alias, M.Y.; Alhammadi, A.; Waseem, A.; Osman, A.F. Survey of Indoor Localization Based on Deep Learning. Comput. Mater. Contin. 2024, 79, 3261–3298. [Google Scholar] [CrossRef]
- Bellavista-Parent, V.; Torres-Sospedra, J.; Pérez-Navarro, A. Comprehensive analysis of applied machine learning in indoor positioning based on Wi-Fi: An extended systematic review. Sensors 2022, 12, 4622. [Google Scholar] [CrossRef] [PubMed]
- Subedi, S.; Pyun, J.-Y. A Survey of Smartphone-Based Indoor Positioning System Using RF-Based Wireless Technologies. Sensors 2020, 20, 7230. [Google Scholar] [CrossRef] [PubMed]
- Ashraf, I.; Hur, S.; Park, Y.W. Smartphone Sensor Based Indoor Positioning: Current Status, Opportunities, and Future Challenges. Electronics 2020, 9, 891. [Google Scholar] [CrossRef]
- Naser, R.S.; Lam, M.C.; Qamar, F.; Zaidan, B.B. Smartphone-Based Indoor Localization Systems: A Systematic Literature Review. Electronics 2023, 12, 1814. [Google Scholar] [CrossRef]
- Gu, F.Q.; Hu, X.K.; Ramezani, M.; Acharya, D.; Khoshelham, K.; Valaee, S.; Shang, J. Indoor Localization Improved by Spatial Context—A Survey. ACM Comput. Surv. 2019, 52, 1–35. [Google Scholar] [CrossRef]
- Guo, G.Y.; Chen, R.Z.; Ye, F.; Peng, X.S.; Liu, Z.Y.; Pan, Y.J. Indoor Smartphone Localization: A Hybrid WiFi RTT-RSS Ranging Approach. IEEE Access 2019, 7, 176767–176781. [Google Scholar] [CrossRef]
- Cao, H.J.; Wang, Y.J.; Bi, J.X. Smartphones: 3D Indoor Localization Using Wi-Fi RTT. IEEE Commun. Lett. 2020, 25, 1201–1205. [Google Scholar] [CrossRef]
- Kang, W.; Han, Y. SmartPDR: Smartphone-Based Pedestrian Dead Reckoning for Indoor Localization. IEEE Sens. J. 2015, 15, 2906–2916. [Google Scholar] [CrossRef]
- Lu, Y.L.; Wei, J.L.; Ling, C.W.; Li, J.W.; Jiang, J.W. An indoor localization method based on adaptive particle filter fusion of geomagnetism, WiFi and PDR. Bull. Surv. Mapp. 2020, 1–6. [Google Scholar] [CrossRef]
- Chen, R.Z.; Qian, L.; Niu, X.G.; Xu, S.H.; Xu, L.; Qiu, C. Fusing acoustic ranges and inertial sensors using a data and model dual-driven approach. Bull. Surv. Mapp. 2022, 51, 1160–1171. [Google Scholar] [CrossRef]
- Zhang, L.; Huang, L.; Yi, Q.W.; Wang, X.J.; Zhang, D.W.; Zhang, G.H. Positioning method of pedestrian dead reckoning based on human activity recognition assistance. In Proceedings of the 2022 IEEE 12th International Conference on Indoor Positioning and Indoor Navigation (IPIN 2022), Beijing, China, 5–8 September 2022. [Google Scholar] [CrossRef]
- Feng, K.; He, T.; Wang, Y.J. A method of indoor fusion positioning based on smartphone. Bull. Surv. Mapp. 2019, S2, 6–10. [Google Scholar] [CrossRef]
- Zhou, B.D.; Wu, P.; Zhang, X.; Zhang, D.J.; Li, Q.Q. Activity semantics-based indoor localization using smartphones. IEEE Sens. J. 2024, 24, 11069–11079. [Google Scholar] [CrossRef]
- Shu, Y.C.; Bo, C.; Shen, G.B.; Zhao, C.S.; Li, L.Q.; Zhao, F. Magicol: Indoor Localization Using Pervasive Magnetic Field and Opportunistic WiFi Sensing. IEEE J. Sel. Areas Commun. 2015, 33, 1443–1457. [Google Scholar] [CrossRef]
- Wu, H.; Mo, Z.L.; Tan, J.J.; He, S.N.; Chan, S.-H.G. Efficient Indoor Localization Based on Geomagnetism. ACM Trans. Sens. Netw. 2019, 15, 1–25. [Google Scholar] [CrossRef]
- Zhou, M.; Wang, B.; Tian, Z.S.; Zhang, Q.K. Indoor BLE and MEMS based multi-floor fusion positioning algorithm. J. Commun. 2017, 1–10. [Google Scholar] [CrossRef]
- Wang, Q.S. Indoor floor positioning method based on activity awareness of smart phone. Transducer Microsyst. Technol. 2020, 20–23. [Google Scholar] [CrossRef]
- Yi, C.; Choi, W.; Jeon, Y.; Liu, L. Pressure-Pair-Based Floor Localization System Using Barometric Sensors on Smartphones. Sensors 2019, 19, 3622. [Google Scholar] [CrossRef]
- Ai, H.J.; Li, T.Z.; Wang, Y.F. Research on floor identification methods in WiFi fingerprinting localization. J. Wut Inf. Manag. Eng. 2015, 269–273+286. [Google Scholar] [CrossRef]
- Liu, X.; Zhou, B.D.; Wu, Z.Q.; Liang, A.B.; Li, Q.Q. An Indoor 3-D Quadrotor Localization Algorithm Based on WiFi RTT and MEMS Sensors. IEEE Internet Things J. 2022, 9, 20879–20888. [Google Scholar] [CrossRef]
- Mekruksavanich, S.; Jantawong, P.; Jitpattanakul, A. Deep learning-based action recognition for pedestrian indoor localization using smartphone inertial sensors. In Proceedings of the 2022 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON), Chiang Rai, Thailand, 26–28 January 2022. [Google Scholar] [CrossRef]
- Mallik, M.; Chowdhury, C. Characteristic analysis of finger print datasets from a pragmatic view of indoor localization using machine learning approaches. J. Supercomput. 2023, 79, 18507–18546. [Google Scholar] [CrossRef]
- Shang, J.; Gu, F.Q.; Hu, X.K.; Kealy, A. APFiLoc: An Infrastructure-Free Indoor Localization Method Fusing Smartphone Inertial Sensors, Landmarks and Map Information. Sensors 2015, 15, 27251–27272. [Google Scholar] [CrossRef] [PubMed]
- Zhou, B.D.; Li, Q.Q.; Mao, Q.Z.; Tu, W.; Zhang, X. Activity Sequence-Based Indoor Pedestrian Localization Using Smartphones. IEEE Trans. Hum.-Mach. Syst. 2014, 45, 562–574. [Google Scholar] [CrossRef]
- Hu, Z.Z.; Liu, Y.T.; Zhou, Z.; Huang, G.; Sun, X.P. Smartphone indoor positioning method based on vision and WiFi double-layer feature map. J. Harbin Inst. Technol. 2024. Available online: https://link.cnki.net/urlid/23.1235.t.20240623.1216.004 (accessed on 2 October 2024).
- Han, L.; Dai, P.; Yang, Y.; Wang, Q. Indoor positioning method based on multi-source information fusion. Transducer Microsyst. Technol. 2020, 21–24. [Google Scholar] [CrossRef]
- Wang, J.; Hu, A.D.; Liu, C.Y.; Li, X. A Floor-map-aided WiFi/pseudo-odometry integration algorithm for an indoor localization system. Sensors 2015, 15, 7096–7124. [Google Scholar] [CrossRef]
- Zhao, W.Y.; Gao, J.X.; Li, Z.K.; Yao, Y.F. KF-PF indoor localization algorithm model assisted by map matching. Geomat. Inf. Sci. Wuhan Univ. 2018, 806–812. [Google Scholar] [CrossRef]
- Kageyama, K.; Miyazaki, T.; Sugaya, Y.; Omachi, S. Collaborative Indoor Positioning by Localization Comparison at an Encounter Position. Appl. Sci. 2023, 13, 6962. [Google Scholar] [CrossRef]
- Shoushtari, H.; Askar, C.; Harder, D.; Willemsen, T.; Sternberg, H. 3D Indoor localization using 5G-based particle filtering and CAD plans. In Proceedings of the International Conference on Indoor Localization and Indoor Navigation (IPIN), Lloret de Mar, Spain, 29 November–2 December 2021. [Google Scholar] [CrossRef]
- Zhao, P.B.; Liu, G.; Luo, L.; Zhou, R. Construction method of indoor digital floor plan based on smartphone. Comput. Eng. 2018, 271–275+281. [Google Scholar] [CrossRef]
- Zhou, B.D.; Yang, C.J.; Gu, Z.N.; Liu, X. An indoor parking lot vehicle positioning method assisted by environmental semantic information. Bull. Surv. Mapp. 2022, 6–11. [Google Scholar] [CrossRef]
- He, X.N.; Song, B.B.; Yu, M. Context-aware landmark detection assists WiFi-PDR indoor localization. Bull. Surv. Mapp. 2020, 7–11. [Google Scholar] [CrossRef]
- Deng, Z.A.; Wang, G.F.; Qin, D.Y.; Na, Z.Y.; Cui, Y.; Chen, J. Continuous indoor localization fusing WiFi, smartphone sensors and landmarks. Sensors 2016, 16, 1427. [Google Scholar] [CrossRef] [PubMed]
- Gu, F.; Kealy, A.; Khoshelham, K.; Shang, J. Efficient and accurate indoor localization using landmark graphs. In Proceedings of the 23rd Congress of the International Society for Photogrammetry and Remote Sensing (ISPRS), Prague, Czech Republic, 11–19 July 2016; pp. 509–514. [Google Scholar] [CrossRef]
- Ge, W.F.; Niu, X.J.; Jiang, J.X.; Wu, Y.B. Research on position and posture determination of smartphone using 2D code landmark. Chin. J. Sens. Actuators 2019, 1816–1823. [Google Scholar] [CrossRef]
- Zhang, X.P.; Guo, J.M.; Xiao, Q. Mobilephone indoor location system based on QR-code. Sci. Surv. Mapp. 2017, 158–163. [Google Scholar] [CrossRef]
- Zhang, X.; Lin, J.; Li, Q.Q.; Liu, T.; Fang, Z.X. Continuous indoor visual localization using a perceptual Hash algorithm and spatial constraint. Acta Geod. Cartogr. Sin. 2021, 1639–1649. [Google Scholar] [CrossRef]
- Hou, S.L.; Yang, F.; Zhong, Y. Ensemble smartphone indoor localization algorithm based on wireless signal and image analysis. J. Comput. Appl. 2018, 2603–2609. [Google Scholar] [CrossRef]
- Huang, G.; Hu, Z.Z.; Cai, H.; Tao, Q.W.; Li, Y.C. Smartphone-based accurate indoor positioning from Wi-Vi fingerprints. Acta Autom. Sin. 2020, 320–331. [Google Scholar] [CrossRef]
- Liu, J.B.; Guo, Y.H.; Yu, W.H. A smartphone based visual global localization method with high usability in large indoor spaces. Geomat. Inf. Sci. Wuhan Univ. 2022. [Google Scholar] [CrossRef]
- Yang, Z.; Fang, J.B.; Chen, Z. Fast visible light indoor positioning system based on smart phone. J. Appl. Opt. 2017, 358–364. [Google Scholar] [CrossRef]
- Jaworski, W.; Wilk, P.; Zborowski, P.; Chmielowiec, W.; Lee, A.Y.; Kumar, A. Real-time 3D indoor localization. In Proceedings of the International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan, 18–21 September 2017. [Google Scholar] [CrossRef]
- Shang, J.; Hu, X.K.; Cheng, W.; Fan, H.C. GridiLoc: A Backtracking Grid Filter for Fusing the Grid Model with PDR Using Smartphone Sensors. Sensors 2016, 16, 2137. [Google Scholar] [CrossRef]
- Xu, W.L.; Liu, L.; Zlatanova, S.; Penard, W.; Xiong, Q. A pedestrian tracking algorithm using grid-based indoor model. Autom. Constr. 2018, 92, 173–187. [Google Scholar] [CrossRef]
- Chen, Y.Y.; Guo, M.Y.; Shen, J.X.; Cao, J.N. GraphLoc: A graph-based method for indoor subarea localization with zero-configuration. Pers. Ubiquitous Comput. 2017, 21, 489–505. [Google Scholar] [CrossRef]
- Zheng, H.; Zhang, Y.; Zhang, L.; Xia, H.; Bai, S.J.; Shen, G.B.; He, T.; Li, X.Y. GraFin: An applicable graph-based fingerprinting approach for robust indoor localization. In Proceedings of the 2021 IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS), Beijing, China, 14–16 December 2022; pp. 747–754. [Google Scholar] [CrossRef]
- Wang, Q.; Luo, H.Y.; Men, A.; Zhao, F.; Huang, Y. An Infrastructure-Free Indoor Localization Algorithm for Smartphones. Sensors 2018, 18, 3317. [Google Scholar] [CrossRef] [PubMed]
- Ma, Y.T.; Dou, Z.; Jiang, Q.D.; Hou, Z.H. Basmag: An Optimized HMM-Based Localization System Using Backward Sequences Matching Algorithm Exploiting Geomagnetic Information. IEEE Sens. J. 2016, 16, 7472–7482. [Google Scholar] [CrossRef]
Types of Spatial Context | Reference | Representation Forms of Landmarks | Landmark Recognition Methods | Methods of Data Integration |
---|---|---|---|---|
Landmark data | [65] | Specific locations or features, such as speed bumps and so on | Machine learning methods | Landmarks were used to correct the cumulative error of PDR; the weights of particles were updated based on the recognition results of environmental landmarks |
[66] | Clustered landmarks, such as specific indoor areas, room entrances and so on | Cluster analysis | Landmarks were used to identify the user’s behavior state and corresponding coordinates for position estimation correction | |
[67] | Specific environmental features, such as elevators, staircases, and so on. | Decision tree methods | Landmark data and sensor data were input into the EKF for data integration | |
[68] | Specific points or objects, such as doorways, staircases, and so on | Obtains landmarks from floor plans and identifies them from smartphone sensor data | Landmarks were used to construct a landmark map to assist heading estimation in the KF and were also used to calibrate the cumulative error of PDR | |
[11] | Signal strength of iBeacon | Measures signal strength to identify landmarks | Landmarks were used to assist in correcting the cumulative error of position estimation | |
[69] | Coarse–fine square code | Image recognition | Captured images using the camera sensor, performed image recognition and coordinated transformation, and calculated the camera’s central position and orientation | |
[70] | QR code | Image recognition | Used QR code information to correct PDR position estimates |
Method Classification | Localization Dimension | Data Sources and Integration Approach |
---|---|---|
Single-sensor data | 2D/3D | Geomagnetic [2,3], Wi-Fi [9,40], Bluetooth [10], Microphone [1] |
Multi-sensor data fusion | 2D | PDR [41] |
PDR+ Wi-Fi [7] | ||
PDR+ Geomagnetic [82] | ||
PDR+ Wi-Fi+ Geomagnetic [44] | ||
PDR+ Bluetooth [45] | ||
PDR+ Acoustic signal [43] | ||
Wi-Fi+ Geomagnetic [47,48] | ||
3D | Barometer + Geomagnetic [8] | |
Barometer + Wi-Fi [50] | ||
Barometer + PDR+ Geomagnetic [20] | ||
Barometer + PDR + Wi-Fi [52] | ||
Integration of sensor data and spatial context | 2D/3D | Maps+ Sensors [57] |
Landmarks+ Sensors [65] | ||
Image data [71], Spatial model [4], Grid data [77] or Graph Model [79] + Sensors |
AI Techniques | AI Algorithms or Models | Utilization | Dataset (Size) |
---|---|---|---|
Machine Learning | Fuzzy C-Means Clustering Algorithm | Clustering the data in the geomagnetic fingerprint database [2] | Geomagnetic vector data points (number: 816) |
Improved KNN Algorithm | Building upon the traditional KNN approach, pedestrian motion constraints are incorporated and the KNN algorithm is weighted using PDR location estimates [6] | RSS and offline signal fingerprint library (number:/) | |
HMM/YOLOv5 | The localization problem based on a dual-layer feature map of vision and Wi-Fi is transformed into a state sequence estimation problem, followed by the detection of safety exit signs [58] | CSI and visual feature data (number:/) | |
Random Forest Algorithm /Improved KNN Algorithm | Classify the localization environment during the fingerprint database establishment phase/compute the final location point [59] | RSS data (number:/) | |
Least Squares Support Vector Machine | Classifying seed landmarks [56] | Accelerometer and barometer data (number: 1379) | |
Decision Tree | Collaborative localization [62] | Map images features (number: 414,500); synthesized walking data (number: 600) | |
Decision Tree | Landmark recognition [67] | Sensor data (number: 1200) | |
k-means Clustering Algorithm | Used to group data points into multiple clusters for a better understanding and prediction of data characteristics [72] | Wi-Fi fingerprints (number: 300); image data (number: 50) |
AI Techniques | AI Algorithms or Models | Utilization | Dataset (Size) |
---|---|---|---|
Deep Learning | CNN | Identifying user behavior patterns [66] | Triaxial acceleration data (number:/) |
Identify ceiling areas and remove them from the feature database [74] | Image data (number: 930) | ||
Identifying user behavior patterns [46] | Sensor data (number: 28,476 s) | ||
Identifying user activities and specific behaviors like ascending or descending stairs and using an elevator [54] | Activity logs dataset (number:/) | ||
LSTM | Identifying unique patterns from the time series of sensor data that are associated with specific locations [21] | Magnetic field data (number: 15,000); light intensity data (number: 18,000) | |
Learning the mapping relationship from signal features to location information [7] | RSSI data (number:/) | ||
Bi-LSTM | Used to extract features from sensor data sources such as Wi-Fi, barometers, and magnetometers, and to predict floor information [19] | Life dataset (number:/) | |
DNN (Deep Neural Network) | Learning the nonlinear correlation between the signal strengths received from different base stations and the user’s location [15] | RSS data (number:/) | |
Lightweight DNN | Trained on the measurements from the accelerometer and gyroscope to learn the velocity change vectors, and uses these learned features to estimate the pedestrian’s trajectory [43] | IMU, SLAM data (number:/) | |
Domain Adaptation Localization Algorithm | Extracting task-relevant and device-independent Wi-Fi data features through adversarial training, and transferring the learned location information from the source domain to the target domain [9] | RSSI data (number:/) | |
LF-DLSTM | Processing local features and learning their time series patterns [22] | RSSI data (number: 81,900, 9000) | |
Wavelet-CNN | Identifying six complex human motion states, including walking, jogging, jumping, standing, climbing stairs, and descending stairs [44] | MEMS data (number: 461,450) | |
KNN Algorithm/BP Neural Network | Floor discrimination: uses Wi-Fi signal strength as a feature input, and the network outputs the predicted floor information [52] | RSSI data (number:/) |
Method Classification | Real-Time Performance |
---|---|
Single-sensor data | The algorithm performed localization twice per second, with an average single-point matching time of 7.89 ms [2]. The algorithm’s response time was at the millisecond level [10]. |
Multi-sensor data fusion | The RNN model output a localization result after five RSSI sampling cycles (i.e., 5 s) once sufficient RSSI data had been collected [7]. The update rate was 20 Hz [43]. The update rates for RSSI and MEMS sensor data were 5–10 Hz and 50 Hz [44]. Compared to non-clustered Wi-Fi fingerprint matching methods, the clustered approach significantly reduced the single-point localization time, with an average reduction of 51%, a maximum reduction of 64%, and a minimum reduction of 36% [53]. |
Integration of sensor data and spatial context | The time for a single localization operation was approximately 150 ms [58]. When the number of particles was set to 100, the map-matching-based PF algorithm converged, leading to improvements in both accuracy and stability, with a computation time of 0.5596 s, roughly equivalent to the time it took for a pedestrian to take 1–2 steps [61]. The time required for standard map matching was 1.536 s, while for semantic road network map matching it was 1.225 s [65]. The average overall localization latency was between 2 and 3 s [70]. The average computation time per walking step was 0.166 s, with the first EKF taking 0.115 s and the second EKF taking 0.051 s [67]. The average computation time was 0.42 s [71]. The average localization time was 0.6 s [72]. Without an initial position, the time required for localization was approximately 6.1 s per image. By incorporating coarse localization results and limiting the image database to a 5 m range, the localization time was reduced to 1.6 s per image. After excluding images captured by overhead cameras, the localization time further decreased to 0.8 s per image [74]. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Li, J.; Song, Y.; Ma, Z.; Liu, Y.; Chen, C. A Review of Indoor Localization Methods Leveraging Smartphone Sensors and Spatial Context. Sensors 2024, 24, 6956. https://doi.org/10.3390/s24216956
Li J, Song Y, Ma Z, Liu Y, Chen C. A Review of Indoor Localization Methods Leveraging Smartphone Sensors and Spatial Context. Sensors. 2024; 24(21):6956. https://doi.org/10.3390/s24216956
Chicago/Turabian StyleLi, Jiayi, Yinhao Song, Zhiliang Ma, Yu Liu, and Cheng Chen. 2024. "A Review of Indoor Localization Methods Leveraging Smartphone Sensors and Spatial Context" Sensors 24, no. 21: 6956. https://doi.org/10.3390/s24216956
APA StyleLi, J., Song, Y., Ma, Z., Liu, Y., & Chen, C. (2024). A Review of Indoor Localization Methods Leveraging Smartphone Sensors and Spatial Context. Sensors, 24(21), 6956. https://doi.org/10.3390/s24216956