Deep Learning Classification of Traffic-Related Tweets: An Advanced Framework Using Deep Learning for Contextual Understanding and Traffic-Related Short Text Classification
Journal article
Authors | Abdi, A., Melhem, W. and Meziane, F. |
---|---|
Abstract | Classifying social media (SM) messages into relevant or irrelevant categories is challenging due to data sparsity, imbalance, and ambiguity. This study aims to improve Intelligent Transport Systems (ITS) by enhancing short text classification of traffic-related SM data. Deep learning methods such as RNNs, CNNs, and BERT are effective at capturing context, but they can be computationally expensive, struggle with very short texts, and perform poorly with rare words. On the other hand, transfer learning leverages pre-trained knowledge but may be biased towards the pre-training domain. To address these challenges, we propose DLCTC, a novel system combining character-level, word-level, and context features with BiLSTM and TextCNN-based attention. By utilizing external knowledge, DLCTC ensures an accurate understanding of concepts and abbreviations in traffic-related short texts. BiLSTM captures context and term correlations; TextCNN captures local patterns. Multi-level attention focuses on important features across character, word, and concept levels. Experimental studies demonstrate DLCTC’s effectiveness over well-known short-text classification approaches based on CNN, RNN, and BERT. |
Keywords | short text classification; BiLSTM–TextCNN integration; multi-level attention mechanism; character–word–concept embeddings; traffic-related social media analysis; intelligent transport systems (ITS) |
Year | 2024 |
Journal | Applied Sciences |
Journal citation | 14 (23), pp. 1-21 |
Publisher | MDPI |
ISSN | 2076-3417 |
Digital Object Identifier (DOI) | https://doi.org/10.3390/app142311009 |
Web address (URL) | https://www.mdpi.com/journal/applsci |
https://www.mdpi.com/2076-3417/14/23/11009 | |
Funder | University of Derby |
Accepted author manuscript | License File Access Level Open |
Publisher's version | License File Access Level Open |
Output status | Published |
Publication dates | |
Online | 27 Nov 2024 |
Publication process dates | |
Accepted | 20 Nov 2024 |
Deposited | 18 Dec 2024 |
https://repository.derby.ac.uk/item/qv2y0/deep-learning-classification-of-traffic-related-tweets-an-advanced-framework-using-deep-learning-for-contextual-understanding-and-traffic-related-short-text-classification
Download files
Accepted author manuscript
applsci-14-11009.pdf | ||
License: CC BY 4.0 | ||
File access level: Open |
Publisher's version
applsci-14-11009.pdf | ||
License: CC BY 4.0 | ||
File access level: Open |
102
total views3
total downloads6
views this month1
downloads this month
Export as
Related outputs
Traffic Detection and Forecasting from Social Media Data Using a Deep Learning-Based Model, Linguistic Knowledge, Large Language Models, and Knowledge Graphs
Melhem, W., Abdi, A. and Meziane, F. 2024. Traffic Detection and Forecasting from Social Media Data Using a Deep Learning-Based Model, Linguistic Knowledge, Large Language Models, and Knowledge Graphs. 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management. SCITEPRESS - Science and Technology Publications. https://doi.org/10.5220/0013066900003838Unequal-Radius Clustering in WSN-Based IoT Networks : Energy Optimization and Load Balancing in UDCOPA Protocol
Mir, F. and Meziane, F. 2024. Unequal-Radius Clustering in WSN-Based IoT Networks : Energy Optimization and Load Balancing in UDCOPA Protocol. The Journal of Supercomputing. pp. 1-32. https://doi.org/10.1007/s11227-024-06426-wQuantitative Scalability of Nodes and Geographical Coverage in LEACH Protocol
Mir, F., Meziane, F., Bounceur, A. and Laouid, A. 2024. Quantitative Scalability of Nodes and Geographical Coverage in LEACH Protocol. 6th International Conference on Pattern Analysis and Intelligent Systems (PAIS). IEEE Computer Society. https://doi.org/10.1109/PAIS62114.2024.10541142EDCOPA : Enhancing DCOPA Protocol by Exploring New Criteria for Improved Clustering
Mir, F., Bounceur, A. and Meziane, F. 2024. EDCOPA : Enhancing DCOPA Protocol by Exploring New Criteria for Improved Clustering. Proceedings of the 7th International Conference on Future Networks and Distributed Systems (ICFNDS '23). ACM Press. https://doi.org/10.1145/3644713.36448Lung CT Image Segmentation Using VGG-16 Network with Image Enhancement Based on Bounded Turning Mittag-Leffler Function
Hasan, A.M., Khalaf, M., Sabbar, B.M., Ibrahim, R.W., A. Jalab, H.A. and Meziane, F. 2024. Lung CT Image Segmentation Using VGG-16 Network with Image Enhancement Based on Bounded Turning Mittag-Leffler Function. Baghdad Science Journal. 21 (12), pp. 1-11. https://doi.org/10.21123/bsj.2024.9286LICA-CS: Efficient Lossless Image Compression Algorithm via Column Subtraction Model
Al Qerom, M., Otair, M., Meziane, F., AbdulRahman, S. and Alzubi, M. 2024. LICA-CS: Efficient Lossless Image Compression Algorithm via Column Subtraction Model. Journal of Robotics and Control. 5 (5), pp. 1311-3121. https://doi.org/10.18196/jrc.v5i5.21834Enhancing vessel arrival time prediction: A fusion-based deep learning approach
Abdi, A. and Amrit, C. 2024. Enhancing vessel arrival time prediction: A fusion-based deep learning approach. Expert Systems With Applications. 252 (A), pp. 1-19. https://doi.org/10.1016/j.eswa.2024.123988A graph based named entity disambiguation using clique partitioning and semantic relatedness
Belalta, R., Belazzoug, M. and Meziane, F. 2024. A graph based named entity disambiguation using clique partitioning and semantic relatedness. Data and Knowledge Engineering. pp. 1-27. https://doi.org/10.1016/j.datak.2024.102308Investigation of Artifact Contamination Impact on EEG Oscillations Towards Enhanced Motor Function Characterization
Asogbon, M.G., Samuel, O., Meziane, F., Li, G. and Li, Y. 2024. Investigation of Artifact Contamination Impact on EEG Oscillations Towards Enhanced Motor Function Characterization. 17th International Joint Conference on Biomedical Engineering Systems and Technologies - BIOSIGNALS. SCITEPRESS - Science and Technology Publications. https://doi.org/10.5220/0012373400003657Exploring Imaging Biomarkers for Early Detection of Alzheimer’s Disease Using Deep Learning: A Comprehensive Analysis
Sami, N., Makkar, A., Meziane, F. and Conway, M. 2024. Exploring Imaging Biomarkers for Early Detection of Alzheimer’s Disease Using Deep Learning: A Comprehensive Analysis. International Conference on Recent Trends in Image Processing and Pattern Recognition. Springer. https://doi.org/10.1007/978-3-031-53085-2_17Novel Adaptive DCOPA Using Dynamic Weighting for Vector of Performances Indicators Optimization of IoT Networks
Mir, F. and Meziane, F. 2024. Novel Adaptive DCOPA Using Dynamic Weighting for Vector of Performances Indicators Optimization of IoT Networks. Expert Systems with Applications. 247, pp. 1-23. https://doi.org/10.1016/j.eswa.2024.123212Molecular subtypes classification of breast cancer in DCE-MRI using deep features
Hasan, A.M., Al-Waely, N.K.N., Aljobouri, H.K., Jalab, H.A., Ibrahim, R.W. and Meziane, F. 2024. Molecular subtypes classification of breast cancer in DCE-MRI using deep features. Expert Systems with Applications. 236, pp. 1-8. https://doi.org/10.1016/j.eswa.2023.121371FNMD: An Evaluation of Machine Learning and Deep Learning Techniques for Fake News Detection
Daneshvar, B., Abdi, A. and Hosseini, SM. 2023. FNMD: An Evaluation of Machine Learning and Deep Learning Techniques for Fake News Detection. International Conference on Recent Trends in Image Processing and Pattern Recognition. Springer. https://doi.org/10.1007/978-3-031-53082-1_22Feedback digitalization preferences in online and hybrid classroom: Experiences from lockdown and implications for post-pandemic education
Sedrakyan, G., Borsci, S., Abdi, A., van den Berg, S., Veldkamp, B. and Hillegersberg , J. 2023. Feedback digitalization preferences in online and hybrid classroom: Experiences from lockdown and implications for post-pandemic education. Journal of Research in Innovative Teaching & Learning. pp. 1-20. https://doi.org/10.1108/JRIT-02-2023-0014Methods and Applications of Data Mining in Business Domains
Abdi, A. and Amrit, C. 2023. Methods and Applications of Data Mining in Business Domains. Applied Sciences. 19 (13), pp. 1-4. https://doi.org/10.3390/app131910774Diagnosis of Breast Cancer Based on Hybrid Features Extraction in Dynamic Contrast Enhanced Magnetic Resonance Imaging
Hasan, A.M., Aljobouri, H.K., Al-Waely, K.N.A., Ibrahim, W.I., Jalab, H.A. and Meziane, F. 2023. Diagnosis of Breast Cancer Based on Hybrid Features Extraction in Dynamic Contrast Enhanced Magnetic Resonance Imaging. Neural Computing and Applications. pp. 1-14. https://doi.org/10.1007/s00521-023-08909-yUnequal Clustering Protocol in IoT Networks Based on Multiple Criteria Processing
Mir, F. and Meziane, F. 2023. Unequal Clustering Protocol in IoT Networks Based on Multiple Criteria Processing. 6th International Conference on Information Science and Systems (ICISS 2023). ACM Press.Classification Model of Breast Masses in DCE-MRI Using Kinetic Curves Features with Quantum-Raina’s Polynomial Based Fusion
Hasan, A.M., Al-Waely, N.K.N., Ajobouri, H.K., Ibrahim, R.W., Jalab, H.A. and Meziane, F. 2023. Classification Model of Breast Masses in DCE-MRI Using Kinetic Curves Features with Quantum-Raina’s Polynomial Based Fusion. Biomedical Signal Processing and Control. 84, pp. 1-12. https://doi.org/10.1016/j.bspc.2023.105002The Impact of Arabic Diacritization on Word Embeddings
Abbache, M., Abbache, A., Xu, J.W., Meziane, F. and Wen, X.B. 2023. The Impact of Arabic Diacritization on Word Embeddings. ACM Transactions on Asian and Low-Resource Language Information Processing . pp. 1-32. https://doi.org/10.1145/3592603Students feedback analysis model using deep learning-based method and linguistic knowledge for intelligent educational systems
Abdi, A., Sedrakyan, G., Veldkamp, B., van Hillegersberg, J. and van den Berg, S. 2023. Students feedback analysis model using deep learning-based method and linguistic knowledge for intelligent educational systems. Soft Computing. pp. 1-22. https://doi.org/10.1007/s00500-023-07926-2
A review of the generation of requirements specification in natural language using objects UML models and domain ontology
Abdalazeima, Alaa and Meziane, Farid 2021. A review of the generation of requirements specification in natural language using objects UML models and domain ontology. Procedia Computer Science. 189, pp. 328-334. https://doi.org/10.1016/j.procs.2021.05.102Mitigation of Popularity Bias in Recommendation Systems
Karboua, S., Harrag, F., Meziane, F. and Boutadjine, A. 2022. Mitigation of Popularity Bias in Recommendation Systems. Tunisian-Algerian Joint Conference on Applied Computing. Constantine, Algeria 14 - 15 Dec 2022Describing Pulmonary Nodules Using 3D Clustering
Al-Funjan, A., Farid Meziane and Aspin, R. 2022. Describing Pulmonary Nodules Using 3D Clustering. Advanced Engineering Research. 22 (3), pp. 261-271. https://doi.org/10.23947/2687-1653-2022-22-3-261-271Credit Risk Prediction for Peer-To-Peer Lending Platforms: An Explainable Machine Learning Approach
Swee, C.P., Labadin, J. and Meziane, F. 2022. Credit Risk Prediction for Peer-To-Peer Lending Platforms: An Explainable Machine Learning Approach. Journal of Computing and Social Informatics. 1 (2), pp. 1-16. https://doi.org/10.33736/jcsi.4761.2022DCOPA: a distributed clustering based on objects performances aggregation for hierarchical communications in IoT applications
Mir, F. and Meziane, F. 2022. DCOPA: a distributed clustering based on objects performances aggregation for hierarchical communications in IoT applications. Cluster Computing. 26, p. 1077–1098. https://doi.org/10.1007/s10586-022-03741-w
Botnet detection used fast-flux technique, based on adaptive dynamic evolving spiking neural network algorithm
Almomani, Ammar, Nawasrah, Ahmad Al, Alauthman, Mohammad, Betar, Mohammed Azmi Al and Meziane, Farid 2021. Botnet detection used fast-flux technique, based on adaptive dynamic evolving spiking neural network algorithm. International Journal of Ad Hoc and Ubiquitous Computing. 36 (1), p. 50. https://doi.org/10.1016/j.cosrev.2020.100305
MRI brain classification using the quantum entropy LBP and deep-learning-based features
Hasan, Ali M., Jalab, Hamid A., Ibrahim, Rabha W., Meziane, Farid, AL-Shamasneh, Ala’a R. and Obaiys, Suzan J. 2020. MRI brain classification using the quantum entropy LBP and deep-learning-based features. Entropy. 22 (9), p. 1033. https://doi.org/10.3390/e22091033