A Decision Support System Based on Transformer-Driven Sentiment Analysis of Social Media Data
DOI:
https://doi.org/10.26877/asset.v8i2.3123Keywords:
Decision support systems, transformer-based embeddings, social media sentiment modeling, NLP pipeline architecture, human-in-the-loop AIAbstract
The growing availability of social media data offers new opportunities for decision support systems (DSS) in large-scale human resource screening. This study proposes a technology-driven DSS architecture integrating transformer-based sentiment analysis to support early-stage candidate profiling. Its novelty lies in combining IndoBERT-based sentence embeddings with a structured DSS layer that aggregates tweet-level sentiment into risk-aware recommendations, rather than treating sentiment classification as a standalone output. Using a quantitative experimental design, 5,000 public posts from 100 users were processed through an NLP pipeline incorporating mean-pooled embeddings, feature engineering, principal component analysis, and Support Vector Machine classification. The model achieved 69.1% accuracy, with weighted precision, recall, and F1-score of 0.694, 0.691, and 0.691, outperforming baseline models by 6.5–15.0 percentage points. Sentiment outputs are treated as probabilistic behavioral signals within an advisory DSS framework, not direct indicators of candidate suitability. Preliminary validation on 50 cases showed moderate correlations (ρ = 0.52–0.61) with conventional assessments. The system remains non-automated, incorporating confidence thresholds, uncertainty handling, and mandatory human oversight. Limitations include moderate accuracy, reliance on text-only data, and linguistic ambiguity.
References
[1] M. Syukri, “Situasi dan kondisi media digital di Indonesia: Meningkatkan keamanan dan ketahanan digital — The SMERU Research Institute,” 2023. [Online]. Available: https://smeru.or.id/id/research-id/situasi-dan-kondisi-media-digital-di-indonesia-meningkatkan-keamanan-dan-ketahanan
[2] Z. Elmenzhi, S. Alji, A. Maghni, and M. Belamhitou, “Exploring the impact of big data analytics on recruitment practices,” in International Conference on Advanced Intelligent Systems for Sustainable Development. Springer, 2024, pp. 882–898. https://doi.org/10.1007/978-3-031-91337-2_78
[3] S. Ziegler, “What every PD needs in a social media recruitment plan,” Oct. 2020. [Online]. Available: https://www.police1.com/police-recruiting/articles/what-every-pd-needs-in-a-social-media-recruitment-plan-hSz8NU7u48RvtHYr/
[4] E. Grunenberg, H. Peters, M. J. Francis, M. D. Back, and S. C. Matz, “Machine learning in recruiting: Predicting personality from CVs and short text responses,” Frontiers in Social Psychology, vol. 1, p. 1290295, 2024. https://doi.org/10.3389/frsps.2023.1290295
[5] R. Moraes, L. L. Pinto, M. Pilankar, and P. Rane, “Personality assessment using social media for hiring candidates,” in 2020 3rd International Conference on Communication System, Computing and IT Applications (CSCITA). IEEE, 2020, pp. 192–197. https://doi.org/ 10.1109/CSCITA47329.2020.9137818.
[6] M. M. Tadesse, H. Lin, B. Xu, and L. Yang, “Personality predictions based on user behavior on the Facebook social media platform,” IEEE Access, vol. 6, pp. 61 959–61 969, 2018. https://doi.org/10.1109/ACCESS.2018.2876502
[7] A. Souri, S. Hosseinpour, and A. M. Rahmani, “Personality classification based on profiles of social networks’ users and the Five-Factor Model of personality,” Human-centric Computing and Information Sciences, vol. 8, no. 1, p. 24, 2018. https://doi.org/10.1186/s13673-018-0147-4
[8] A. Naz, H. U. Khan, A. Bukhari, B. Alshemaimri, A. Daud, and M. Ramzan, “Machine and deep learning for personality traits detection: A comprehensive survey and open research challenges,” Artificial Intelligence Review, vol. 58, no. 8, p. 239, 2025. https://doi.org/10.1007/s10462-025-11245-3
[9] H. Christian, D. Suhartono, A. Chowanda, and K. Z. Zamli, “Text-based personality prediction from multiple social media data sources using pre-trained language model and model averaging,” Journal of Big Data, vol. 8, no. 1, p. 68, 2021. https://doi.org/10.1186/s40537-021-00459-1
[10] F. Habib, Z. Ali, A. Azam, K. Kamran, and F. M. Pasha, “Navigating pathways to automated personality prediction: A comparative study of small and medium language models,” Frontiers in Big Data, vol. 7, p. 1387325, 2024. https://doi.org/10.3389/fdata.2024.1387325
[11] T. Joseph, “Natural language processing (NLP) for sentiment analysis in social media,” International Journal of Computing and Engineering, vol. 6, no. 2, pp. 35–48, 2024.
[12] M. Ranjan, S. Tiwari, A. M. Sattar, and N. S. Tatkar, “A new approach for carrying out sentiment analysis of social media comments using natural language processing,” Engineering Proceedings, vol. 59, no. 1, p. 181, 2024. https://doi.org/10.3390/engproc2023059181
[13] K. Chaudhary, M. Alam, M. S. Al-Rakhami, and A. Gumaei, “Machine learning-based mathematical modelling for prediction of social media consumer behavior using big data analytics,” Journal of Big Data, vol. 8, no. 1, p. 73, 2021. https://doi.org/10.1186/s40537-021-00466-2
[14] S. B. Abkenar, M. H. Kashani, E. Mahdipour, and S. M. Jameii, “Big data analytics meets social media: A systematic review of techniques, open issues, and future directions,” Telematics and Informatics, vol. 57, p. 101517, 2021. https://doi.org/10.1016/j.tele.2020.101517
[15] J. Gilbert, S. Hamid, I. A. T. Hashem, N. A. Ghani, and F. F. Boluwatife, “The rise of user profiling in social media: Review, challenges and future direction,” Social Network Analysis and Mining, vol. 13, no. 1, p. 137, 2023. https://doi.org/10.1007/s13278-023-01146-0
[16] N. Han, S. Li, F. Huang, Y. Wen, Y. Su, L. Li, X. Liu, and T. Zhu, “How social media expression can reveal personality,” Frontiers in Psychiatry, vol. 14, p. 1052844, 2023. https://doi.org/10.3389/fpsyt.2023.1052844
[17] M. D. Kamalesh and B. Bharathi, “Personality prediction model for social media using machine learning technique,” Computers and Electrical Engineering, vol. 100, p. 107852, 2022. https://doi.org/10.1016/j.compeleceng.2022.107852
[18] Q. Tang, W. Jiang, Y. Du, and L. Lin, “An attention-based denoising framework for personality detection in social media texts,” arXiv preprint arXiv:2311.09945, 2023. https://doi.org/ 10.1109/ISPA67752.2025.00097
[19] G. Alwafi and B. Fakieh, “A machine learning model to predict privacy-fatigued users from social media personalized advertisements,” Scientific Reports, vol. 14, no. 1, p. 3685, 2024. https://doi.org/10.1038/s41598-024-54078-w
[20] Y. Kong and H. Ding, “Tools, potential, and pitfalls of social media screening: Social profiling in the era of AI-assisted recruiting,” Journal of Business and Technical Communication, vol. 38, no. 1, pp. 33–65, 2024. https://doi.org/10.1177/10506519231199478
[21] J. W. Creswell and J. D. Creswell, Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Sage Publications, 2017.
[22] W. Bleidorn and C. J. Hopwood, “Using machine learning to advance personality assessment and theory,” Personality and Social Psychology Review, vol. 23, no. 2, pp. 190–203, 2019. https://doi.org/10.1177/1088868318772990
[23] R. Baly et al., “What was written vs. who read it: News media profiling using text analysis and social media context,” arXiv preprint arXiv:2005.04518, 2020. https://doi.org/ 10.18653/v1/2020.acl-main.308
[24] S. M. Mohammad and P. D. Turney, “Crowdsourcing a word–emotion association lexicon,” Computational Intelligence, vol. 29, no. 3, pp. 436–465, 2013. https://doi.org/10.1111/j.1467-8640.2012.00460.x
[25] F. Koto, A. Rahimi, J. H. Lau, and T. Baldwin, “IndoLEM and IndoBERT: A benchmark dataset and pre-trained language model for Indonesian NLP,” arXiv preprint arXiv:2011.00677, 2020. https://doi.org/10.18653/v1/2020.coling-main.66
[26] A. Ghasempour, “Support vector regression to predict power consumption,” Electrical & Computer Engineering Technical Reports, 2024.
[27] N. Reimers and I. Gurevych, “Sentence-BERT: Sentence embeddings using Siamese BERT-networks,” in Proc. EMNLP, 2019, pp. 3982–3992. https://doi.org/10.18653/v1/D19-1410
[28] P. L. Roth, P. Bobko, C. H. Van Iddekinge, and J. B. Thatcher, “Social media in employee-selection-related decisions: A research agenda for uncharted territory,” Journal of Management, vol. 42, no. 1, pp. 269–298, 2016. https://doi.org/10.1177/0149206313503018
[29] M. Raghavan, S. Barocas, J. Kleinberg, and K. Levy, “Mitigating bias in algorithmic hiring: Evaluating claims and practices,” in Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, 2020, pp. 469–481. https://doi.org/10.1145/3351095.3372828
[30] J. Dastin, “Amazon scraps secret AI recruiting tool that showed bias against women,” in Ethics of Data and Analytics. Auerbach Publications, 2022, pp. 296–299.
[31] B. H. Zhang, B. Lemoine, and M. Mitchell, “Mitigating unwanted biases with adversarial learning,” in Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, 2018, pp. 335–340. https://doi.org/10.1145/3278721.3278779
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Advance Sustainable Science Engineering and Technology
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
