FTFPOS-IDF: A Fuzzy Rule-Based Thematic Term Weighting Scheme for Bloom's Taxonomy Question Classification

Authors

DOI:

https://doi.org/10.26877/asset.v8i3.2957

Keywords:

Question, Bloom Taxonomy, Thematic, Fuzzy, Classification

Abstract

The increasing adoption of Artificial Intelligence (AI) in education has created a growing demand for automated and reliable assessment systems. Existing Bloom’s Taxonomy (BT) question classification approaches commonly rely on TF-IDF-based weighting schemes, which assign static term weights and often fail to capture the varying thematic importance of terms across cognitive levels. To address this limitation, this study proposes a novel Fuzzy Thematic Feature and Part-of-Speech Inverse Document Frequency (FTFPOS-IDF) weighting scheme that integrates fuzzy rule-based reasoning with Natural Language Processing (NLP) to dynamically assign thematic weights according to Bloom’s Taxonomy relevance. The proposed framework combines Machine Learning (ML) and Deep Learning (DL) classifiers with Chi-Square feature selection to reduce irrelevant features and improve classification performance. Experimental results demonstrate that FTFPOS-IDF consistently outperforms conventional TF-IDF variants across multiple classification models. The highest performance was achieved by the Multilayer Perceptron (MLP) classifier with an accuracy of 86.7%. These findings indicate that fuzzy rule-based thematic weighting can effectively enhance Bloom’s Taxonomy question classification and support scalable, reliable, and sustainable digital assessment systems in educational environments.

Author Biographies

  • Sucipto, Universitas Negeri Malang

    Faculty Engineering, Universitas Negeri Malang, Jl. Cakrawala No.5 Malang, East Java 65145, Indonesia

    Faculty of Engineering and Informatics, Universitas Nusantara PGRI Kediri, Jl. Ahmad Dahlan No.76 Kediri, East Java 64112, Indonesia

  • Didik Dwi Prasetya, Universitas Negeri Malang

    Faculty Engineering, Universitas Negeri Malang, Jl. Cakrawala No.5 Malang, East Java 65145, Indonesia

  • Triyanna Widiyaningtyas, Universitas Negeri Malang

    Faculty Engineering, Universitas Negeri Malang, Jl. Cakrawala No.5 Malang, East Java 65145, Indonesia

References

[1] L. Chen, P. Chen, and Z. Lin, “Artificial Intelligence in Education: A Review,” IEEE Access, vol. 8, pp. 75264–75278, 2020, doi: https://doi.org/10.1109/ACCESS.2020.2988510.

[2] B. Memarian and T. Doleck, “A review of assessment for learning with artificial intelligence,” Computers in Human Behavior: Artificial Humans, vol. 2, no. 1, p. 100040, Jan. 2024, doi: https://doi.org/10.1016/J.CHBAH.2023.100040.

[3] K. Stolpe and J. Hallström, “Artificial intelligence literacy for technology education,” Computers and Education Open, vol. 6, p. 100159, Jun. 2024, doi: https://doi.org/10.1016/J.CAEO.2024.100159.

[4] S. Sucipto, D. D. Prasetya, and T. Widiyaningtyas, “Educational Data Mining: Multiple Choice Question Classification in Vocational School,” Matrik: Jurnal Manajemen, Teknik Informatika, dan Rekayasa Komputer, vol. 23, no. 2, pp. 367–376, 2024, doi: https://doi.org/10.30812/matrik.v23i2.3499.

[5] M. Murtaza, Y. Ahmed, J. A. Shamsi, F. Sherwani, and M. Usman, “AI-Based Personalized E-Learning Systems: Issues, Challenges, and Solutions,” IEEE Access, vol. 10, pp. 81323–81342, 2022, doi: https://doi.org/10.1109/ACCESS.2022.3193938.

[6] D. D. Prasetya, A. Pinandito, Y. Hayashi, and T. Hirashima, “Analysis of quality of knowledge structure and students’ perceptions in extension concept mapping,” Res. Pract. Technol. Enhanc. Learn., vol. 17, no. 1, pp. 1–25, Dec. 2022, doi: https://doi.org/10.1186/S41039-022-00189-9/FIGURES/8.

[7] F. Y. Yu, “Multiple peer-assessment modes to augment online student question-generation processes,” Comput. Educ., vol. 56, no. 2, pp. 484–494, Feb. 2011, doi: https://doi.org/10.1016/J.COMPEDU.2010.08.025.

[8] M. C. Rupa and K. Ramani, “Hybrid Approaches for Advanced Medical Text Summarization: Combining TF-IDF, BERT, and Seq2Seq Models,” Advance Sustainable Science Engineering and Technology, vol. 7, no. 3, pp. 0250301–0250301, Aug. 2025, doi: https://doi.org/10.26877/ASSET.V7I3.1427.

[9] J. K. Stringer et al., “Examining Bloom’s Taxonomy in Multiple Choice Questions: Students’ Approach to Questions,” Med. Sci. Educ., vol. 31, no. 4, 2021, doi: https://doi.org/10.1007/s40670-021-01305-y.

[10] H. Sharma, R. Mathur, T. Chintala, S. Dhanalakshmi, and R. Senthil, “An effective deep learning pipeline for improved question classification into bloom’s taxonomy’s domains,” Educ. Inf. Technol. (Dordr)., vol. 28, no. 5, 2023, doi: https://doi.org/10.1007/s10639-022-11356-2.

[11] A. A. Salatino, T. Thanapalasingam, A. Mannocci, F. Osborne, and E. Motta, “The computer science ontology: A large-scale taxonomy of research areas,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11137 LNCS, pp. 187–205, 2018, doi: https://doi.org/10.1007/978-3-030-00668-6_12/FIGURES/8.

[12] S. Sucipto, D. D. Prasetya, and T. Widiyaningtyas, “A review questions classification based on Bloom taxonomy using a data mining approach,” ITEGAM-JETIA, vol. 10, no. 48, pp. 161–170, Aug. 2024, doi: https://doi.org/10.5935/JETIA.V10I48.1204.

[13] P. M. Patil, R. P. Bhavsar, and B. V. Pawar, “Bloom’s Taxonomy based automatic Marathi question generation,” International Journal of Advanced Technology and Engineering Exploration, vol. 11, no. 113, pp. 575–603, Apr. 2024, doi: https://doi.org/10.19101/IJATEE.2023.10102163.

[14] M. O. Gani, R. K. Ayyasamy, A. Sangodiah, and Y. T. Fui, “Bloom’s Taxonomy-based exam question classification: The outcome of CNN and optimal pre-trained word embedding technique,” Educ. Inf. Technol. (Dordr)., vol. 28, no. 12, pp. 15893–15914, Dec. 2023, doi: https://doi.org/10.1007/S10639-023-11842-1/FIGURES/10.

[15] T. Volarić, H. Ljubić, and R. Rozić, “Fuzzy-Based Knowledge Design and Delivery Model for Personalised Learning,” Communications in Computer and Information Science, vol. 2124 CCIS, pp. 152–163, 2024, doi: https://doi.org/10.1007/978-3-031-62058-4_11.

[16] N. Sun, “English Speaking Teaching Strategies Based on Natural Language Processing,” Journal of Electrical Systems, vol. 19, no. 4, pp. 102–115, 2023, doi: 10.52783/JES.626.

[17] I. Vayansky and S. A. P. Kumar, “A review of topic modeling methods,” Inf. Syst., vol. 94, p. 101582, Dec. 2020, doi: https://doi.org/10.1016/J.IS.2020.101582.

[18] A. A. Yahya, Z. Toukal, and A. Osman, “Bloom’s taxonomy-based classification for item bank questions using support vector machines,” Studies in Computational Intelligence, vol. 431, pp. 135–140, 2012, doi: https://doi.org/10.1007/978-3-642-30732-4_17/COVER.

[19] M. Mohammed and N. Omar, “Question classification based on Bloom’s Taxonomy using enhanced TF-IDF,” Int. J. Adv. Sci. Eng. Inf. Technol., vol. 8, no. 4–2, 2018, doi: https://doi.org/10.18517/ijaseit.8.4-2.6835.

[20] M. O. Gani, R. K. Ayyasamy, S. M. Alhashmi, A. Sangodiah, and Y. T. Fui, “ETFPOS-IDF: A Novel Term Weighting Scheme for Examination Question Classification Based on Bloom’s Taxonomy,” IEEE Access, vol. 10, pp. 132777–132785, 2022, doi: https://doi.org/10.1109/ACCESS.2022.3230592.

[21] M. Chindukuri and S. Sivanesan, “Transfer learning for Bloom’s taxonomy-based question classification,” Neural Comput. Appl., vol. 36, no. 31, pp. 19915–19937, Nov. 2024, doi: https://doi.org/10.1007/S00521-024-10241-Y/FIGURES/15.

[22] K. Chen, Z. Zhang, J. Long, and H. Zhang, “Turning from TF-IDF to TF-IGM for term weighting in text classification,” Expert Syst. Appl., vol. 66, pp. 245–260, Dec. 2016, doi: https://doi.org/10.1016/J.ESWA.2016.09.009.

[23] A. O. Balogun et al., “An Adaptive Rank Aggregation-Based Ensemble Multi-Filter Feature Selection Method in Software Defect Prediction,” Entropy, vol. 23, no. 1274, p. 1274, Sep. 2021, doi: https://doi.org/10.3390/E23101274.

[24] I. Saifudin and T. Widiyaningtyas, “Systematic Literature Review on Recommender System: Approach, Problem, Evaluation Techniques, Datasets,” IEEE Access, pp. 1–1, 2024, doi: https://doi.org/10.1109/ACCESS.2024.3359274.

[25] A. A. Yahya, “Swarm intelligence-based approach for educational data classification,” Journal of King Saud University - Computer and Information Sciences, vol. 31, no. 1, pp. 35–51, Jan. 2019, doi: https://doi.org/10.1016/J.JKSUCI.2017.08.002.

[26] A. Sangodiah, T. J. San, Y. T. Fui, L. E. Heng, R. K. Ayyasamy, and N. B. A. Jalil, “Identifying Optimal Baseline Variant of Unsupervised Term Weighting in Question Classification Based on Bloom Taxonomy,” Mendel, vol. 28, no. 1, 2022, doi: https://doi.org/10.13164/mendel.2022.1.008.

[27] P. Wang et al., “Classification of Proactive Personality: Text Mining Based on Weibo Text and Short-Answer Questions Text,” IEEE Access, vol. 8, pp. 97370–97382, 2020, doi: https://doi.org/10.1109/ACCESS.2020.2995905.

[28] T. Wang, Y. Cai, H. fung Leung, R. Y. K. Lau, H. Xie, and Q. Li, “On entropy-based term weighting schemes for text categorization,” Knowl. Inf. Syst., vol. 63, no. 9, 2021, doi: https://doi.org/10.1007/s10115-021-01581-5.

[29] H. Hairani, T. Widiyaningtyas, and D. D. Prasetya, “Feature Selection and Hybrid Sampling with Machine Learning Methods for Health Data Classification,” Revue d’Intelligence Artificielle, vol. 38, no. 4, p. 1255, Aug. 2024, doi: https://doi.org/10.18280/RIA.380419.

[30] G. W. Nurcahyo, "Product Codefication Accuracy With Cosine Similarity And Weighted Term Frequency And Inverse Document Frequency (TF-IDF)," Journal of Applied Engineering and Technological Science (JAETS), vol. 2, no. 2, pp. 62-69, 2021, doi: https://doi.org/10.37385/jaets.v2i2.210.

Downloads

Published

2026-06-18

Issue

Section

Articles