被撤回的出版物: Application of LDA and word2vec to detect English off-topic composition (Retracted article. See vol. 18, 2023)

This paper presents an off-topic detection algorithm combining LDA and word2vec aiming at the problem of the lack of accurate and efficient off-topic detection algorithms in the English composition-assisted review system. The algorithm uses the LDA model to model the document and train the document through the word2vec, and uses the semantic relationship between the document's topics and words to calculate the probability weighted sum for each topic and its feature words in the document, and finally selects the off-topic composition by setting a reasonable threshold. Different F values are obtained by changing the number of topics in the document, and the best number of topics is determined. Experimental results show that the proposed method is more effective than vector space model, can detect more off-topic compositions, and the accuracy is higher, the F value is more than 88%, which realizes the intelligent processing of off-topic detection of composition, and can be effectively applied in English composition teaching.

Automated summary

This paper proposes an off-topic detection algorithm by combining LDA and word2vec, which solves the accuracy and efficiency problems in off-topic detection of English compositions. The algorithm models and trains the document using the LDA model and word2vec, calculates the probability weighted sum for each topic and its feature words based on the semantic relationship between topics and words, and selects off-topic compositions by setting a reasonable threshold. Experimental results show that this method is more effective than the vector space model, capable of detecting more off-topic compositions with higher accuracy.