Improving Text Classification using Deep Neural Networks and Word Embeddings

Natural Language Processing is a flourishing aspect of Data Science in both academia and industry. This paper examines the technique of sentiment classification on text data using automated Machine learning approaches. It will delve into newly introduced embedding techniques and machine learning model pipelines. The models explored in this paper consist of a simple Naive Bayes classifier, as well as several Deep Neural Models, including a Gated Recurrent Unit (GRU) and a Long Term Short Term architecture. Several different forms of numerical representations of words (word em- beddings) are introduced to supplement the neural models in an attempt to build a solid sentiment predictor.

Overall, the Neural methods outperformed Naive Bayes. Furthermore, the neural methods performed very similarly; the word embed- dings and suggested feature extraction yielded very little gain, leading to the conclusion that in the case of these experiments, a simple model would be preferred. Perhaps in the future for a stronger model, it would be beneficial to optimize the parameters with grid search, or by acquiring a larger variety of data for transfer learning. 

Subscribe to access this work and thousands more
Report
Overall Rating

0

5 Star
(0)
4 Star
(0)
3 Star
(0)
2 Star
(0)
1 Star
(0)
APA

Herforth, N. (2020). Improving Text Classification using Deep Neural Networks and Word Embeddings. Afribary. Retrieved from https://afribary.com/works/improving-text-classification-using-deep-neural-networks-and-word-embeddings

MLA 8th

Herforth, Nicolai "Improving Text Classification using Deep Neural Networks and Word Embeddings" Afribary. Afribary, 28 Dec. 2020, https://afribary.com/works/improving-text-classification-using-deep-neural-networks-and-word-embeddings. Accessed 29 Mar. 2024.

MLA7

Herforth, Nicolai . "Improving Text Classification using Deep Neural Networks and Word Embeddings". Afribary, Afribary, 28 Dec. 2020. Web. 29 Mar. 2024. < https://afribary.com/works/improving-text-classification-using-deep-neural-networks-and-word-embeddings >.

Chicago

Herforth, Nicolai . "Improving Text Classification using Deep Neural Networks and Word Embeddings" Afribary (2020). Accessed March 29, 2024. https://afribary.com/works/improving-text-classification-using-deep-neural-networks-and-word-embeddings

Document Details
By: Nicolai Herforth Field: Computer / Mathematics Type: Project 7 PAGES (3417 WORDS) (pdf)