No Detail Found!

Learning an efficient text augmentation strategy and DQN and XLNet to improve sentiment analysis applications

Author(s)
Hussein Ali Salman Department of electrical and computer engineering, Urmia University,Urmia,Iran
MortezaValizadeh Department of electrical and computer engineering, Urmia University,Urmia,Iran
Vahid Talavat Department of electrical and computer engineering, Urmia University,Urmia,Iran
Abstract
Modern machine learning models like deep neural networks contain numerous parameters and thus necessitate large labeled datasets for training. Often, there is a shortage of labeled data in many scenarios, leading to overfitting. A popular solution to this scarcity is data augmentation, which involves expanding training datasets by altering data points in a way that retains their class labels. This method assumes that additional information can be leveraged from the existing dataset through modifications, which enhance the training set size either by altering data forms or by oversampling. Data augmentation techniques enhance the diversity of training data without the need to gather new data and have become essential in boosting the performance of deep neural networks across various areas, including computer vision. However, the application of these techniques in natural language processing has been limited due to its complexity. In our study, we employ the DQN method, a blend of reinforcement learning and deep learning for augmenting text data. We used various neural networks like CNN, Bi-LSTM+Attention, Transformer, BERT, and XLNet. Our tests on the SemEval dataset showed improvements across most networks, with the combination of DQN and XLNet achieving the highest accuracy at 66%.
Publication Details
Page(s) 20-36
DOI DOI not available
Published Journal: International Journal of Communication Networks and Information Security, Volume: 16, Issue: 5, Year: 2024

Request the full text from PASTIC

Keywords
Neural Network, data augmentation, DQN Algorithm, Natural Language Processing Reinforcement Learning
References
Bayer M.,A. Kaufhold C.,Reuter C. .2021 ."A survey on data augmentation for text classification,". ACM Computing Surveys, : .
Li B.,Hou Y.,Che W. .2022 ."Data augmentation approaches in natural language processing: A survey,". AI Open, : .
Coulombe C . .2018 ."Text data augmentation made simple by leveraging nlp cloud apis,". , : .
Banko M.,Brill E. .2001 ."Scaling to very very large corpora for natural language disambiguation," in Proceedings of the 39th annual meeting of the Association for Computational Linguistics. , : 26-33.
Feng S. Y. .2021 ."A survey of data augmentation approaches for NLP,". arXiv preprint arXiv:2105.03075, : .
Kobayashi S.,Short Papers) .2018 ."Contextual Augmentation: Data Augmentation by Words with Paradigmatic Relations," in Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. , 2 : 452-457.
Wei J.,Zou K. .2019 ."Eda :Easy data augmentation techniques for boosting performance on text classification tasks,". , : .
Alzantot M.,Sharma Y.,Elgohary A.,Ho B.-J.,Srivastava M.,K.-W. Chang M. .2018 ."Generating natural language adversarial examples,". , : .
Wong S. C.,Gatt A.,Stamatescu V.,M. D. McDonnell V. .2016 ."Understanding data augmentation for classification: when to warp?," in 2016 international conference on digital image computing: techniques and applications. , : 1-6.
Tobin J.,Fong R.,Ray A.,Schneider J.,Zaremba W.,Abbeel P. .2017 ."Domain randomization for transferring deep neural networks from simulation to the real world," in 2017 IEEE/RSJ international conference on intelligent robots and systems. , : 23-30.
Shorten C.,Khoshgoftaar T. M. .2019 ."A survey on image data augmentation for deep learning,". Journal of big data, 6(1) : 1-48.
Tang R. .2020 ."Rapidly bootstrapping a question answering dataset for COVID-19,". , : .
Cachola I.,Lo K.,Cohan A.,Weld D. S. .2020 ."TLDR: Extreme summarization of scientific documents,". , : .
Shorten C.,Khoshgoftaar T. M .,Furht B. .2021 ."Text data augmentation for deep learning,". Journal of big Data, 8(1) : 1-34.
Raille G.,Djambazovska S.,Musat C. .2020 ."Fast cross-domain data augmentation through neural sentence editing,". , : .
Madnani N.,Dorr B. J. .2010 ."Generating phrasal and sentential paraphrases: A survey of data-driven methods,". Computational Linguistics, 36(3) : 341-387.
Naeem M.,Rizvi S. T. H.,Coronato A. .2020 ."A gentle introduction to reinforcement learning and its application in different fields,". IEEE Access, 8 : 209320-209344.
Dave V. S.,Dutta K. .2014 ."Neural network based models for software effort estimation: a review,". Artificial Intelligence Review, 42(2) : 295-307.
Mozaffari A.,Emami M.,Fathi A. .2019 ."A comprehensive investigation into the performance, robustness, scalability and convergence of chaos-enhanced evolutionary algorithms with boundary constraints,". Artificial Intelligence Review, 52(4) : 2319-2380.
Abiodun O. I.,Jantan A.,Omolara A. E.,Dada K. V.,Mohamed N. A.,Arshad H. .2018 ."State-of-theart in artificial neural network applications: A survey,". Heliyon, 4(11) : e00938.
Li H.,Ma Y.,Ma Z.,Zhu H. .2021 ."Weibo text sentiment analysis based on bert and deep learning,". Applied Sciences, 11(22) : 10774.
Jang B.,Kim M.,Kim J. W. .2020 ."Bi-LSTM model to increase accuracy in text classification: Combining Word2vec CNN and attention mechanism,". Applied Sciences, 10(17) : 5841.
Singh S.,Mahmood A. .2021 ."The NLP cookbook: modern recipes for transformer based deep learning architectures,". IEEE Access, 9 : 68675-68702.
Yang Z.,Dai Z.,Yang Y.,Salakhutdinov R. R.,Le Q. V. .2019 ."Xlnet: Generalized autoregressive pretraining for language understanding,". Advances in neural information processing systems, 32 : .
Miller G. A. .1995 ."WordNet: a lexical database for English,". Communications of the ACM, 38(11) : 39-41.
Zhang X.,Zhao J.,LeCun Y. .2015 ."Character-level convolutional networks for text classification,". Advances in neural information processing systems, 28 : .
Mueller J.,Thyagarajan A. . ."Siamese recurrent architectures for learning sentence similarity,". 2016, 30 : .
Daval-Frerot G.,Weis Y. .2020 ."WMD at SemEval-2020 Tasks 7 and 11: Assessing humor and propaganda using unsupervised data augmentation,". in Proceedings of the Fourteenth Workshop on Semantic Evaluation, : 1865-1874.
Dai X.,Adel H. .2020 ."An analysis of simple data augmentation for named entity recognition,". , : .
Zhang D.,Li T.,Zhang H.,Yin B. .2020 ."On data augmentation for extreme multi-label classification,". , : .
Zuo X.,Chen Y.,Liu K.,Zhao J .2020 ."KnowDis: Knowledge enhanced data augmentation for event causality detection via distant supervision,". , : .
K. K. Schuler .2005 .VerbNet: A broad-coverage, comprehensive verb lexicon. , : .
Wang W. Y.,Yang D. .2015 ."That's so annoying!!!: A lexical and frame-semantic embedding based data augmentation approach to automatic categorization of annoying behaviors using# petpeeve tweets,". in Proceedings of the 2015 conference on empirical methods in natural language processing, : 2557-2563.
Mikolov T.,Chen K.,Corrado G. S.,Dean J. .2013 ."Distributed representations of words and phrases and their compositionality,". Advances in neural information processing systems, 26 : .
Liu S.,Lee K.,and I. Lee K. .2020 ."Document-level multi-topic sentiment classification of email data with bilstm and data augmentation," Knowledge-Based Systems. , 197 : 105918.
Jiao X. .2019 ."TinyBERT: Distilling BERT for Natural Language Understanding," arXiv e-prints. , : .
Regina M.,Goutal S. .2020 ."Text Data Augmentation: Towards better detection of spearphishing emails,". , : .
Tapia-Téllez and H. J. Escalante J. M. .2020 ."Data augmentation with transformers for text classification,". in Mexican International Conference on Artificial Intelligence, : 247-259.
Lowell D.,Howard B. E.,Lipton Z. C.,Wallace B. C. .2020 ."Unsupervised data augmentation with naive augmentation and without unlabeled data,". , : .
Palomino D.,Luna J. O. .2020 .Transformer-based Data Augmentation for Overcoming Few-Shot Learning,". in IberLEF@ SEPLN, : 171-178.
Fadaee M.,Bisazza A.,Monz C.,Short Papers) .2017 ."Data Augmentation for Low-Resource Neural Machine Translation," in Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. , 2 : 567-573.
Dehouck M.,Gómez-Rodríguez C. .2020 ."Data augmentation via subtree swapping for dependency parsing of low-resource languages,". in Proceedings of the 28th International Conference on Computational Linguistics, : 3818-3830.
Louvan S.,Magnini B. .2020 ."Simple is Better! Lightweight Data Augmentation for Low Resource Slot Filling and Intent Classification,". in Proceedings of the 34th Pacific Asia Conference on Language, Information and Computation, : 167-177.
Xie Q.,Dai Z.,Luong T.,Le Q. .2020 ."Unsupervised data augmentation for consistency training,". Advances in Neural Information Processing Systems, 33 : 6256-6268.
Yu A. W. .2018 ."Qanet: Combining local convolution with global self-attention for reading comprehension,". , : .
A. R. Fabbriet al. .2021 ."Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentation,". in Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, : 704-717.
Zhang Y.,Sun X. .2020 ."Parallel Data Augmentation for Formality Style Transfer,". in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, : 3221-3228.
Qu Y.,Shen D.,Shen Y.,Sajeev S.,Chen W. .2020 ."Coda: Contrast-enhanced and diversitypromoting data augmentation for natural language understanding,". , : .
Nishikawa S.,Ri R.,Tsuruoka Y. .2021 ."Data Augmentation with Unsupervised Machine Translation Improves the Structural Similarity of Cross-lingual Word Embeddings," in Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th. International Joint Conference on Natural Language Processing: Student Research Workshop, : 163-173.
Bornea M.,Pan L.,Rosenthal S.,Florian R.,Sil A. .2021 ."Multilingual transfer learning for qa using translation as data augmentation,". in Proceedings of the AAAI Conference on Artificial Intelligence, 35(14) : 12583-12591.
Barriere V.,Balahur A. .2020 ."Improving sentiment analysis over non-english tweets using multilingual transformers and automatic translation for data-augmentation,". , : .
Hou Y.,Liu Y.,Che W. .2018 ."Sequence-to-sequence data augmentation for dialogue language understanding,". , : .
Hou Y.,Chen S.,Che W.,Chen C. .2021 ."C2c-genda: Cluster-to-cluster generation for data augmentation of slot filling,". in Proceedings of the AAAI Conference on Artificial Intelligence, 35(14) : 13027-13035.
Kober T.,Weeds J.,Bertolini L.,Weir D. .2020 ."Data augmentation for hypernymy detection,". , : .
Liu D. .2020 ."Tell me how to ask again: Question data augmentation with controllable rewriting in continuous space,". , : .
Yan G.,Li Y.,Zhang S.,Chen Z. .2019 ."Data augmentation for deep learning of judgment documents,". in International Conference on Intelligent Science and Big Data Engineering, : 232-242.
Longpre S.,Wang Y.,C. Y. .2020 .DuBois, "How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers?,". , : .
Rastogi C.,Mofid N.,F.-I. Hsiao N. .2020 ."Can we achieve more with less? exploring data augmentation for toxic comment classification,". , : .
Luque F. M. .2019 .Data augmentation and robust embeddings for sentiment analysis,". Atalaya at TASS, : .
Peng B.,Zhu C.,Zeng M.,Gao J. .2020 ."Data augmentation for spoken language understanding via pretrained language models,". , : .
Z. Xieet al. ,Wang X.,Pham H.,Dai Z.,Neubig G. .2018 ."SwitchOut: an efficient data augmentation algorithm for neural machine translation,". , : .
Qin L.,Ni M.,Zhang Y.,Che W. .2020 ."Cosda-ml: Multi-lingual code-switching data augmentation for zero-shot cross-lingual nlp,". , : .
Song X.,Zang L.,Hu S. .2021 ."Data augmentation for copy-mechanism in dialogue state tracking,". in International Conference on Computational Science, : 736-749.
Min J.,McCoy J.,D. Das E.,Pitler T.,Linzen T. .2020 ."Syntactic data augmentation increases robustness to inference heuristics,". , : .
Liu Q.,Guan W.,Li S.,Cheng F.,Kurohashi S. .2021 ."RODA: Reverse Operation Based Data Augmentation for Solving Math Word Problems,". IEEE/ACM Transactions on Audio, Speech, and Language Processing, 30 : 1-11.
Kang D.,Khot T.,Sabharwal A.,Hovy E. . ."AdvEntuRe: Adversarial Training for Textual Entailment with Knowledge-Guided Examples.". , : .
Yin Y.,Shang L.,Jiang X.,Chen X.,Liu Q. .2020 ."Dialog state tracking with reinforced data augmentation,". in Proceedings of the AAAI Conference on Artificial Intelligence, 34(05) : 9474-9481.
Sennrich R.,Haddow B.,Birch A. . ."Improving Neural Machine Translation Models with Monolingual Data," in 54th Annual Meeting of the Association for Computational Linguistics, 2016: Association for Computational Linguistics (ACL. , : 86-96.
K. M. Yoo Y.,Shin Y. . ."Data augmentation for spoken language understanding via joint variational generation,". 2019, 33(01) : 7402-7409.
Anaby-Tavoret al A. .2020 ."Do not have enough data? Deep learning to the rescue!,". in Proceedings of the AAAI Conference on Artificial Intelligence, 34(05) : 7383-7390.
Kumar V.,Choudhary A.,Cho E.,Ng N.,Cho K.,Ghassemi M.,EMNLP M. .2020 .Association for Computational Linguistics (ACL. , : 1268-1283.
Quteineh H.,Samothrakis S.,Sutcliffe R. .2020 ."Textual data augmentation for efficient active learning on tiny datasets,". in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), : 7400-7410.
Tarján B.,Fegyó T.,Mihajlik P. .2020 ."Deep Transformer based Data Augmentation with Subword Units for Morphologically Rich Online ASR,". , : .
Thakur N.,Reimers N.,Daxenberger J.,and I. Gurevych J. .2020 ."Augmented sbert: Data augmentation method for improving bi-encoders for pairwise sentence scoring tasks,". , : .
Miao L.,Last M.,Litvak M. .2020 ."Twitter Data Augmentation for Monitoring Public Opinion on COVID-19 Intervention Measures,". in NLP4COVID@ EMNLP, : .
Yang Y.,Jin N.,Lin K.,Guo M.,Cer D. .2020 ."Neural retrieval for question answering with crossattention supervised data augmentation,". , : .
Du J. .2020 ."Self-training improves pre-training for natural language understanding,". , : .
Liu R.,Jia C.,Wang S.,Vosoughi S. .2020 ."Data boost: Text data augmentation through reinforcement learning guided conditional generation,". , : .
Yu P.,Zhang R.,Zhao Y.,Zhang Y.,Li C.,Chen C. .2021 ."SDA: Improving text generation with self data augmentation,". arXiv preprint arXiv:2101.03236, : .
Fang J.,Li P. .2020 ."Data augmentation with reinforcement learning for document-level event coreference resolution,". in CCF International Conference on Natural Language Processing and Chinese Computing, : 751-763.
Li K.,Chen C.,Quan X.,Ling Q.,Song Y. .2020 ."Conditional augmentation for aspect term extraction via masked sequence-to-sequence generation,". , : .
Mou X.,Sigouin B.,I. Steenstra B.,Su H. .2020 ."Multimodal dialogue state tracking by qa approach with data augmentation,". , : .
Chen Y.,Lu S.,Yang F.,Huang X.,Fan X.,Guo C. .2020 ."Pattern-aware Data Augmentation for Query Rewriting in Voice Assistant Systems,". , : .
Montella S.,Fabre B.,Urvoy T.,Heinecke J.,Rojas-Barahona J. .2020 ."Denoising pre-training and data augmentation strategies for enhanced RDF verbalization with transformers,". , : .
. ." https://alt. , : .
Rosenthal S.,Farra N.,Nakov P. .2019 ."SemEval-2017 task 4: Sentiment analysis in Twitter,". , : .
0

Citations

0

Downloads

48

Views