Find right countenance for your input—Improving automatic emoticon recommendation system with distributed representations

Barbieri, 2018, SemEval 2018 Task 2: Multilingual emoji prediction, 24 Bernico, 2018, Investigating the impact of data volume and domain similarity on transfer learning applications, Proceedings of the Future Technologies Conference, 2, 53 Chen, 2018, EmojiIt at SemEval-2018 Task 2: An effective attention-based recurrent neural network model for emoji prediction with characters gated words, 423 Çöltekin, 2018, Tübingen-Oslo at SemEval-2018 Task 2: SVMs perform better than RNNs in emoji prediction, 34 Corinna, 1995, Support-Vector Networks, Machine Learning, 20, 273, 10.1007/BF00994018 Derks, 2007, Emoticons and social interaction on the internet: The importance of social context, Computers in Human Behavior, 23, 842, 10.1016/j.chb.2004.11.013 Devlin, 2019, BERT: Pre-training of deep bidirectional transformers for language understanding, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1, 4171 Emura, 2012, Facemark recommendation based on emotion, communication, and motion type estimation in microblogs [in Japanese], Journal of Natural Language Processing, 19, 401, 10.5715/jnlp.19.401 Harada, 2004, The role of face marks in promoting smooth communication and expressing consideration and politeness in Japanese [in Japanese], Language and Culture: The Journal of the Institute for Language and Culture, 8, 205 Inoue, 1997, System for analyzing emotional expression in e-mail text: Collection, classification, and analysis of emotional expressions [in Japanese], IEICE Technical Report Thought and Language, 96, 1 Ip, A. (2002). The Impact of Emoticons on Affect Interpretation in Instant Messaging. http://www.amysmile.com/doc/emoticon_paper.pdf. Jibril, 2013, Relevance of emoticons in computer-mediated communication contexts: An overview, Asian Social Science, 9, 201, 10.5539/ass.v9n4p201 Kikuta, Y. (2019). BERT Pretrained Model Trained on Japanese Wikipedia Articles. https://github.com/yoheikikuta/bert-japanese. Kingma, 2015, ADAM: A method for stochastic optimization, 1 Kudo, 2018, SentencePiece: A simple and language dependent subword Tokenizer and Detokenizer for neural text processing, 66 Kudo, 2004, Applying conditional random fields to Japanese morphological analysis, 230 LeCun, 2015, Deep learning, Nature, 521, 436, 10.1038/nature14539 Li, 2019, Emoji-aware attention-based bi-directional GRU network model for Chinese sentiment analysis, 11 Li, 2018, Tourism review sentiment classification using a bidirectional recurrent neural network with an attention mechanism and topic-enriched word vectors, Sustainability, 10, 1 Mehrabian, 1971, 1 Mikolov, 2013, Distributed representations of words and phrases and their compositionality, Advances in Neural Information Processing Systems, 26, 3111 Nakamura, 1993, 1 Park, 2013, Emoticon style: Interpreting differences in emoticons across cultures, 466 Pedregosa, 2011, Scikit-learn: Machine learning in python, Journal of Machine Learning Research, 12, 2825 Peters, 2018, Deep contextualized word representations, Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 1, 2227 Ptaszynski, 2017, ML-ask: Open source affect analysis software for textual input in Japanese, Journal of Open Research Software, 5, 1, 10.5334/jors.149 Ptaszynski, 2012, YACIS: A five-billion-word corpus of Japanese blogs fully annotated with syntactic and affective information, 40 Řehůřek, 2010, Software framework for topic modelling with large corpora, 45 Sakaki, T., Mizuki, S., & Gunji, N. (2019). BERT Pre-trained Model Trained on Large-scale Japanese Social Media Corpus. https://github.com/hottolink/hottoSNS-bert. Schuster, 1997, Bidirectional recurrent neural networks, IEEE Transactions on Signal Processing, 45, 2673, 10.1109/78.650093 Steck, 2013, Evaluation of recommendations: Rating-prediction and ranking, 213 Suzuki, 2006, Express emoticons choice method for smooth communication of E-business, vol. 4252, 296 Tomi, 2013, Emoticons, FIP - Financije i Pravo, 1, 35 Urabe, 2014, Emoticon recommendation system to richen your online communication, 2014 International Journal of Multimedia Data Engineering and Management, 5, 13 Urabe, 2016, Study of emoticon selection process for future emoticon recommendation systems [in Japanese], 1 Vaswani, 2017, Attention is all you need, Advances in Neural Information Processing Systems, 30, 5998 Weng, L. (2017). Learning Word Embedding. https://lilianweng.github.io/lil-log/2017/10/15/learning-word-embedding.html. Wilcoxon, 1992, Individual comparisons by ranking methods, 196 Yamamoto, 2015, Multidimensional sentiment calculation method for twitter based on emoticons, International Journal of Pervasive Computing and Communications, 11, 212, 10.1108/IJPCC-03-2015-0019 Yang, 2016, Hierarchical attention networks for document classification, 1480 Yata, S. (2010). Nihongo Web Corpus 2010. http://www.s-yata.jp/corpus/nwc2010/. Zhang, 2020, Emoji prediction: A transfer learning approach, vol. 1130, 864