A taxonomy of Malay social media text

• Main Authors: Maskat, R. (Author), Munarko, Y. (Author)
• Format: Article
• Language: English
• Published: Institute of Advanced Engineering and Science 2019
• Subjects: Data preprocessing; Malay language; Social media; Taxonomy; Text analytics
• Online Access: View Fulltext in Publisher; View in Scopus

 In this paper, we proposed a preliminary taxonomy of Malay social media text. Performing text analytics on Malay social media text is a challenge. The formal Malay language follows specific spelling and sentence construction rules. However, the Malay language used in social media differs in both aspects. This impedes the accuracy of text analytics. Due to the complexity of Malay social media text, many researches has chosen to focus on classifying the formal Malay language. To the best of our knowledge, we are the first to propose a formal taxonomy for Malay text in social media. Narrow and informal categorisations of Malay social media text can be found amidst efforts to pre-process social media text, yet cherry-picked only some categories to be handled. We have differentiated Malay social media text from the formal Malay language by identifying them as Social Media Malay Language or SMML. They consists of spelling variations, Malay-English mix sentence, Malay-spelling English words, slang-based words, vowel-les words, number suffixes and manner of expression. This taxonomy is expected to serve as a guideline in research and commercial products. © 2019 Institute of Advanced Engineering and Science. All rights reserved.