Using Text Mining of Big Data for Prediction

From time-to-time in this Blog we draw your attention to some of the applications of text analytics. In the last few years one of those areas has been predictive analysis, using text mining to explore large databases. Using text mining to learn from past behavior, discover patterns and identify trends, allows researchers are able to make predictions in different fields. This blog is based on the paper Big Data for Prediction: Patent Analysis. The analysis of patents using text mining can help investors and inventors get a better sense of where a...

read more

PART I: Automatic Machine Learning Document Classification – An Introduction

This blog focuses on Automatic Machine Learning Document Classification (AML-DC), which is part of the broader topic of Natural Language Processing (NLP).  NLP itself can be described as “the application of computation techniques on language used in the natural form, written text or speech, to analyse and derive certain insights from it” (Arun, 2018). AML-DC aims to automatically assign ‘a data-point to a predefined class or group according to its predictive characteristics’ (Kabir et. al., 2018). AML-DC is the essence of text mining as it transects,...

read more