Bench marking of classification algorithms: Decision Trees and Random Forests-a case study using R

Manish Varma Datla

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

Decision Trees and Random Forests are leading Machine Learning Algorithms, which are used for Classification purposes. Through the course of this paper, a comparison is made of classification results of these two algorithms, for classifying data sets obtained from Kaggle's Bike Sharing System and Titanic problems. The solution methodology deployed is primarily broken into two segments. First, being Feature Engineering where the given instance variables are made noise free and two or more variables are used together to give rise to a valuable third. Secondly, the classification parameters are worked out, consisting of correctly classified instances, incorrectly classified instances, Precision and Accuracy. This process ensured that the instance variables and classification parameters were best treated before they were deployed with the two algorithms i.e. Decision Trees and Random Forests. The developed model has been validated by using Systems data and the Classification results. From the model it can safely be concluded that for all classification problems Decision Trees is handy with small data sets i.e. less number of instances and Random Forests gives better results for the same number of attributes and large data sets i.e. with greater number of instances. R language has been used to solve the problem and to present the results.

Original languageEnglish
Title of host publicationInternational Conference on Trends in Automation, Communication and Computing Technologies, I-TACT 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781467366670
DOIs
Publication statusPublished - 15-06-2016
Externally publishedYes
Event2015 International Conference on Trends in Automation, Communication and Computing Technologies, I-TACT 2015 - Bangalore, India
Duration: 21-12-201522-12-2015

Conference

Conference2015 International Conference on Trends in Automation, Communication and Computing Technologies, I-TACT 2015
CountryIndia
CityBangalore
Period21-12-1522-12-15

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Hardware and Architecture
  • Control and Systems Engineering
  • Instrumentation

Fingerprint Dive into the research topics of 'Bench marking of classification algorithms: Decision Trees and Random Forests-a case study using R'. Together they form a unique fingerprint.

Cite this