Memory Utilization in R: The Impact of Data Management Frameworks (Packages)

Authors

Anant P. Awasthi, Department of Statistics, Amity University, Gautam Buddha Nagar, Uttar Pradesh, IndiaFollow
Niraj K . Singh, Department of Statistics, Amity University, Gautam Buddha Nagar, Uttar Pradesh, IndiaFollow
Masood H. Siddiqui, Department of Statistics, University of Lucknow, Lucknow, Uttar Pradesh, IndiaFollow
Aanchal A. Awasthi, Department of Statistics, Amity University, Gautam Buddha Nagar, Uttar Pradesh, IndiaFollow

Author Country (or Countries)

India

Abstract

Memory management is a very important component of running large workloads in computing. It takes into account the capacity & limitations of the available memory on the device itself and deallocates memory space when it is not needed or expands the space through virtual memory. Memory management strives to optimize memory usage so that the CPU can efficiently access the instructions and data it needs to execute the various processes. This work is focused on memory utilization by different data management frameworks in R on different platforms. We have considered Native R, tidyverse, and data.table as data management frameworks. Very high precision (1e-5+1 to 1e-6+1) visual analysis of memory utilization data shows Native R memory management is better when compared to tidyverse and data.table. But, when we are analysing data on a large scale and observe the memory utilization, it shows no significant difference in distribution of memory utilization across different sample sizes. We have established the same results using analysis of variance (ANOVA) and analysis of coefficients of linear regression models.

Digital Object Identifier (DOI)

https://dx.doi.org/10.18576/jsap/130217

Recommended Citation

P. Awasthi, Anant; K . Singh, Niraj; H. Siddiqui, Masood; and A. Awasthi, Aanchal (2024) "Memory Utilization in R: The Impact of Data Management Frameworks (Packages)," Journal of Statistics Applications & Probability: Vol. 13: Iss. 2, Article 19.
DOI: https://dx.doi.org/10.18576/jsap/130217
Available at: https://digitalcommons.aaru.edu.jo/jsap/vol13/iss2/19