RStudio: MemoryError: Java heap space

Working with not so big data in my laptop, I often encounter a problem such as, when I want to read thousand of file to RStudio. The error message can be seen below: Error in code execution because of “java.lang.OutOfMemoryError: Java heap space” What is the solution? I embed those code to increase the allocation …

How to load Parquet data into R

Apache Parquet is a columnar storage format available to any project in the Hadoop ecosystem, regardless of the choice of data processing framework, data model or programming language. Parquet datafile usually coming from a Spark system. Two package in R that normally used to read parquet file: SparkR and sparklyr I use “sparklyr” package because …