Photo: Annie Spratt / Unsplash · Royalty-free Big Data
Data note · Spark 2 extends the RDDs(Resilient Distributed Dataset) in terms of a "DataFrame" Dataframe contains Row Objects thus give you power to use…
Read Note
Photo: Christina @ wocintechchat.com / Unsplash · Royalty-free Big Data
Data note · Apache Spark is super lightening fast Hadoop distributed processing service. Its execute in-memory that's why it is the fastest of all processing…
Read Note
Photo: Alexandre Debiève / Unsplash · Royalty-free Big Data
Data note · As we know that the core of the Hadoop's distributed processing system is MapReduce. We can use on the top technologies like…
Read Note
Photo: Alexandre Debiève / Unsplash · Royalty-free Big Data
Data note · As we know that HDFS is the distributed storage system of Hadoop. Similarly MapReduce is the core processing engine. Recently TEZ is…
Read Note
Photo: Maximilian Wittmann / Unsplash · Royalty-free Big Data
Data note · As we saw in out last post that we successfully uploaded data to HDFS( stands for Hadoop File System and is the…
Read Note
Photo: Annie Spratt / Unsplash · Royalty-free Big Data
Data note · In Hadoop Architecture, while HDFS is the distributed file system, MapReduce or Tez are the distributed processing engines. To process huge amount…
Read Note