Apache Spark
-
Software Development
Introduction to Apache Spark with Examples and Use Cases
I first heard of Spark in late 2013 when I became interested in Scala, the language in which Spark is…
Read More » -
Enterprise Java
Spark 101: What Is It, What It Does, and Why It Matters
Recently, a new name has entered many of the conversations about big data. Some people see the popular newcomer Apache…
Read More » -
Software Development
Resource Allocation Configuration for Spark on YARN
In this blog post, I will explain the resource allocation configurations for Spark on YARN, describe the yarn-client and yarn-cluster…
Read More » -
Software Development
Spark Backend for Apache Gora
I’ve worked for Spark backend of Apache Gora as my GSoC 2015 project and finished it. At this blog post, I’ll…
Read More » -
Enterprise Java
Apache Spark: 5 Pitfalls You MUST Solve Before Changing Your Architecture
The top 5 things you need to know before moving to Apache Spark It seems like everyone’s only talking about…
Read More » -
Software Development
Spark, Parquet and S3 – It’s complicated
(A version of this post was originally posted in AppsFlyer’s blog. Also special thanks to Morri Feldman and Michael Spector…
Read More » -
Enterprise Java
Getting started with Spark: it is possible to create lightweight RESTful application also in Java
Recently I have been writing a RESTful service using Spark, a web framework for Java (which is not related to Apache Spark). When we…
Read More » -
Software Development
Scale Effects, Machine Learning, and Spark
“In 1997, IBM asked James Barry to make sense of the company’s struggling web server business. Barry found that IBM…
Read More » -
Software Development
Spark and Cluster Computing
In this post I’ll mention the first paper at which Spark is introduced, Spark: Cluster Computing with Working Sets. This post…
Read More »