top of page


Sqoop Import from MySQL to Hive & HBase
In last post we discussed Sqoop concepts and demos on how to move data from RDBMS to HDFS and from HDFS back to RDBMS. Today we will...
Sep 19, 20213 min read


Flume & Spark Streaming Integration
In this post, we will integrate Flume and Spark Streaming. We will use Spark Streaming to process data that we will get from Flume. Flume...
Aug 18, 20213 min read


Spark Streaming: Streaming Word Count
In last post, we used flume from Hadoop toolset to stream data from Twitter to HDFS location for analysis. In this blog, we are going to...
Aug 16, 20212 min read
Running Hive Queries in Spark
Hive quries can be executed from Spark Shell. Hive comes with Spark Library as HiveContext, which is inherited from SQLContext....
Jul 3, 20211 min read
bottom of page