Building Real-time communication with Apache Spark through Apache Livy

Dockerizing and Consuming an Apache Livy environment

Ramses Alexander Coraspe Valdez
ITNEXT
Published in
5 min readJun 12, 2022

--

Dockerizing and Consuming an Apache Livy environment

We all know what Apache Spark is, There are two approaches to submit jobs to an Apache Spark cluster programmatically and each of them comes with some limitations in order to achieve a real time interaction, spark-submit and spark-shell are the only options…

--

--

Writer for

Very passionate about data engineering and technology, love to design, create, test and write ideas, I hope you like my articles.