kumo-ai/incubator-livy

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere, enabling users to execute code snippets or programs in a Spark context running locally or in Apache Hadoop YARN. It supports interactive shells for Scala, Python, and R, as well as batch submissions, and allows multiple users to share the same server with impersonation support. This project is ideal for developers and data engineers who need to submit Spark jobs from various locations without modifying their existing programs.