I am using Apache Zeppelin with the interpreter binding configured in "Per User Scoped" mode. While working with multiple users and notebooks, I've observed some behavior regarding what is shared and what is isolated between users and notes. Here are my observations:
Python Variables:
Functions Dealing with Spark Context:
addPyFile
, do not affect other users. For example, when one user adds a file using this function, the added files are not visible to other users.sqlContext.setConf("spark.sql.shuffle.partitions")
, affect all users. For example, changing the number of shuffle partitions impacts all users globally.Given this behavior, I would like to understand:
addPyFile
) appear user-specific, while others (like sqlContext.setConf
) seem to apply globally?Any clarification on how Zeppelin handles resource sharing in this mode would be greatly appreciated.