Understanding Resource Sharing in Zeppelin with "Per User Scoped" Interpreter Binding Mode - Stack Overflow

admin2025-04-27  3

I am using Apache Zeppelin with the interpreter binding configured in "Per User Scoped" mode. While working with multiple users and notebooks, I've observed some behavior regarding what is shared and what is isolated between users and notes. Here are my observations:

  1. Python Variables:

    • All notes share Python variables for the same user.
    • Python variables are not shared among different users.
  2. Functions Dealing with Spark Context:

    • Some functions, like addPyFile, do not affect other users. For example, when one user adds a file using this function, the added files are not visible to other users.
    • Other functions, like sqlContext.setConf("spark.sql.shuffle.partitions"), affect all users. For example, changing the number of shuffle partitions impacts all users globally.

Given this behavior, I would like to understand:

  • What is shared and what is not shared between different users in "Per User Scoped" mode?
  • Why do some Spark-related configurations (like addPyFile) appear user-specific, while others (like sqlContext.setConf) seem to apply globally?

Any clarification on how Zeppelin handles resource sharing in this mode would be greatly appreciated.

转载请注明原文地址:http://anycun.com/QandA/1745705415a91078.html