Skip to content

Spark-2.0 Kernel startup is failing due to "data/libs/streaming-twitter-assembly-1.6.jar" has jopt-simple version 3.2 #4

@mahadev-khapali

Description

@mahadev-khapali

Spark-2.0 Kernel startup is failing with below error when user has pushed library "streaming-twitter-assembly-1.6.jar" to his "data/libs" directory.

"data/libs/streaming-twitter-assembly-1.6.jar" has jopt-simple version 3.2 which not compatible with "toree" with spark02.0, can you please update your "streaming-twitter-assembly-1.6.jar" with "jopt-simple-4.6.jar" or above level version.

TMP=/gpfs/fs01/user/sc01-4b6feb1d1106ba-5fc93277e5ba/kgateway/tmp
USER=sc01-4b6feb1d1106ba-5fc93277e5ba
Starting Spark Kernel with SPARK_HOME=/usr/local/src/spark20master/spark
Exception in thread "main" java.lang.NoSuchMethodError: joptsimple/OptionParser.allowsUnrecognizedOptions()V
at org.apache.toree.boot.CommandLineOptions.(CommandLineOptions.scala:31)
at org.apache.toree.Main$.delayedEndpoint$org$apache$toree$Main$1(Main.scala:25)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions