sbt程序集插件包括“提供的”库及其沿袭

sc4hvdpw  于 2021-06-25  发布在  Flink
关注(0)|答案(1)|浏览(328)

这是我的build.sbt

resolvers  ++= Seq("Apache Development Snapshot Repository" at "https://repository.apache.org/content/repositories/snapshots/",
  Resolver.mavenLocal)

name := "flink-wiki-edits"

version := "1.0"

scalaVersion := "2.11.7"

val flinkVersion = "1.1.3"

val flinkDependencies = Seq(
  "org.apache.flink" %% "flink-scala" % flinkVersion % "provided",
  "org.apache.flink" %% "flink-streaming-scala" % flinkVersion % "provided",
  "org.apache.flink" %% "flink-connector-wikiedits"% flinkVersion )

lazy val root = (project in file(".")).
  settings(
    libraryDependencies ++= flinkDependencies
  )

mainClass in assembly := Some("com.ta.WikipediaAnalytics")

// make run command include the provided dependencies
run in Compile <<= Defaults.runTask(fullClasspath in Compile, mainClass in (Compile, run), runner in (Compile, run))

// exclude Scala library from assembly
assemblyOption in assembly := (assemblyOption in assembly).value.copy(includeScala = false)

以及 $ sbt assembly ```
vagrant@vagrant-ubuntu-trusty-64:/workspace/flink-wiki-edits$ sbt assembly
[info] Loading project definition from /workspace/flink-wiki-edits/project
[info] Set current project to flink-wiki-edits (in build file:/workspace/flink-wiki-edits/)
[info] Including: flink-connector-wikiedits_2.11-1.1.3.jar
[info] Including: flink-streaming-java_2.11-1.1.3.jar
[info] Including: flink-core-1.1.3.jar
[info] Including: flink-annotations-1.1.3.jar
[info] Including: jsr305-1.3.9.jar
[info] Including: commons-lang3-3.3.2.jar
[info] Including: slf4j-api-1.7.7.jar
[info] Including: slf4j-log4j12-1.7.7.jar
[info] Including: log4j-1.2.17.jar
[info] Including: force-shading-1.1.3.jar
[info] Including: flink-metrics-core-1.1.3.jar
[info] Including: kryo-2.24.0.jar
[info] Including: minlog-1.2.jar

在那里我看到很多图书馆是

"org.apache.flink" %% "flink-scala" % flinkVersion % "provided",
"org.apache.flink" %% "flink-streaming-scala" % flinkVersion % "provided"

我假设provided在组装fat jar时会排除库,如果我忽略了什么,请告诉我。
eiee3dmh

eiee3dmh1#

这是由flink连接器引起的wikiedits库依赖于flink-streaming-java_2.11,请参阅:flink-streaming-java_2.11 pom:

<dependency>
      <groupId>org.apache.flink</groupId>
      <artifactId>flink-streaming-java_2.11</artifactId>
      <version>1.1.3</version>
      <scope>compile</scope>
    </dependency>

而且flink-streaming-java2.11还有flinkcore。。。相关性,请参见:
http://search.maven.org/#artifactdetails%7corg.apache.flink%7cflink-streaming-java\u 2.11%7c1.1.3%7cjar

相关问题