第2章 编译安装 2.1 编译环境准备 本教程的相关组件版本如下: Hadoop 3.1.3 Hive 3.1.2 Flink 1.13.6,scala-2.12 Spark 3.2.2,scala-2.12
/sbt assembly(这个过程十分漫长,有条件的同学建议挂个代理) 编译好之后:diffy/target/scala-2.12/diffy-server.jar(diffy根目录的相对路径下) 启动 /target/scala-2.12/diffy-server.jar\ -candidate='127.0.0.1:80'\ -master.primary='127.0.0.1
success] Total time: 0 s, completed Nov 6, 2020, 2:20:26 PM [info] Wrote /home/admin/CMAK-3.0.0.5/target/scala [info] Main Scala API documentation to /home/admin/CMAK-3.0.0.5/target/scala-2.12/api... [info] compiling 136 Scala sources and 2 Java sources to /home/admin/CMAK-3.0.0.5/target/scala-2.12/classes
info: package mode @ mixed, scala-2.12 dist: /Users/achao/Downloads/streampark-release/incubator-streampark 2 [StreamPark] build info: package mode @ mixed, scala-2.12, now build starting... info: package mode @ mixed, scala-2.12 dist: /Users/achao/Downloads/streampark-release/incubator-streampark
dependencies for modules specified for each version separately --> <profiles> <profile> <id>scala
hudi.git && cd hudi•mvn clean package -DskipTests注意:默认是用scala-2.11编译的 如果我们用的是flink1.12.2-2.12版本,可以自己编译成scala
确认无误后执行编译命令, sbt:hello-scala> compile [info] Compiling 1 Scala source to D:\idea-projects\hello-scala\target\scala
hudi.git && cd hudi mvn clean package -DskipTests 注意:默认是用scala-2.11编译的 如果我们用的是flink1.12.2-2.12版本,可以自己编译成scala
Contents/Home/bin/java -cp /Users/sandyshu/code/spark/conf/:/Users/sandyshu/code/spark/assembly/target/scala
Zeppelin 主要feature: Feature Feature 说明 多版本Flink支持 同时支持 Flink 1.10 到 1.15 的 6 个大版本,并且同时支持Scala-2.11 和Scala
[info] Compiling 140 Scala sources and 2 Java sources to /home/xuqingkang/CMAK/target/scala-2.12/classes
在 IDEA 右边 Maven 选项中进行 Maven Profile 勾选:dev、flink-1.17、jdk1.8、scala-2.12、web,然后继续使用它进行 maven clean,maven