Nebula Spark Connector meta connect timed out

  • nebula 版本:3.0
  • 部署方式:分布式
  • 安装方式:RPM
  • 是否为线上版本:Y
  • 硬件信息
    • 磁盘 2T ssd
    • CPU 16、内存 128G
  • 问题的具体描述
    导入时 meta connect timed out,安装了三台机器,每次withGraphAddress需要填写不同的ip
    node01,node02,node03
    第一次使用node01能正常导入,一旦nebula重启可能node01就不能使用了需要填写其他机器ip,随机性
/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/bin/java -Dvisualgc.id=20333309053326 -javaagent:/Users/chenpeng/Library/Application Support/JetBrains/Toolbox/apps/IDEA-U/ch-0/221.5591.52/IntelliJ IDEA.app/Contents/lib/idea_rt.jar=61148:/Users/chenpeng/Library/Application Support/JetBrains/Toolbox/apps/IDEA-U/ch-0/221.5591.52/IntelliJ IDEA.app/Contents/bin -Dfile.encoding=UTF-8 -classpath /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/rt.jar:/Users/chenpeng/Documents/code/code2022/qihoo/spark/kg_full_build/unification-integration/target/test-classes:/Users/chenpeng/Documents/code/code2022/qihoo/spark/kg_full_build/unification-integration/target/classes:/Users/chenpeng/.ivy2/cache/org.scala-lang/scala-reflect/jars/scala-reflect-2.11.12.jar:/Users/chenpeng/.ivy2/cache/org.scala-lang/scala-library/jars/scala-library-2.11.12.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-core_2.11/2.4.5/spark-core_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/thoughtworks/paranamer/paranamer/2.8/paranamer-2.8.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/avro/avro/1.8.2/avro-1.8.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/codehaus/jackson/jackson-core-asl/1.9.13/jackson-core-asl-1.9.13.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/codehaus/jackson/jackson-mapper-asl/1.9.13/jackson-mapper-asl-1.9.13.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/commons/commons-compress/1.8.1/commons-compress-1.8.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/tukaani/xz/1.5/xz-1.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/twitter/chill_2.11/0.9.3/chill_2.11-0.9.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/esotericsoftware/minlog/1.3.0/minlog-1.3.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/objenesis/objenesis/2.5.1/objenesis-2.5.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/twitter/chill-java/0.9.3/chill-java-0.9.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/xbean/xbean-asm6-shaded/4.8/xbean-asm6-shaded-4.8.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-launcher_2.11/2.4.5/spark-launcher_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-kvstore_2.11/2.4.5/spark-kvstore_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/fusesource/leveldbjni/leveldbjni-all/1.8/leveldbjni-all-1.8.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/fasterxml/jackson/core/jackson-annotations/2.6.7/jackson-annotations-2.6.7.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-network-common_2.11/2.4.5/spark-network-common_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-network-shuffle_2.11/2.4.5/spark-network-shuffle_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-unsafe_2.11/2.4.5/spark-unsafe_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/activation/activation/1.1.1/activation-1.1.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/curator/curator-recipes/2.6.0/curator-recipes-2.6.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/curator/curator-framework/2.6.0/curator-framework-2.6.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/servlet/javax.servlet-api/3.1.0/javax.servlet-api-3.1.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/commons/commons-lang3/3.5/commons-lang3-3.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/commons/commons-math3/3.4.1/commons-math3-3.4.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/slf4j/slf4j-api/1.7.16/slf4j-api-1.7.16.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/slf4j/jul-to-slf4j/1.7.16/jul-to-slf4j-1.7.16.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/slf4j/jcl-over-slf4j/1.7.16/jcl-over-slf4j-1.7.16.jar:/Users/chenpeng/Documents/code/code/maven/repot/log4j/log4j/1.2.17/log4j-1.2.17.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/slf4j/slf4j-log4j12/1.7.16/slf4j-log4j12-1.7.16.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/ning/compress-lzf/1.0.3/compress-lzf-1.0.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/xerial/snappy/snappy-java/1.1.7.3/snappy-java-1.1.7.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/lz4/lz4-java/1.4.0/lz4-java-1.4.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/github/luben/zstd-jni/1.3.2-2/zstd-jni-1.3.2-2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-net/commons-net/3.1/commons-net-3.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/json4s/json4s-jackson_2.11/3.5.3/json4s-jackson_2.11-3.5.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/json4s/json4s-core_2.11/3.5.3/json4s-core_2.11-3.5.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/json4s/json4s-ast_2.11/3.5.3/json4s-ast_2.11-3.5.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/json4s/json4s-scalap_2.11/3.5.3/json4s-scalap_2.11-3.5.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scala-lang/modules/scala-xml_2.11/1.0.6/scala-xml_2.11-1.0.6.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/jersey/core/jersey-client/2.22.2/jersey-client-2.22.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/ws/rs/javax.ws.rs-api/2.0.1/javax.ws.rs-api-2.0.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/hk2/hk2-api/2.4.0-b34/hk2-api-2.4.0-b34.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/hk2/hk2-utils/2.4.0-b34/hk2-utils-2.4.0-b34.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/hk2/external/aopalliance-repackaged/2.4.0-b34/aopalliance-repackaged-2.4.0-b34.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/hk2/external/javax.inject/2.4.0-b34/javax.inject-2.4.0-b34.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/hk2/hk2-locator/2.4.0-b34/hk2-locator-2.4.0-b34.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/javassist/javassist/3.18.1-GA/javassist-3.18.1-GA.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/jersey/core/jersey-common/2.22.2/jersey-common-2.22.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/jersey/bundles/repackaged/jersey-guava/2.22.2/jersey-guava-2.22.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/hk2/osgi-resource-locator/1.0.1/osgi-resource-locator-1.0.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/jersey/core/jersey-server/2.22.2/jersey-server-2.22.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/jersey/media/jersey-media-jaxb/2.22.2/jersey-media-jaxb-2.22.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/validation/validation-api/1.1.0.Final/validation-api-1.1.0.Final.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/jersey/containers/jersey-container-servlet/2.22.2/jersey-container-servlet-2.22.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/glassfish/jersey/containers/jersey-container-servlet-core/2.22.2/jersey-container-servlet-core-2.22.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/io/netty/netty-all/4.1.42.Final/netty-all-4.1.42.Final.jar:/Users/chenpeng/Documents/code/code/maven/repot/io/netty/netty/3.9.9.Final/netty-3.9.9.Final.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/clearspring/analytics/stream/2.7.0/stream-2.7.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/io/dropwizard/metrics/metrics-core/3.1.5/metrics-core-3.1.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/io/dropwizard/metrics/metrics-jvm/3.1.5/metrics-jvm-3.1.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/io/dropwizard/metrics/metrics-json/3.1.5/metrics-json-3.1.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/io/dropwizard/metrics/metrics-graphite/3.1.5/metrics-graphite-3.1.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/fasterxml/jackson/core/jackson-databind/2.6.7.3/jackson-databind-2.6.7.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/fasterxml/jackson/module/jackson-module-scala_2.11/2.6.7.1/jackson-module-scala_2.11-2.6.7.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scala-lang/scala-reflect/2.11.8/scala-reflect-2.11.8.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/fasterxml/jackson/module/jackson-module-paranamer/2.7.9/jackson-module-paranamer-2.7.9.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/ivy/ivy/2.4.0/ivy-2.4.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/oro/oro/2.0.8/oro-2.0.8.jar:/Users/chenpeng/Documents/code/code/maven/repot/net/razorvine/pyrolite/4.13/pyrolite-4.13.jar:/Users/chenpeng/Documents/code/code/maven/repot/net/sf/py4j/py4j/0.10.7/py4j-0.10.7.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-tags_2.11/2.4.5/spark-tags_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/commons/commons-crypto/1.0.0/commons-crypto-1.0.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/spark-project/spark/unused/1.0.0/unused-1.0.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-sql_2.11/2.4.5/spark-sql_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/univocity/univocity-parsers/2.7.3/univocity-parsers-2.7.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-sketch_2.11/2.4.5/spark-sketch_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-catalyst_2.11/2.4.5/spark-catalyst_2.11-2.4.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scala-lang/modules/scala-parser-combinators_2.11/1.1.0/scala-parser-combinators_2.11-1.1.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/codehaus/janino/janino/3.0.9/janino-3.0.9.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/codehaus/janino/commons-compiler/3.0.9/commons-compiler-3.0.9.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/antlr/antlr4-runtime/4.7/antlr4-runtime-4.7.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/orc/orc-core/1.5.5/orc-core-1.5.5-nohive.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/orc/orc-shims/1.5.5/orc-shims-1.5.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-lang/commons-lang/2.6/commons-lang-2.6.jar:/Users/chenpeng/Documents/code/code/maven/repot/io/airlift/aircompressor/0.10/aircompressor-0.10.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/orc/orc-mapreduce/1.5.5/orc-mapreduce-1.5.5-nohive.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/parquet/parquet-column/1.10.1/parquet-column-1.10.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/parquet/parquet-common/1.10.1/parquet-common-1.10.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/parquet/parquet-encoding/1.10.1/parquet-encoding-1.10.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/parquet/parquet-hadoop/1.10.1/parquet-hadoop-1.10.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/parquet/parquet-format/2.4.0/parquet-format-2.4.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/parquet/parquet-jackson/1.10.1/parquet-jackson-1.10.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/arrow/arrow-vector/0.10.0/arrow-vector-0.10.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/arrow/arrow-format/0.10.0/arrow-format-0.10.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/arrow/arrow-memory/0.10.0/arrow-memory-0.10.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/joda-time/joda-time/2.9.9/joda-time-2.9.9.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/carrotsearch/hppc/0.7.2/hppc-0.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/vlkan/flatbuffers/1.2.0-3f79e055/flatbuffers-1.2.0-3f79e055.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-client/2.7.2/hadoop-client-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-common/2.7.2/hadoop-common-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/xmlenc/xmlenc/0.52/xmlenc-0.52.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-httpclient/commons-httpclient/3.1/commons-httpclient-3.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-io/commons-io/2.4/commons-io-2.4.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/servlet/jsp/jsp-api/2.1/jsp-api-2.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-configuration/commons-configuration/1.6/commons-configuration-1.6.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-digester/commons-digester/1.8/commons-digester-1.8.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-beanutils/commons-beanutils/1.7.0/commons-beanutils-1.7.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-beanutils/commons-beanutils-core/1.8.0/commons-beanutils-core-1.8.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-auth/2.7.2/hadoop-auth-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/directory/server/apacheds-kerberos-codec/2.0.0-M15/apacheds-kerberos-codec-2.0.0-M15.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/directory/server/apacheds-i18n/2.0.0-M15/apacheds-i18n-2.0.0-M15.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/directory/api/api-asn1-api/1.0.0-M20/api-asn1-api-1.0.0-M20.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/directory/api/api-util/1.0.0-M20/api-util-1.0.0-M20.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/curator/curator-client/2.7.1/curator-client-2.7.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/htrace/htrace-core/3.1.0-incubating/htrace-core-3.1.0-incubating.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-hdfs/2.7.2/hadoop-hdfs-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/mortbay/jetty/jetty-util/6.1.26/jetty-util-6.1.26.jar:/Users/chenpeng/Documents/code/code/maven/repot/xerces/xercesImpl/2.9.1/xercesImpl-2.9.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/xml-apis/xml-apis/1.3.04/xml-apis-1.3.04.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-mapreduce-client-app/2.7.2/hadoop-mapreduce-client-app-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-mapreduce-client-common/2.7.2/hadoop-mapreduce-client-common-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-yarn-client/2.7.2/hadoop-yarn-client-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-yarn-server-common/2.7.2/hadoop-yarn-server-common-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-mapreduce-client-shuffle/2.7.2/hadoop-mapreduce-client-shuffle-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-yarn-api/2.7.2/hadoop-yarn-api-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-mapreduce-client-core/2.7.2/hadoop-mapreduce-client-core-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-yarn-common/2.7.2/hadoop-yarn-common-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/xml/bind/jaxb-api/2.2.2/jaxb-api-2.2.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/xml/stream/stax-api/1.0-2/stax-api-1.0-2.jar:/Users/chenpeng/Documents/code/code/maven/repot/javax/servlet/servlet-api/2.5/servlet-api-2.5.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/sun/jersey/jersey-core/1.9/jersey-core-1.9.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/sun/jersey/jersey-client/1.9/jersey-client-1.9.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/codehaus/jackson/jackson-jaxrs/1.9.13/jackson-jaxrs-1.9.13.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/codehaus/jackson/jackson-xc/1.9.13/jackson-xc-1.9.13.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-mapreduce-client-jobclient/2.7.2/hadoop-mapreduce-client-jobclient-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/hadoop/hadoop-annotations/2.7.2/hadoop-annotations-2.7.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/net/java/dev/jna/jna/5.11.0/jna-5.11.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/google/code/gson/gson/2.2.4/gson-2.2.4.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/alibaba/fastjson/1.2.78/fastjson-1.2.78.jar:/Users/chenpeng/Documents/code/code/maven/repot/net/minidev/json-smart/2.3/json-smart-2.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/net/minidev/accessors-smart/1.2/accessors-smart-1.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/ow2/asm/asm/5.0.4/asm-5.0.4.jar:/Users/chenpeng/Documents/code/code/maven/repot/neo4j-contrib/neo4j-connector-apache-spark_2.11/4.0.1_for_spark_2.4/neo4j-connector-apache-spark_2.11-4.0.1_for_spark_2.4.jar:/Users/chenpeng/Documents/code/code/maven/repot/neo4j-contrib/neo4j-connector-apache-spark_2.11_common/4.0.1/neo4j-connector-apache-spark_2.11_common-4.0.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/neo4j/driver/neo4j-java-driver/4.2.3/neo4j-java-driver-4.2.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/neo4j/neo4j-cypher-dsl/2020.1.4/neo4j-cypher-dsl-2020.1.4.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apiguardian/apiguardian-api/1.1.0/apiguardian-api-1.1.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/elasticsearch/elasticsearch-spark-20_2.11/6.2.2/elasticsearch-spark-20_2.11-6.2.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/vesoft/nebula-spark-connector/3.0.0/nebula-spark-connector-3.0.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-graphx_2.11/2.4.4/spark-graphx_2.11-2.4.4.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/spark/spark-mllib-local_2.11/2.4.4/spark-mllib-local_2.11-2.4.4.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scalanlp/breeze_2.11/0.13.2/breeze_2.11-0.13.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scalanlp/breeze-macros_2.11/0.13.2/breeze-macros_2.11-0.13.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/net/sf/opencsv/opencsv/2.3/opencsv-2.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/github/rwl/jtransforms/2.4.0/jtransforms-2.4.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/spire-math/spire_2.11/0.13.0/spire_2.11-0.13.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/spire-math/spire-macros_2.11/0.13.0/spire-macros_2.11-0.13.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/typelevel/machinist_2.11/0.6.1/machinist_2.11-0.6.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/chuusai/shapeless_2.11/2.3.2/shapeless_2.11-2.3.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/typelevel/macro-compat_2.11/1.1.1/macro-compat_2.11-1.1.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/github/fommil/netlib/core/1.1.2/core-1.1.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/net/sourceforge/f2j/arpack_combined_all/0.1/arpack_combined_all-0.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/vesoft/client/3.0.0/client-3.0.0.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/apache/commons/commons-pool2/2.2/commons-pool2-2.2.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/bouncycastle/bcpkix-jdk15on/1.69/bcpkix-jdk15on-1.69.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/bouncycastle/bcprov-jdk15on/1.69/bcprov-jdk15on-1.69.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/bouncycastle/bcutil-jdk15on/1.69/bcutil-jdk15on-1.69.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/locationtech/jts/jts-core/1.16.1/jts-core-1.16.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/commons-codec/commons-codec/1.13/commons-codec-1.13.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scalatest/scalatest-funsuite_2.11/3.2.3/scalatest-funsuite_2.11-3.2.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scalatest/scalatest-core_2.11/3.2.3/scalatest-core_2.11-3.2.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scalatest/scalatest-compatible/3.2.3/scalatest-compatible-3.2.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/scalactic/scalactic_2.11/3.2.3/scalactic_2.11-3.2.3.jar:/Users/chenpeng/Documents/code/code/maven/repot/com/google/guava/guava/14.0.1/guava-14.0.1.jar:/Users/chenpeng/Documents/code/code/maven/repot/org/projectlombok/lombok/1.18.12/lombok-1.18.12.jar demo.nebula.TestNebula
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/chenpeng/Documents/code/code/maven/repot/org/slf4j/slf4j-log4j12/1.7.16/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/chenpeng/Documents/code/code/maven/repot/com/vesoft/nebula-spark-connector/3.0.0/nebula-spark-connector-3.0.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
22/05/31 16:53:13 ERROR Executor: Exception in task 0.0 in stage 1.0 (TID 1)
com.facebook.thrift.transport.TTransportException: java.net.SocketTimeoutException: connect timed out
	at com.facebook.thrift.transport.TSocket.open(TSocket.java:206)
	at com.vesoft.nebula.client.meta.MetaClient.getClient(MetaClient.java:148)
	at com.vesoft.nebula.client.meta.MetaClient.doConnect(MetaClient.java:127)
	at com.vesoft.nebula.client.meta.MetaClient.connect(MetaClient.java:116)
	at com.vesoft.nebula.connector.nebula.MetaProvider.<init>(MetaProvider.scala:53)
	at com.vesoft.nebula.connector.writer.NebulaWriter.<init>(NebulaWriter.scala:22)
	at com.vesoft.nebula.connector.writer.NebulaVertexWriter.<init>(NebulaVertexWriter.scala:18)
	at com.vesoft.nebula.connector.writer.NebulaVertexWriterFactory.createDataWriter(NebulaSourceWriter.scala:28)
	at org.apache.spark.sql.execution.datasources.v2.DataWritingSparkTask$.run(WriteToDataSourceV2Exec.scala:113)
	at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec$$anonfun$doExecute$2.apply(WriteToDataSourceV2Exec.scala:67)
	at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec$$anonfun$doExecute$2.apply(WriteToDataSourceV2Exec.scala:66)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
	at org.apache.spark.scheduler.Task.run(Task.scala:123)
	at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: connect timed out
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:607)
	at com.facebook.thrift.transport.TSocket.open(TSocket.java:201)
	... 18 more
22/05/31 16:53:13 ERROR TaskSetManager: Task 0 in stage 1.0 failed 1 times; aborting job
22/05/31 16:53:13 ERROR WriteToDataSourceV2Exec: Data source writer com.vesoft.nebula.connector.writer.NebulaDataSourceVertexWriter@186dcb05 is aborting.
22/05/31 16:53:13 ERROR NebulaDataSourceVertexWriter: NebulaDataSourceVertexWriter abort
22/05/31 16:53:13 ERROR WriteToDataSourceV2Exec: Data source writer com.vesoft.nebula.connector.writer.NebulaDataSourceVertexWriter@186dcb05 aborted.
Exception in thread "main" org.apache.spark.SparkException: Writing job aborted.
	at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec.doExecute(WriteToDataSourceV2Exec.scala:92)
	at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:131)
	at org.apache.spark.sql.execution.SparkPlan$$anonfun$execute$1.apply(SparkPlan.scala:127)
	at org.apache.spark.sql.execution.SparkPlan$$anonfun$executeQuery$1.apply(SparkPlan.scala:155)
	at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
	at org.apache.spark.sql.execution.SparkPlan.executeQuery(SparkPlan.scala:152)
	at org.apache.spark.sql.execution.SparkPlan.execute(SparkPlan.scala:127)
	at org.apache.spark.sql.execution.QueryExecution.toRdd$lzycompute(QueryExecution.scala:83)
	at org.apache.spark.sql.execution.QueryExecution.toRdd(QueryExecution.scala:81)
	at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:676)
	at org.apache.spark.sql.DataFrameWriter$$anonfun$runCommand$1.apply(DataFrameWriter.scala:676)
	at org.apache.spark.sql.execution.SQLExecution$$anonfun$withNewExecutionId$1.apply(SQLExecution.scala:80)
	at org.apache.spark.sql.execution.SQLExecution$.withSQLConfPropagated(SQLExecution.scala:127)
	at org.apache.spark.sql.execution.SQLExecution$.withNewExecutionId(SQLExecution.scala:75)
	at org.apache.spark.sql.DataFrameWriter.runCommand(DataFrameWriter.scala:676)
	at org.apache.spark.sql.DataFrameWriter.save(DataFrameWriter.scala:260)
	at com.vesoft.nebula.connector.connector.package$NebulaDataFrameWriter.writeVertices(package.scala:287)
	at demo.nebula.TestNebula.main(TestNebula.java:48)
Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 1 times, most recent failure: Lost task 0.0 in stage 1.0 (TID 1, localhost, executor driver): com.facebook.thrift.transport.TTransportException: java.net.SocketTimeoutException: connect timed out
	at com.facebook.thrift.transport.TSocket.open(TSocket.java:206)
	at com.vesoft.nebula.client.meta.MetaClient.getClient(MetaClient.java:148)
	at com.vesoft.nebula.client.meta.MetaClient.doConnect(MetaClient.java:127)
	at com.vesoft.nebula.client.meta.MetaClient.connect(MetaClient.java:116)
	at com.vesoft.nebula.connector.nebula.MetaProvider.<init>(MetaProvider.scala:53)
	at com.vesoft.nebula.connector.writer.NebulaWriter.<init>(NebulaWriter.scala:22)
	at com.vesoft.nebula.connector.writer.NebulaVertexWriter.<init>(NebulaVertexWriter.scala:18)
	at com.vesoft.nebula.connector.writer.NebulaVertexWriterFactory.createDataWriter(NebulaSourceWriter.scala:28)
	at org.apache.spark.sql.execution.datasources.v2.DataWritingSparkTask$.run(WriteToDataSourceV2Exec.scala:113)
	at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec$$anonfun$doExecute$2.apply(WriteToDataSourceV2Exec.scala:67)
	at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec$$anonfun$doExecute$2.apply(WriteToDataSourceV2Exec.scala:66)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
	at org.apache.spark.scheduler.Task.run(Task.scala:123)
	at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: connect timed out
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:607)
	at com.facebook.thrift.transport.TSocket.open(TSocket.java:201)
	... 18 more

Driver stacktrace:
	at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1891)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1879)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1878)
	at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
	at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1878)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:927)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:927)
	at scala.Option.foreach(Option.scala:257)
	at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:927)
	at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2112)
	at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2061)
	at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2050)
	at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49)
	at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:738)
	at org.apache.spark.SparkContext.runJob(SparkContext.scala:2061)
	at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec.doExecute(WriteToDataSourceV2Exec.scala:64)
	... 17 more
Caused by: com.facebook.thrift.transport.TTransportException: java.net.SocketTimeoutException: connect timed out
	at com.facebook.thrift.transport.TSocket.open(TSocket.java:206)
	at com.vesoft.nebula.client.meta.MetaClient.getClient(MetaClient.java:148)
	at com.vesoft.nebula.client.meta.MetaClient.doConnect(MetaClient.java:127)
	at com.vesoft.nebula.client.meta.MetaClient.connect(MetaClient.java:116)
	at com.vesoft.nebula.connector.nebula.MetaProvider.<init>(MetaProvider.scala:53)
	at com.vesoft.nebula.connector.writer.NebulaWriter.<init>(NebulaWriter.scala:22)
	at com.vesoft.nebula.connector.writer.NebulaVertexWriter.<init>(NebulaVertexWriter.scala:18)
	at com.vesoft.nebula.connector.writer.NebulaVertexWriterFactory.createDataWriter(NebulaSourceWriter.scala:28)
	at org.apache.spark.sql.execution.datasources.v2.DataWritingSparkTask$.run(WriteToDataSourceV2Exec.scala:113)
	at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec$$anonfun$doExecute$2.apply(WriteToDataSourceV2Exec.scala:67)
	at org.apache.spark.sql.execution.datasources.v2.WriteToDataSourceV2Exec$$anonfun$doExecute$2.apply(WriteToDataSourceV2Exec.scala:66)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
	at org.apache.spark.scheduler.Task.run(Task.scala:123)
	at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
	at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: connect timed out
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:607)
	at com.facebook.thrift.transport.TSocket.open(TSocket.java:201)
	... 18 more

进程已结束,退出代码1

        NebulaConnectionConfig config = NebulaConnectionConfig.builder()
                .withMetaAddress("node01Ip:9559")
                .withGraphAddress("node01Ip:9669")
                .withConenctionRetry(2)
                .build();

withGraphAddress 随便哪台机器都行,withMetaAddress只有一台能用每次还不一样

三台的话,可以三个 meta 地址都放上去啊,graph 也是。

方三个不行,只能放能用的那一个才能成功 ,否则一直timeout

放真实的 ip 呢?

是放的ip :sweat_smile:

三个 graphD 用 console 都能正常连接么? console 连了之后

show hosts
show hosts meta
show hosts graph

结果都是正常的么?



一切正常,就是spark connector 配置meta的地方 只能配置一个 而且重启之后还会变

明白了,奇怪,重启造成 meta timeout 好奇怪,方便用 python/ipython 的 storage client 测试一下 meta 的情况么?在 spark 一样的环境里。

参考 readme 里的例子:

python3 -m pip install nebula3-python
python3
from nebula3.mclient import MetaCache, HostAddr
from nebula3.sclient.GraphStorageClient import GraphStorageClient

# the metad servers's address, 改成你的meta 地址,可以一个一个 meta 试一下,或者三个都填进去,看能不能重现
meta_cache = MetaCache([('172.28.1.1', 9559),
                        ('172.28.1.2', 9559),
                        ('172.28.1.3', 9559)],
                       50000)
graph_storage_client = GraphStorageClient(meta_cache)

resp = graph_storage_client.scan_vertex(
        space_name='basketballplayer',
        tag_name='player')
while resp.has_next():
    result = resp.next()
    for vertex_data in result:
        print(vertex_data)

如果不能重现,说明集群是正常的,要看看 spark 每一个节点到集群的网络情况?

1 个赞


感觉是环境问题 我配置的弹性地址,这个地方变成内网地址了

1 个赞

这是 meta 的服务发现机制决定的,它会从 meta 那里获取 meta 和 storage 的地址,因为meta的 leader 是动态变化的,你目前有条件把外部可路由的地址配置在内部么?或者配置域名,内外各自解析到不同网段的地址?

解决了 谢谢,通过修改meta配置域名解决的,机器上hosts配置【本地ip 域名】

2 个赞

此话题已在最后回复的 7 天后被自动关闭。不再允许新回复。