E:\world-lines\mr-apps\buckets-nebula\buckets-nebula-exchange-demo>docker exec -it buckets-nebula-spark-master bash ./bin/spark-submit --master spark://master:7077 --class com.vesoft.nebula.exchange.Exchange  /tmp/nebula-exchange-2.6.1.jar  -c /tmp/clickhouse_application.conf
22/02/21 08:07:05 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
log4j:WARN No appenders could be found for logger (com.vesoft.nebula.exchange.config.Configs$).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
22/02/21 08:07:05 INFO SparkContext: Running Spark version 2.4.6
22/02/21 08:07:05 INFO SparkContext: Submitted application: com.vesoft.nebula.exchange.Exchange
22/02/21 08:07:06 INFO SecurityManager: Changing view acls to: spark  
22/02/21 08:07:06 INFO SecurityManager: Changing modify acls to: spark
22/02/21 08:07:06 INFO SecurityManager: Changing view acls groups to:
22/02/21 08:07:06 INFO SecurityManager: Changing modify acls groups to:
22/02/21 08:07:06 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(spark); groups with view permissions: Set(); users  with modify permissions: Set(spark); groups with modify permissions: Set()
22/02/21 08:07:06 INFO Utils: Successfully started service 'sparkDriver' on port 43725.
22/02/21 08:07:06 INFO SparkEnv: Registering MapOutputTracker
22/02/21 08:07:06 INFO SparkEnv: Registering BlockManagerMaster
22/02/21 08:07:06 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
22/02/21 08:07:06 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
22/02/21 08:07:06 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-69daf859-2e08-4dea-afd2-9cd5bfa2db91
22/02/21 08:07:06 INFO MemoryStore: MemoryStore started with capacity 366.3 MB
22/02/21 08:07:06 INFO SparkEnv: Registering OutputCommitCoordinator
22/02/21 08:07:06 INFO Utils: Successfully started service 'SparkUI' on port 4040.
22/02/21 08:07:07 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://b213d13690e2:4040
22/02/21 08:07:07 INFO SparkContext: Added JAR file:/tmp/nebula-exchange-2.6.1.jar at spark://b213d13690e2:43725/jars/nebula-exchange-2.6.1.jar with timestamp 1645430827035
22/02/21 08:07:07 INFO StandaloneAppClient$ClientEndpoint: Connecting to master spark://master:7077...
22/02/21 08:07:07 INFO TransportClientFactory: Successfully created connection to master/172.32.0.3:7077 after 42 ms (0 ms spent in bootstraps)
22/02/21 08:07:07 INFO StandaloneSchedulerBackend: Connected to Spark cluster with app ID app-20220221080707-0008
22/02/21 08:07:07 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 44575.
22/02/21 08:07:07 INFO NettyBlockTransferService: Server created on b213d13690e2:44575
22/02/21 08:07:07 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
22/02/21 08:07:07 INFO StandaloneAppClient$ClientEndpoint: Executor added: app-20220221080707-0008/0 on worker-20220221021658-172.32.0.2-41337 (172.32.0.2:41337) with 1 core(s)
22/02/21 08:07:07 INFO StandaloneSchedulerBackend: Granted executor ID app-20220221080707-0008/0 on hostPort 172.32.0.2:41337 with 1 core(s), 1024.0 MB RAM
22/02/21 08:07:07 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, b213d13690e2, 44575, None)
22/02/21 08:07:07 INFO BlockManagerMasterEndpoint: Registering block manager b213d13690e2:44575 with 366.3 MB RAM, BlockManagerId(driver, b213d13690e2, 44575, None)
22/02/21 08:07:07 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, b213d13690e2, 44575, None)
22/02/21 08:07:07 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, b213d13690e2, 44575, None)    
22/02/21 08:07:07 INFO StandaloneAppClient$ClientEndpoint: Executor updated: app-20220221080707-0008/0 is now RUNNING
22/02/21 08:07:07 INFO StandaloneSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0
22/02/21 08:07:07 INFO Exchange$: Processing Tag player
22/02/21 08:07:07 INFO Exchange$: field keys: name, age
22/02/21 08:07:07 INFO Exchange$: nebula keys: name, age
22/02/21 08:07:07 INFO ClickHouseDriver: Driver registered
22/02/21 08:07:08 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/opt/bitnami/spark/spark-warehouse').
22/02/21 08:07:08 INFO SharedState: Warehouse path is 'file:/opt/bitnami/spark/spark-warehouse'.
22/02/21 08:07:09 INFO StateStoreCoordinatorRef: Registered StateStoreCoordinator endpoint
22/02/21 08:07:10 INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (172.32.0.2:35744) with ID 0
22/02/21 08:07:10 INFO BlockManagerMasterEndpoint: Registering block manager 172.32.0.2:41047 with 366.3 MB RAM, BlockManagerId(0, 172.32.0.2, 41047, None)
22/02/21 08:07:21 ERROR MetaClient: Get Space Error: java.net.UnknownHostException: metad0
Exception in thread "main" com.facebook.thrift.transport.TTransportException: java.net.UnknownHostException: metad0
        at com.facebook.thrift.transport.TSocket.open(TSocket.java:206)
        at com.vesoft.nebula.client.meta.MetaClient.getClient(MetaClient.java:145)
        at com.vesoft.nebula.client.meta.MetaClient.freshClient(MetaClient.java:165)
        at com.vesoft.nebula.client.meta.MetaClient.getSpace(MetaClient.java:227)
        at com.vesoft.nebula.client.meta.MetaClient.getTags(MetaClient.java:255)
        at com.vesoft.nebula.exchange.MetaProvider.getLabelType(MetaProvider.scala:93)
        at com.vesoft.nebula.exchange.utils.NebulaUtils$.getDataSourceFieldType(NebulaUtils.scala:31)
        at com.vesoft.nebula.exchange.processor.VerticesProcessor.process(VerticesProcessor.scala:111)
        at com.vesoft.nebula.exchange.Exchange$$anonfun$main$2.apply(Exchange.scala:150)
        at com.vesoft.nebula.exchange.Exchange$$anonfun$main$2.apply(Exchange.scala:126)
        at scala.collection.immutable.List.foreach(List.scala:392)
        at com.vesoft.nebula.exchange.Exchange$.main(Exchange.scala:126)
        at com.vesoft.nebula.exchange.Exchange.main(Exchange.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
        at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:845)
        at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
        at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
        at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
        at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.net.UnknownHostException: metad0
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:184)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:607)
        at com.facebook.thrift.transport.TSocket.open(TSocket.java:201)
        ... 24 more
22/02/21 08:07:21 INFO SparkContext: Invoking stop() from shutdown hook
22/02/21 08:07:21 INFO SparkUI: Stopped Spark web UI at http://b213d13690e2:4040
22/02/21 08:07:21 INFO StandaloneSchedulerBackend: Shutting down all executors
22/02/21 08:07:21 INFO CoarseGrainedSchedulerBackend$DriverEndpoint: Asking each executor to shut down
22/02/21 08:07:21 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
22/02/21 08:07:21 INFO MemoryStore: MemoryStore cleared
22/02/21 08:07:21 INFO BlockManager: BlockManager stopped
22/02/21 08:07:21 INFO BlockManagerMaster: BlockManagerMaster stopped
22/02/21 08:07:21 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
22/02/21 08:07:21 INFO SparkContext: Successfully stopped SparkContext
22/02/21 08:07:21 INFO ShutdownHookManager: Shutdown hook called
22/02/21 08:07:21 INFO ShutdownHookManager: Deleting directory /tmp/spark-762006b0-bd9e-4377-8dcc-54e4a41e7132
22/02/21 08:07:21 INFO ShutdownHookManager: Deleting directory /tmp/spark-5e02f0b1-82de-46d2-aecb-dc1101c3b39d