exchange 2.0导入CSV

为了更快地定位、解决问题,麻烦参考下面模版提问 ^ ^

提问参考模版:

  • nebula 版本:2.0-Beta
  • 部署方式(分布式 / 单机 / Docker / DBaaS):三个docker
  • 硬件信息
    • 磁盘( 必须为 SSD ,不支持 HDD)
    • CPU、内存信息:2g
  • 问题的具体描述:
    spark-submit以后,出现ilegalStateException,查了spark的stdout:
    spark 报错:
2021-01-14 07:45:43 INFO  Executor:54 - Finished task 0.0 in stage 1.0 (TID 1). 1561 bytes result sent to driver
2021-01-14 07:45:43 INFO  CoarseGrainedExecutorBackend:54 - Driver commanded a shutdown
2021-01-14 07:45:43 INFO  MemoryStore:54 - MemoryStore cleared
2021-01-14 07:45:43 ERROR CoarseGrainedExecutorBackend:43 - REC

配置文件:

{
  # Spark 相关配置
  spark: {
    app: {
      name: Spark Writer
    }
    driver: {
      cores: 1
      maxResultSize: 2G
    }
    cores {
      max: 6
    }
  }
  # Nebula Graph 相关配置
  nebula: {
    address:{
      # 以下为 Nebula Graph 的 Graph 服务和 Meta 服务所在机器的 IP 地址及端口
      # 如果有多个地址,格式为 "ip1:port","ip2:port","ip3:port"
      # 不同地址之间以英文逗号 (,) 隔开
      graph:["172.17.0.11:3699","172.17.0.16:3699","172.17.0.18:3699"]
      meta:["172.17.0.11:45500","172.17.0.16:45500","172.17.0.18:45500"]
    }
    # 填写的账号必须拥有 Nebula Graph 相应图空间的写数据权限
    user: user
    pswd: password
    # 填写 Nebula Graph 中需要写入数据的图空间名称
    space: csv
    connection {
      timeout: 3000
      retry: 3
    }
    execution {
      retry: 3
    }
    error: {
      max: 32
      output: /tmp/errors
    }
    rate: {
      limit: 1024
      timeout: 1000
    }
  }
  tags: [
    {
      name: course
      type: {
        source: csv
        sink: client
      }
      path: "hdfs://master:9000/nebula/test2/course.csv"
      fields: [_c0, _c1]
      nebula.fields: [courseId, courseName]
      vertex: {
        field: _c1,
        policy: "hash"
      }
      separator: ","
      header: false
      batch: 256
      partition: 32
      isImplicit: true
    }

    # 设置标签 user 相关信息
    {
      name: user
      type: {
        source: csv
        sink: client
      }
      path: "hdfs://master:9000/nebula/test2/user.csv"

      fields: [_c0]
      nebula.fields: [userId]
      vertex: userId
      separator: ","
      header: false
      batch: 256
      partition: 32
      isImplicit: true
    }
  ]
  edges: [
    {
      name: action
      type: {
        source: csv
        sink: client
      }
      path: "hdfs://master:9000/nebula/test2/actions.csv"
      fields: [_c0, _c3, _c4, _c5, _c6, _c7, _c8]
      nebula.fields: [actionId, duration, feature0, feature1, feature2, feature3, label]
	#(actionId int, duration double, feature0 double, feature1 double, feature2 double, feature3 double, label bool)
      source: _c1
      target: {
        field: _c2
        policy: "hash"
      }
      separator: ","
      header: false
      batch: 256
      partition: 32
      isImplicit: true
    }
  ]
}
2021-01-14 14:18:04 INFO  BlockManagerInfo:54 - Added broadcast_3_piece0 in memory on 172.17.0.18:38831 (size: 7.0 KB, free: 366.3 MB)
2021-01-14 14:18:07 INFO  BlockManagerInfo:54 - Added broadcast_2_piece0 in memory on 172.17.0.18:38831 (size: 23.9 KB, free: 366.3 MB)
2021-01-14 14:18:08 INFO  TaskSetManager:54 - Finished task 0.0 in stage 1.0 (TID 1) in 6742 ms on 172.17.0.18 (executor 2) (1/1)
2021-01-14 14:18:08 INFO  TaskSchedulerImpl:54 - Removed TaskSet 1.0, whose tasks have all completed, from pool 
2021-01-14 14:18:08 INFO  DAGScheduler:54 - ResultStage 1 (csv at FileBaseReader.scala:86) finished in 6.759 s
2021-01-14 14:18:08 INFO  DAGScheduler:54 - Job 1 finished: csv at FileBaseReader.scala:86, took 6.766075 s
Exception in thread "main" java.lang.IllegalStateException
        at com.google.common.base.Preconditions.checkState(Preconditions.java:133)
        at com.google.common.net.HostAndPort.getPort(HostAndPort.java:109)
        at com.vesoft.nebula.exchange.MetaProvider$$anonfun$1.apply(MetaProvider.scala:28)
        at com.vesoft.nebula.exchange.MetaProvider$$anonfun$1.apply(MetaProvider.scala:27)
        at scala.collection.immutable.List.foreach(List.scala:392)
        at com.vesoft.nebula.exchange.MetaProvider.<init>(MetaProvider.scala:27)
        at com.vesoft.nebula.exchange.processor.VerticesProcessor.process(VerticesProcessor.scala:95)
        at com.vesoft.nebula.exchange.Exchange$$anonfun$main$2.apply(Exchange.scala:139)
        at com.vesoft.nebula.exchange.Exchange$$anonfun$main$2.apply(Exchange.scala:116)
        at scala.collection.immutable.List.foreach(List.scala:392)
        at com.vesoft.nebula.exchange.Exchange$.main(Exchange.scala:116)
        at com.vesoft.nebula.exchange.Exchange.main(Exchange.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
        at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
        at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
        at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
        at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
        at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
2021-01-14 14:18:08 INFO  SparkContext:54 - Invoking stop() from shutdown hook
2021-01-14 14:18:08 INFO  AbstractConnector:318 - Stopped Spark@3163987e{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
2021-01-14 14:18:08 INFO  SparkUI:54 - Stopped Spark web UI at http://2bf1fc2dba17:4040
2021-01-14 14:18:08 INFO  StandaloneSchedulerBackend:54 - Shutting down all executors
2021-01-14 14:18:08 INFO  CoarseGrainedSchedulerBackend$DriverEndpoint:54 - Asking each executor to shut down
2021-01-14 14:18:08 INFO  MapOutputTrackerMasterEndpoint:54 - MapOutputTrackerMasterEndpoint stopped!
2021-01-14 14:18:08 INFO  MemoryStore:54 - MemoryStore cleared
2021-01-14 14:18:08 INFO  BlockManager:54 - BlockManager stopped
2021-01-14 14:18:08 INFO  BlockManagerMaster:54 - BlockManagerMaster stopped
2021-01-14 14:18:08 INFO  OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:54 - OutputCommitCoordinator stopped!
2021-01-14 14:18:08 INFO  SparkContext:54 - Successfully stopped SparkContext
2021-01-14 14:18:08 INFO  ShutdownHookManager:54 - Shutdown hook called
2021-01-14 14:18:08 INFO  ShutdownHookManager:54 - Deleting directory /tmp/spark-a7d8dd73-331f-4957-99d6-3debc1c46a80
2021-01-14 14:18:08 INFO  ShutdownHookManager:54 - Deleting directory /tmp/spark-40d0d807-a9e7-4b60-ad8d-3a8c943980b2

请问一下大佬们,就是,配置文件是否配错,还是其他什么原因;
(数据集是V1 exchange 文档里面的哪个)

你这个估计是graph和meta地址填的有问题

1 个赞

这两个配置,不同地址之间的逗号是中文的,要使用英文逗号。

改过来了,spark app也跑通了,可是数据没有进去图空间,我在studio探索的时候,指定一个VID,显示不存在

你在 spark日志中查一下这些日志信息:

batchSuccess. course
batchFailure.course

batchSuccess.user
batchFailure.course

batchSuccess. action
batchFailure. action

如果存在batchFailure对应的值大于0,就查一下日志中的这些信息,有说明写入失败的原因:

write vertex failed for xxx

你配置文件中有几个地方需要改一下:

  1. 你使用的Nebula Graph版本是Beta,只支持String类型的vid,所以tag中对于vertex的配置不要配policy。
  2. 对user这个tag的配置, vertex 对应的值要写csv中的列名,不是nebula中的属性名。
  3. 同1,对action这个dege的配置,target不要配policy
{
  # Spark 相关配置
  spark: {
    app: {
      name: Spark Writer
    }
    driver: {
      cores: 1
      maxResultSize: 2G
    }
    cores {
      max: 6
    }
  }
  # Nebula Graph 相关配置
  nebula: {
    address:{
      # 以下为 Nebula Graph 的 Graph 服务和 Meta 服务所在机器的 IP 地址及端口
      # 如果有多个地址,格式为 "ip1:port","ip2:port","ip3:port"
      # 不同地址之间以英文逗号 (,) 隔开
      graph:["172.17.0.11:3699","172.17.0.16:3699","172.17.0.18:3699"]
      meta:["172.17.0.11:45500","172.17.0.16:45500","172.17.0.18:45500"]
    }
    # 填写的账号必须拥有 Nebula Graph 相应图空间的写数据权限
    user: user
    pswd: password
    # 填写 Nebula Graph 中需要写入数据的图空间名称
    space: csv
    connection {
      timeout: 3000
      retry: 3
    }
    execution {
      retry: 3
    }
    error: {
      max: 32
      output: /tmp/errors
    }
    rate: {
      limit: 1024
      timeout: 1000
    }
  }
  tags: [
    {
      name: course
      type: {
        source: csv
        sink: client
      }
      path: "hdfs://master:9000/nebula/test2/course.csv"
      fields: [_c0, _c1]
      nebula.fields: [courseId, courseName]
      vertex: _c1
      separator: ","
      header: false
      batch: 256
      partition: 32
      isImplicit: true
    }

    # 设置标签 user 相关信息
    {
      name: user
      type: {
        source: csv
        sink: client
      }
      path: "hdfs://master:9000/nebula/test2/user.csv"

      fields: [_c0]
      nebula.fields: [userId]
      #csv.fields: [userId]
      vertex: _c0
      separator: ","
      header: false
      batch: 256
      partition: 32
      isImplicit: true
    }
  ]
  edges: [
    {
      name: action
      type: {
        source: csv
        sink: client
      }
      path: "hdfs://master:9000/nebula/test2/actions.csv"
      fields: [_c0, _c3, _c4, _c5, _c6, _c7, _c8]
      nebula.fields: [actionId, duration, feature0, feature1, feature2, feature3, label]
	#(actionId int, duration double, feature0 double, feature1 double, feature2 double, feature3 double, label bool)
      source: _c1
      target: _c2
      separator: ","
      header: false
      batch: 256
      partition: 32
      isImplicit: true
    }
  ]
}

这样配置可以吗,还有我记得之前CREATE SPACE的时候,有一个VID配置为String的选项,现在找不到哪个页面了404,,,,beta版create space时候默认是string还是integer

默认是FIXED_STRING(8),可以通过DESC SPACE space_name查看到space的vid type。
配置看着是可以的

看到了,是长度8,请问,如何设置String的长度,之前官方有一个帖子,现在被删除了,我们这边普遍使用md5,所以string长度要设置很大。。。。。。。。。。。。
刚刚跑了一遍,stdout报错

2021-01-15 03:14:02 INFO  CoarseGrainedExecutorBackend:2566 - Started daemon with process name: 11683@2bf1fc2dba17
2021-01-15 03:14:02 INFO  SignalUtils:54 - Registered signal handler for TERM
2021-01-15 03:14:02 INFO  SignalUtils:54 - Registered signal handler for HUP
2021-01-15 03:14:02 INFO  SignalUtils:54 - Registered signal handler for INT
2021-01-15 03:14:02 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2021-01-15 03:14:02 INFO  SecurityManager:54 - Changing view acls to: root
2021-01-15 03:14:02 INFO  SecurityManager:54 - Changing modify acls to: root
2021-01-15 03:14:02 INFO  SecurityManager:54 - Changing view acls groups to: 
2021-01-15 03:14:02 INFO  SecurityManager:54 - Changing modify acls groups to: 
2021-01-15 03:14:02 INFO  SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
2021-01-15 03:14:03 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:33170 after 125 ms (0 ms spent in bootstraps)
2021-01-15 03:14:03 INFO  SecurityManager:54 - Changing view acls to: root
2021-01-15 03:14:03 INFO  SecurityManager:54 - Changing modify acls to: root
2021-01-15 03:14:03 INFO  SecurityManager:54 - Changing view acls groups to: 
2021-01-15 03:14:03 INFO  SecurityManager:54 - Changing modify acls groups to: 
2021-01-15 03:14:03 INFO  SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
2021-01-15 03:14:03 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:33170 after 3 ms (0 ms spent in bootstraps)
2021-01-15 03:14:03 INFO  DiskBlockManager:54 - Created local directory at /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-c1ae96c9-35be-45f9-a872-d20d905019a6/blockmgr-3e906551-0b06-480f-b590-950083e3ad17
2021-01-15 03:14:03 INFO  MemoryStore:54 - MemoryStore started with capacity 366.3 MB
2021-01-15 03:14:04 INFO  CoarseGrainedExecutorBackend:54 - Connecting to driver: spark://CoarseGrainedScheduler@2bf1fc2dba17:33170
2021-01-15 03:14:04 INFO  WorkerWatcher:54 - Connecting to worker spark://Worker@172.17.0.11:35268
2021-01-15 03:14:04 INFO  TransportClientFactory:267 - Successfully created connection to /172.17.0.11:35268 after 14 ms (0 ms spent in bootstraps)
2021-01-15 03:14:04 INFO  WorkerWatcher:54 - Successfully connected to spark://Worker@172.17.0.11:35268
2021-01-15 03:14:04 INFO  CoarseGrainedExecutorBackend:54 - Successfully registered with driver
2021-01-15 03:14:04 INFO  Executor:54 - Starting executor ID 0 on host 172.17.0.11
2021-01-15 03:14:04 INFO  Utils:54 - Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 41548.
2021-01-15 03:14:04 INFO  NettyBlockTransferService:54 - Server created on 172.17.0.11:41548
2021-01-15 03:14:04 INFO  BlockManager:54 - Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
2021-01-15 03:14:04 INFO  BlockManagerMaster:54 - Registering BlockManager BlockManagerId(0, 172.17.0.11, 41548, None)
2021-01-15 03:14:04 INFO  BlockManagerMaster:54 - Registered BlockManager BlockManagerId(0, 172.17.0.11, 41548, None)
2021-01-15 03:14:04 INFO  BlockManager:54 - Initialized BlockManager: BlockManagerId(0, 172.17.0.11, 41548, None)
2021-01-15 03:14:20 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 5
2021-01-15 03:14:20 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 7
2021-01-15 03:14:20 INFO  Executor:54 - Running task 3.0 in stage 3.0 (TID 7)
2021-01-15 03:14:20 INFO  Executor:54 - Running task 1.0 in stage 3.0 (TID 5)
2021-01-15 03:14:21 INFO  Executor:54 - Fetching spark://2bf1fc2dba17:33170/jars/nebula-exchange-2.0.0.jar with timestamp 1610680440779
2021-01-15 03:14:21 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:33170 after 2 ms (0 ms spent in bootstraps)
2021-01-15 03:14:21 INFO  Utils:54 - Fetching spark://2bf1fc2dba17:33170/jars/nebula-exchange-2.0.0.jar to /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-c1ae96c9-35be-45f9-a872-d20d905019a6/spark-bf8f744b-4bd3-4096-a2cd-8b7d4d5e6cae/fetchFileTemp2462815707856788402.tmp
2021-01-15 03:14:23 INFO  Utils:54 - Copying /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-c1ae96c9-35be-45f9-a872-d20d905019a6/spark-bf8f744b-4bd3-4096-a2cd-8b7d4d5e6cae/-11996987491610680440779_cache to /opt/Code/app-20210115031401-0025/0/./nebula-exchange-2.0.0.jar
2021-01-15 03:14:23 INFO  Executor:54 - Adding file:/opt/Code/app-20210115031401-0025/0/./nebula-exchange-2.0.0.jar to class loader
2021-01-15 03:14:23 INFO  MapOutputTrackerWorker:54 - Updating epoch to 1 and clearing cache
2021-01-15 03:14:24 INFO  TorrentBroadcast:54 - Started reading broadcast variable 6
2021-01-15 03:14:24 INFO  TransportClientFactory:267 - Successfully created connection to /172.17.0.18:44576 after 2 ms (0 ms spent in bootstraps)
2021-01-15 03:14:24 INFO  MemoryStore:54 - Block broadcast_6_piece0 stored as bytes in memory (estimated size 11.8 KB, free 366.3 MB)
2021-01-15 03:14:24 INFO  TorrentBroadcast:54 - Reading broadcast variable 6 took 925 ms
2021-01-15 03:14:25 INFO  MemoryStore:54 - Block broadcast_6 stored as values in memory (estimated size 23.2 KB, free 366.3 MB)
2021-01-15 03:14:25 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 0, fetching them
2021-01-15 03:14:25 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:33170)
2021-01-15 03:14:25 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 0, fetching them
2021-01-15 03:14:25 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:14:25 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:25 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:25 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 8 ms
2021-01-15 03:14:25 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 8 ms
2021-01-15 03:14:27 INFO  CodeGenerator:54 - Code generated in 228.864657 ms
2021-01-15 03:14:27 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:27 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:27 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:27 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:27 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:27 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:27 INFO  Executor:54 - Finished task 3.0 in stage 3.0 (TID 7). 1878 bytes result sent to driver
2021-01-15 03:14:27 INFO  Executor:54 - Finished task 1.0 in stage 3.0 (TID 5). 1835 bytes result sent to driver
2021-01-15 03:14:28 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 36
2021-01-15 03:14:28 INFO  Executor:54 - Running task 0.0 in stage 5.0 (TID 36)
2021-01-15 03:14:28 INFO  TorrentBroadcast:54 - Started reading broadcast variable 10
2021-01-15 03:14:28 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:46475 after 2 ms (0 ms spent in bootstraps)
2021-01-15 03:14:28 INFO  MemoryStore:54 - Block broadcast_10_piece0 stored as bytes in memory (estimated size 7.0 KB, free 366.3 MB)
2021-01-15 03:14:28 INFO  TorrentBroadcast:54 - Reading broadcast variable 10 took 21 ms
2021-01-15 03:14:28 INFO  MemoryStore:54 - Block broadcast_10 stored as values in memory (estimated size 13.0 KB, free 366.3 MB)
2021-01-15 03:14:28 INFO  CodeGenerator:54 - Code generated in 15.446926 ms
2021-01-15 03:14:28 INFO  CodeGenerator:54 - Code generated in 11.346072 ms
2021-01-15 03:14:28 INFO  FileScanRDD:54 - Reading File path: hdfs://master:9000/nebula/test2/user.csv, range: 0-36, partition values: [empty row]
2021-01-15 03:14:28 INFO  CodeGenerator:54 - Code generated in 12.58426 ms
2021-01-15 03:14:28 INFO  TorrentBroadcast:54 - Started reading broadcast variable 9
2021-01-15 03:14:28 INFO  MemoryStore:54 - Block broadcast_9_piece0 stored as bytes in memory (estimated size 23.9 KB, free 366.3 MB)
2021-01-15 03:14:28 INFO  TorrentBroadcast:54 - Reading broadcast variable 9 took 13 ms
2021-01-15 03:14:28 INFO  MemoryStore:54 - Block broadcast_9 stored as values in memory (estimated size 335.1 KB, free 365.9 MB)
2021-01-15 03:14:29 INFO  Executor:54 - Finished task 0.0 in stage 5.0 (TID 36). 1520 bytes result sent to driver
2021-01-15 03:14:29 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 37
2021-01-15 03:14:29 INFO  Executor:54 - Running task 0.0 in stage 6.0 (TID 37)
2021-01-15 03:14:29 INFO  TorrentBroadcast:54 - Started reading broadcast variable 12
2021-01-15 03:14:29 INFO  MemoryStore:54 - Block broadcast_12_piece0 stored as bytes in memory (estimated size 6.1 KB, free 365.9 MB)
2021-01-15 03:14:29 INFO  TorrentBroadcast:54 - Reading broadcast variable 12 took 13 ms
2021-01-15 03:14:29 INFO  MemoryStore:54 - Block broadcast_12 stored as values in memory (estimated size 11.3 KB, free 365.9 MB)
2021-01-15 03:14:29 INFO  FileScanRDD:54 - Reading File path: hdfs://master:9000/nebula/test2/user.csv, range: 0-36, partition values: [empty row]
2021-01-15 03:14:29 INFO  CodeGenerator:54 - Code generated in 11.588742 ms
2021-01-15 03:14:29 INFO  TorrentBroadcast:54 - Started reading broadcast variable 11
2021-01-15 03:14:29 INFO  MemoryStore:54 - Block broadcast_11_piece0 stored as bytes in memory (estimated size 23.9 KB, free 365.8 MB)
2021-01-15 03:14:29 INFO  TorrentBroadcast:54 - Reading broadcast variable 11 took 12 ms
2021-01-15 03:14:29 INFO  MemoryStore:54 - Block broadcast_11 stored as values in memory (estimated size 335.1 KB, free 365.5 MB)
2021-01-15 03:14:29 INFO  Executor:54 - Finished task 0.0 in stage 6.0 (TID 37). 1387 bytes result sent to driver
2021-01-15 03:14:29 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 38
2021-01-15 03:14:29 INFO  Executor:54 - Running task 0.0 in stage 7.0 (TID 38)
2021-01-15 03:14:29 INFO  MapOutputTrackerWorker:54 - Updating epoch to 2 and clearing cache
2021-01-15 03:14:29 INFO  TorrentBroadcast:54 - Started reading broadcast variable 13
2021-01-15 03:14:29 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 39
2021-01-15 03:14:29 INFO  Executor:54 - Running task 1.0 in stage 7.0 (TID 39)
2021-01-15 03:14:29 INFO  MemoryStore:54 - Block broadcast_13_piece0 stored as bytes in memory (estimated size 11.4 KB, free 365.6 MB)
2021-01-15 03:14:29 INFO  TorrentBroadcast:54 - Reading broadcast variable 13 took 34 ms
2021-01-15 03:14:29 INFO  MemoryStore:54 - Block broadcast_13 stored as values in memory (estimated size 22.0 KB, free 365.5 MB)
2021-01-15 03:14:29 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 1, fetching them
2021-01-15 03:14:29 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:33170)
2021-01-15 03:14:29 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 1, fetching them
2021-01-15 03:14:29 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:14:29 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:29 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:29 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 2 ms
2021-01-15 03:14:29 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 3 ms
2021-01-15 03:14:29 INFO  CodeGenerator:54 - Code generated in 24.317028 ms
2021-01-15 03:14:29 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:29 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:29 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:29 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:29 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:29 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:29 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "2": ("2")
2021-01-15 03:14:29 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "9": ("9")
2021-01-15 03:14:29 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:29 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 1.0 in stage 7.0 (TID 39). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 55
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 0.0 in stage 7.0 (TID 38). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  Executor:54 - Running task 2.0 in stage 7.0 (TID 55)
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 56
2021-01-15 03:14:30 INFO  Executor:54 - Running task 3.0 in stage 7.0 (TID 56)
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "4": ("4")
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "1": ("1")
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 3.0 in stage 7.0 (TID 56). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 2.0 in stage 7.0 (TID 55). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 62
2021-01-15 03:14:30 INFO  Executor:54 - Running task 24.0 in stage 7.0 (TID 62)
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 63
2021-01-15 03:14:30 INFO  Executor:54 - Running task 25.0 in stage 7.0 (TID 63)
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "11": ("11")
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "3": ("3")
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 25.0 in stage 7.0 (TID 63). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 24.0 in stage 7.0 (TID 62). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 64
2021-01-15 03:14:30 INFO  Executor:54 - Running task 26.0 in stage 7.0 (TID 64)
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 65
2021-01-15 03:14:30 INFO  Executor:54 - Running task 27.0 in stage 7.0 (TID 65)
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "7": ("7")
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "0": ("0")
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 27.0 in stage 7.0 (TID 65). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 26.0 in stage 7.0 (TID 64). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 66
2021-01-15 03:14:30 INFO  Executor:54 - Running task 28.0 in stage 7.0 (TID 66)
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 4 ms
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 67
2021-01-15 03:14:30 INFO  Executor:54 - Running task 29.0 in stage 7.0 (TID 67)
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "10": ("10")
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "5": ("5")
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 28.0 in stage 7.0 (TID 66). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 68
2021-01-15 03:14:30 INFO  Executor:54 - Running task 30.0 in stage 7.0 (TID 68)
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 4 ms
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 29.0 in stage 7.0 (TID 67). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 69
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  Executor:54 - Running task 31.0 in stage 7.0 (TID 69)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "6": ("6")
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:14:30 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:30 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:30 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX user(userId) VALUES "8": ("8")
2021-01-15 03:14:30 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: part: 1, error code: -17.
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 30.0 in stage 7.0 (TID 68). 1788 bytes result sent to driver
2021-01-15 03:14:30 INFO  Executor:54 - Finished task 31.0 in stage 7.0 (TID 69). 1788 bytes result sent to driver
2021-01-15 03:14:31 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 70
2021-01-15 03:14:31 INFO  Executor:54 - Running task 0.0 in stage 8.0 (TID 70)
2021-01-15 03:14:31 INFO  TorrentBroadcast:54 - Started reading broadcast variable 15
2021-01-15 03:14:31 INFO  MemoryStore:54 - Block broadcast_15_piece0 stored as bytes in memory (estimated size 4.5 KB, free 366.3 MB)
2021-01-15 03:14:31 INFO  TorrentBroadcast:54 - Reading broadcast variable 15 took 10 ms
2021-01-15 03:14:31 INFO  MemoryStore:54 - Block broadcast_15 stored as values in memory (estimated size 8.8 KB, free 366.3 MB)
2021-01-15 03:14:31 INFO  CodeGenerator:54 - Code generated in 15.267138 ms
2021-01-15 03:14:31 INFO  FileScanRDD:54 - Reading File path: hdfs://master:9000/nebula/test2/actions.csv, range: 0-704, partition values: [empty row]
2021-01-15 03:14:31 INFO  TorrentBroadcast:54 - Started reading broadcast variable 14
2021-01-15 03:14:31 INFO  MemoryStore:54 - Block broadcast_14_piece0 stored as bytes in memory (estimated size 23.9 KB, free 366.3 MB)
2021-01-15 03:14:31 INFO  TorrentBroadcast:54 - Reading broadcast variable 14 took 10 ms
2021-01-15 03:14:31 INFO  MemoryStore:54 - Block broadcast_14 stored as values in memory (estimated size 335.1 KB, free 365.9 MB)
2021-01-15 03:14:31 INFO  Executor:54 - Finished task 0.0 in stage 8.0 (TID 70). 1338 bytes result sent to driver
2021-01-15 03:14:31 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 76
2021-01-15 03:14:31 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 78
2021-01-15 03:14:31 INFO  Executor:54 - Running task 1.0 in stage 11.0 (TID 76)
2021-01-15 03:14:31 INFO  Executor:54 - Running task 3.0 in stage 11.0 (TID 78)
2021-01-15 03:14:31 INFO  MapOutputTrackerWorker:54 - Updating epoch to 3 and clearing cache
2021-01-15 03:14:31 INFO  TorrentBroadcast:54 - Started reading broadcast variable 20
2021-01-15 03:14:31 INFO  MemoryStore:54 - Block broadcast_20_piece0 stored as bytes in memory (estimated size 12.7 KB, free 365.9 MB)
2021-01-15 03:14:31 INFO  TorrentBroadcast:54 - Reading broadcast variable 20 took 14 ms
2021-01-15 03:14:31 INFO  MemoryStore:54 - Block broadcast_20 stored as values in memory (estimated size 26.6 KB, free 365.9 MB)
2021-01-15 03:14:31 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 2, fetching them
2021-01-15 03:14:31 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:33170)
2021-01-15 03:14:31 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 2, fetching them
2021-01-15 03:14:31 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:14:31 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:31 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:14:31 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:31 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:14:31 INFO  CodeGenerator:54 - Code generated in 51.832163 ms
2021-01-15 03:14:31 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:31 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:31 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:31 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:31 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:31 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:31 INFO  Executor:54 - Finished task 3.0 in stage 11.0 (TID 78). 1792 bytes result sent to driver
2021-01-15 03:14:31 INFO  Executor:54 - Finished task 1.0 in stage 11.0 (TID 76). 1792 bytes result sent to driver
2021-01-15 03:14:31 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 81
2021-01-15 03:14:31 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 82
2021-01-15 03:14:31 INFO  Executor:54 - Running task 7.0 in stage 11.0 (TID 82)
2021-01-15 03:14:31 INFO  Executor:54 - Running task 6.0 in stage 11.0 (TID 81)
2021-01-15 03:14:31 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:31 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:31 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:31 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 3 ms
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 7.0 in stage 11.0 (TID 82). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 85
2021-01-15 03:14:32 INFO  Executor:54 - Running task 10.0 in stage 11.0 (TID 85)
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 4 ms
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 6.0 in stage 11.0 (TID 81). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 87
2021-01-15 03:14:32 INFO  Executor:54 - Running task 12.0 in stage 11.0 (TID 87)
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 10.0 in stage 11.0 (TID 85). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 89
2021-01-15 03:14:32 INFO  Executor:54 - Running task 14.0 in stage 11.0 (TID 89)
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 14.0 in stage 11.0 (TID 89). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 12.0 in stage 11.0 (TID 87). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 95
2021-01-15 03:14:32 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 96
2021-01-15 03:14:32 INFO  Executor:54 - Running task 19.0 in stage 11.0 (TID 96)
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:32 INFO  Executor:54 - Running task 18.0 in stage 11.0 (TID 95)
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 19.0 in stage 11.0 (TID 96). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 97
2021-01-15 03:14:32 INFO  Executor:54 - Running task 20.0 in stage 11.0 (TID 97)
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 18.0 in stage 11.0 (TID 95). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 100
2021-01-15 03:14:32 INFO  Executor:54 - Running task 23.0 in stage 11.0 (TID 100)
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:14:32 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 20.0 in stage 11.0 (TID 97). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:14:32 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:14:32 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:14:32 INFO  Executor:54 - Finished task 23.0 in stage 11.0 (TID 100). 1792 bytes result sent to driver
2021-01-15 03:14:32 INFO  CoarseGrainedExecutorBackend:54 - Driver commanded a shutdown
2021-01-15 03:14:32 ERROR CoarseGrainedExecutorBackend:43 - RECEIVED SIGNAL TERM

数据类型不匹配,你 DESC TAG user看下属性的数据类型,把DESC的结果贴出来吧。

PS:创建space的时候可以指定vidType的,具体见文档: Nebula Graph CRUD - Nebula Graph Database Manual

是的,INT64,也就是说我要把它更改为String类型
CREATE TAG user(userId String);

懂了,是不是Beta做VID的,用INT会出错,

我靠,点进去了,现在轮到边了QAQ

2021-01-15 03:27:26 INFO  CoarseGrainedExecutorBackend:2566 - Started daemon with process name: 12229@2bf1fc2dba17
2021-01-15 03:27:26 INFO  SignalUtils:54 - Registered signal handler for TERM
2021-01-15 03:27:26 INFO  SignalUtils:54 - Registered signal handler for HUP
2021-01-15 03:27:26 INFO  SignalUtils:54 - Registered signal handler for INT
2021-01-15 03:27:27 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2021-01-15 03:27:27 INFO  SecurityManager:54 - Changing view acls to: root
2021-01-15 03:27:27 INFO  SecurityManager:54 - Changing modify acls to: root
2021-01-15 03:27:27 INFO  SecurityManager:54 - Changing view acls groups to: 
2021-01-15 03:27:27 INFO  SecurityManager:54 - Changing modify acls groups to: 
2021-01-15 03:27:27 INFO  SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
2021-01-15 03:27:28 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:33905 after 144 ms (0 ms spent in bootstraps)
2021-01-15 03:27:28 INFO  SecurityManager:54 - Changing view acls to: root
2021-01-15 03:27:28 INFO  SecurityManager:54 - Changing modify acls to: root
2021-01-15 03:27:28 INFO  SecurityManager:54 - Changing view acls groups to: 
2021-01-15 03:27:28 INFO  SecurityManager:54 - Changing modify acls groups to: 
2021-01-15 03:27:28 INFO  SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
2021-01-15 03:27:28 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:33905 after 2 ms (0 ms spent in bootstraps)
2021-01-15 03:27:28 INFO  DiskBlockManager:54 - Created local directory at /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-c3881130-6fca-4eea-9d1b-aabd2152d5bd/blockmgr-18a94c83-111f-4bfe-a3db-d0b6389b8e87
2021-01-15 03:27:28 INFO  MemoryStore:54 - MemoryStore started with capacity 366.3 MB
2021-01-15 03:27:28 INFO  WorkerWatcher:54 - Connecting to worker spark://Worker@172.17.0.11:35268
2021-01-15 03:27:28 INFO  TransportClientFactory:267 - Successfully created connection to /172.17.0.11:35268 after 1 ms (0 ms spent in bootstraps)
2021-01-15 03:27:28 INFO  CoarseGrainedExecutorBackend:54 - Connecting to driver: spark://CoarseGrainedScheduler@2bf1fc2dba17:33905
2021-01-15 03:27:28 INFO  WorkerWatcher:54 - Successfully connected to spark://Worker@172.17.0.11:35268
2021-01-15 03:27:29 INFO  CoarseGrainedExecutorBackend:54 - Successfully registered with driver
2021-01-15 03:27:29 INFO  Executor:54 - Starting executor ID 0 on host 172.17.0.11
2021-01-15 03:27:29 INFO  Utils:54 - Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 45999.
2021-01-15 03:27:29 INFO  NettyBlockTransferService:54 - Server created on 172.17.0.11:45999
2021-01-15 03:27:29 INFO  BlockManager:54 - Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
2021-01-15 03:27:29 INFO  BlockManagerMaster:54 - Registering BlockManager BlockManagerId(0, 172.17.0.11, 45999, None)
2021-01-15 03:27:29 INFO  BlockManagerMaster:54 - Registered BlockManager BlockManagerId(0, 172.17.0.11, 45999, None)
2021-01-15 03:27:29 INFO  BlockManager:54 - Initialized BlockManager: BlockManagerId(0, 172.17.0.11, 45999, None)
2021-01-15 03:27:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 2
2021-01-15 03:27:46 INFO  Executor:54 - Running task 0.0 in stage 2.0 (TID 2)
2021-01-15 03:27:46 INFO  Executor:54 - Fetching spark://2bf1fc2dba17:33905/jars/nebula-exchange-2.0.0.jar with timestamp 1610681245837
2021-01-15 03:27:46 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:33905 after 3 ms (0 ms spent in bootstraps)
2021-01-15 03:27:46 INFO  Utils:54 - Fetching spark://2bf1fc2dba17:33905/jars/nebula-exchange-2.0.0.jar to /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-c3881130-6fca-4eea-9d1b-aabd2152d5bd/spark-44b49643-5116-40e8-9e40-b5832df29def/fetchFileTemp8353872076169556840.tmp
2021-01-15 03:27:49 INFO  Utils:54 - Copying /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-c3881130-6fca-4eea-9d1b-aabd2152d5bd/spark-44b49643-5116-40e8-9e40-b5832df29def/-6454453611610681245837_cache to /opt/Code/app-20210115032726-0026/0/./nebula-exchange-2.0.0.jar
2021-01-15 03:27:49 INFO  Executor:54 - Adding file:/opt/Code/app-20210115032726-0026/0/./nebula-exchange-2.0.0.jar to class loader
2021-01-15 03:27:49 INFO  TorrentBroadcast:54 - Started reading broadcast variable 5
2021-01-15 03:27:49 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:36843 after 2 ms (0 ms spent in bootstraps)
2021-01-15 03:27:49 INFO  MemoryStore:54 - Block broadcast_5_piece0 stored as bytes in memory (estimated size 6.2 KB, free 366.3 MB)
2021-01-15 03:27:50 INFO  TorrentBroadcast:54 - Reading broadcast variable 5 took 676 ms
2021-01-15 03:27:50 INFO  MemoryStore:54 - Block broadcast_5 stored as values in memory (estimated size 11.5 KB, free 366.3 MB)
2021-01-15 03:27:51 INFO  CodeGenerator:54 - Code generated in 226.182757 ms
2021-01-15 03:27:51 INFO  FileScanRDD:54 - Reading File path: hdfs://master:9000/nebula/test2/course.csv, range: 0-235, partition values: [empty row]
2021-01-15 03:27:51 INFO  CodeGenerator:54 - Code generated in 18.338955 ms
2021-01-15 03:27:51 INFO  TorrentBroadcast:54 - Started reading broadcast variable 4
2021-01-15 03:27:51 INFO  MemoryStore:54 - Block broadcast_4_piece0 stored as bytes in memory (estimated size 23.9 KB, free 366.2 MB)
2021-01-15 03:27:51 INFO  TorrentBroadcast:54 - Reading broadcast variable 4 took 14 ms
2021-01-15 03:27:51 INFO  MemoryStore:54 - Block broadcast_4 stored as values in memory (estimated size 335.1 KB, free 365.9 MB)
2021-01-15 03:27:52 INFO  Executor:54 - Finished task 0.0 in stage 2.0 (TID 2). 1473 bytes result sent to driver
2021-01-15 03:27:52 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 3
2021-01-15 03:27:52 INFO  Executor:54 - Running task 0.0 in stage 3.0 (TID 3)
2021-01-15 03:27:52 INFO  MapOutputTrackerWorker:54 - Updating epoch to 1 and clearing cache
2021-01-15 03:27:52 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 4
2021-01-15 03:27:52 INFO  Executor:54 - Running task 24.0 in stage 3.0 (TID 4)
2021-01-15 03:27:52 INFO  TorrentBroadcast:54 - Started reading broadcast variable 6
2021-01-15 03:27:52 INFO  TransportClientFactory:267 - Successfully created connection to /172.17.0.16:42579 after 2 ms (0 ms spent in bootstraps)
2021-01-15 03:27:52 INFO  MemoryStore:54 - Block broadcast_6_piece0 stored as bytes in memory (estimated size 11.8 KB, free 365.9 MB)
2021-01-15 03:27:52 INFO  TorrentBroadcast:54 - Reading broadcast variable 6 took 69 ms
2021-01-15 03:27:52 INFO  MemoryStore:54 - Block broadcast_6 stored as values in memory (estimated size 23.2 KB, free 365.9 MB)
2021-01-15 03:27:52 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 0, fetching them
2021-01-15 03:27:52 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:33905)
2021-01-15 03:27:52 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 0, fetching them
2021-01-15 03:27:52 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:27:52 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:27:52 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:27:52 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 8 ms
2021-01-15 03:27:52 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 8 ms
2021-01-15 03:27:57 INFO  CodeGenerator:54 - Code generated in 28.140126 ms
2021-01-15 03:27:58 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:27:58 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:27:58 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:27:58 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:27:58 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:27:58 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:27:58 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "History of Ecology": (1, "History of Ecology")
2021-01-15 03:27:58 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "Women in Islam": (2, "Women in Islam")
2021-01-15 03:27:58 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: Invalid vid.
2021-01-15 03:27:58 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: Invalid vid.
2021-01-15 03:27:58 INFO  Executor:54 - Finished task 0.0 in stage 3.0 (TID 3). 1835 bytes result sent to driver
2021-01-15 03:27:58 INFO  Executor:54 - Finished task 24.0 in stage 3.0 (TID 4). 1835 bytes result sent to driver
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 40
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 42
2021-01-15 03:28:01 INFO  Executor:54 - Running task 4.0 in stage 7.0 (TID 40)
2021-01-15 03:28:01 INFO  MapOutputTrackerWorker:54 - Updating epoch to 2 and clearing cache
2021-01-15 03:28:01 INFO  Executor:54 - Running task 6.0 in stage 7.0 (TID 42)
2021-01-15 03:28:01 INFO  TorrentBroadcast:54 - Started reading broadcast variable 13
2021-01-15 03:28:01 INFO  MemoryStore:54 - Block broadcast_13_piece0 stored as bytes in memory (estimated size 11.4 KB, free 366.3 MB)
2021-01-15 03:28:01 INFO  TorrentBroadcast:54 - Reading broadcast variable 13 took 26 ms
2021-01-15 03:28:01 INFO  MemoryStore:54 - Block broadcast_13 stored as values in memory (estimated size 22.0 KB, free 366.3 MB)
2021-01-15 03:28:01 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 1, fetching them
2021-01-15 03:28:01 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:33905)
2021-01-15 03:28:01 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 1, fetching them
2021-01-15 03:28:01 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 2 ms
2021-01-15 03:28:01 INFO  CodeGenerator:54 - Code generated in 33.042997 ms
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 4.0 in stage 7.0 (TID 40). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 6.0 in stage 7.0 (TID 42). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 46
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 47
2021-01-15 03:28:01 INFO  Executor:54 - Running task 9.0 in stage 7.0 (TID 47)
2021-01-15 03:28:01 INFO  Executor:54 - Running task 8.0 in stage 7.0 (TID 46)
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 8.0 in stage 7.0 (TID 46). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 54
2021-01-15 03:28:01 INFO  Executor:54 - Running task 14.0 in stage 7.0 (TID 54)
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 9.0 in stage 7.0 (TID 47). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 56
2021-01-15 03:28:01 INFO  Executor:54 - Running task 15.0 in stage 7.0 (TID 56)
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 14.0 in stage 7.0 (TID 54). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 59
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:01 INFO  Executor:54 - Running task 17.0 in stage 7.0 (TID 59)
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 15.0 in stage 7.0 (TID 56). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 17.0 in stage 7.0 (TID 59). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 63
2021-01-15 03:28:01 INFO  Executor:54 - Running task 19.0 in stage 7.0 (TID 63)
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 65
2021-01-15 03:28:01 INFO  Executor:54 - Running task 21.0 in stage 7.0 (TID 65)
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 19.0 in stage 7.0 (TID 63). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 69
2021-01-15 03:28:01 INFO  Executor:54 - Running task 23.0 in stage 7.0 (TID 69)
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:28:01 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:01 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 21.0 in stage 7.0 (TID 65). 1788 bytes result sent to driver
2021-01-15 03:28:01 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:01 INFO  Executor:54 - Finished task 23.0 in stage 7.0 (TID 69). 1788 bytes result sent to driver
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 72
2021-01-15 03:28:03 INFO  Executor:54 - Running task 0.0 in stage 10.0 (TID 72)
2021-01-15 03:28:03 INFO  TorrentBroadcast:54 - Started reading broadcast variable 19
2021-01-15 03:28:03 INFO  MemoryStore:54 - Block broadcast_19_piece0 stored as bytes in memory (estimated size 6.5 KB, free 366.3 MB)
2021-01-15 03:28:03 INFO  TorrentBroadcast:54 - Reading broadcast variable 19 took 11 ms
2021-01-15 03:28:03 INFO  MemoryStore:54 - Block broadcast_19 stored as values in memory (estimated size 12.6 KB, free 366.3 MB)
2021-01-15 03:28:03 INFO  FileScanRDD:54 - Reading File path: hdfs://master:9000/nebula/test2/actions.csv, range: 0-704, partition values: [empty row]
2021-01-15 03:28:03 INFO  CodeGenerator:54 - Code generated in 38.010911 ms
2021-01-15 03:28:03 INFO  TorrentBroadcast:54 - Started reading broadcast variable 18
2021-01-15 03:28:03 INFO  MemoryStore:54 - Block broadcast_18_piece0 stored as bytes in memory (estimated size 23.9 KB, free 366.2 MB)
2021-01-15 03:28:03 INFO  TorrentBroadcast:54 - Reading broadcast variable 18 took 10 ms
2021-01-15 03:28:03 INFO  MemoryStore:54 - Block broadcast_18 stored as values in memory (estimated size 335.1 KB, free 365.9 MB)
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 0.0 in stage 10.0 (TID 72). 1387 bytes result sent to driver
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 73
2021-01-15 03:28:03 INFO  Executor:54 - Running task 24.0 in stage 11.0 (TID 73)
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 74
2021-01-15 03:28:03 INFO  Executor:54 - Running task 25.0 in stage 11.0 (TID 74)
2021-01-15 03:28:03 INFO  MapOutputTrackerWorker:54 - Updating epoch to 3 and clearing cache
2021-01-15 03:28:03 INFO  TorrentBroadcast:54 - Started reading broadcast variable 20
2021-01-15 03:28:03 INFO  MemoryStore:54 - Block broadcast_20_piece0 stored as bytes in memory (estimated size 12.7 KB, free 365.9 MB)
2021-01-15 03:28:03 INFO  TorrentBroadcast:54 - Reading broadcast variable 20 took 24 ms
2021-01-15 03:28:03 INFO  MemoryStore:54 - Block broadcast_20 stored as values in memory (estimated size 26.6 KB, free 365.9 MB)
2021-01-15 03:28:03 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 2, fetching them
2021-01-15 03:28:03 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:33905)
2021-01-15 03:28:03 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 2, fetching them
2021-01-15 03:28:03 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:03 INFO  CodeGenerator:54 - Code generated in 44.686546 ms
2021-01-15 03:28:03 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:03 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:03 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:03 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:160 - INSERT EDGE action(actionId,duration,feature0,feature1,feature2,feature3,label) VALUES "0"->"Legacies of the Ancient World": (5, 55, -0.319991479, -0.435701433, 0.106783779, -0.06730924, false)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:160 - INSERT EDGE action(actionId,duration,feature0,feature1,feature2,feature3,label) VALUES "0"->"History of Ecology": (1, 6, -0.319991479, -0.435701433, 0.106783779, -0.06730924, false)
2021-01-15 03:28:03 ERROR NebulaGraphClientWriter:166 - write edge failed for Storage Error: Invalid vid.
2021-01-15 03:28:03 ERROR NebulaGraphClientWriter:166 - write edge failed for Storage Error: Invalid vid.
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 24.0 in stage 11.0 (TID 73). 1792 bytes result sent to driver
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 89
2021-01-15 03:28:03 INFO  Executor:54 - Running task 26.0 in stage 11.0 (TID 89)
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 25.0 in stage 11.0 (TID 74). 1792 bytes result sent to driver
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 91
2021-01-15 03:28:03 INFO  Executor:54 - Running task 27.0 in stage 11.0 (TID 91)
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:03 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:03 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:03 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:160 - INSERT EDGE action(actionId,duration,feature0,feature1,feature2,feature3,label) VALUES "0"->"ITP Core 2": (6, 59, -0.319991479, -0.435701433, 0.106783779, -0.06730924, false)
2021-01-15 03:28:03 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:160 - INSERT EDGE action(actionId,duration,feature0,feature1,feature2,feature3,label) VALUES "0"->"Environmental Disruptors of Development": (0, 0, -0.319991479, -0.435701433, 0.106783779, -0.06730924, false)
2021-01-15 03:28:03 ERROR NebulaGraphClientWriter:166 - write edge failed for Storage Error: Invalid vid.
2021-01-15 03:28:03 ERROR NebulaGraphClientWriter:166 - write edge failed for Storage Error: Invalid vid.
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 27.0 in stage 11.0 (TID 91). 1835 bytes result sent to driver
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 26.0 in stage 11.0 (TID 89). 1792 bytes result sent to driver
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 101
2021-01-15 03:28:03 INFO  Executor:54 - Running task 28.0 in stage 11.0 (TID 101)
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 102
2021-01-15 03:28:03 INFO  Executor:54 - Running task 29.0 in stage 11.0 (TID 102)
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:28:03 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:03 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:03 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:03 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:160 - INSERT EDGE action(actionId,duration,feature0,feature1,feature2,feature3,label) VALUES "0"->"The Research Paper: Octavia Butler\'s Kindred": (7, 62, -0.319991479, -0.435701433, 0.106783779, -0.06730924, false)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:160 - INSERT EDGE action(actionId,duration,feature0,feature1,feature2,feature3,label) VALUES "0"->"Women in Islam": (2, 41, -0.319991479, -0.435701433, 0.106783779, -0.06730924, false)
2021-01-15 03:28:03 ERROR NebulaGraphClientWriter:166 - write edge failed for Storage Error: Invalid vid.
2021-01-15 03:28:03 ERROR NebulaGraphClientWriter:166 - write edge failed for Storage Error: Invalid vid.
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 29.0 in stage 11.0 (TID 102). 1792 bytes result sent to driver
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 103
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 28.0 in stage 11.0 (TID 101). 1792 bytes result sent to driver
2021-01-15 03:28:03 INFO  Executor:54 - Running task 30.0 in stage 11.0 (TID 103)
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:03 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 104
2021-01-15 03:28:03 INFO  Executor:54 - Running task 31.0 in stage 11.0 (TID 104)
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:28:03 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:28:03 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:03 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:03 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:03 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:160 - INSERT EDGE action(actionId,duration,feature0,feature1,feature2,feature3,label) VALUES "0"->"History of Ecology": (3, 49, -0.319991479, -0.435701433, 0.106783779, -0.06730924, false)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:28:03 INFO  NebulaGraphClientWriter:160 - INSERT EDGE action(actionId,duration,feature0,feature1,feature2,feature3,label) VALUES "0"->"Women in Islam": (4, 51, -0.319991479, -0.435701433, 0.106783779, -0.06730924, false)
2021-01-15 03:28:03 ERROR NebulaGraphClientWriter:166 - write edge failed for Storage Error: Invalid vid.
2021-01-15 03:28:03 ERROR NebulaGraphClientWriter:166 - write edge failed for Storage Error: Invalid vid.
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 30.0 in stage 11.0 (TID 103). 1792 bytes result sent to driver
2021-01-15 03:28:03 INFO  Executor:54 - Finished task 31.0 in stage 11.0 (TID 104). 1792 bytes result sent to driver
2021-01-15 03:28:04 INFO  CoarseGrainedExecutorBackend:54 - Driver commanded a shutdown
2021-01-15 03:28:04 INFO  MemoryStore:54 - MemoryStore cleared
2021-01-15 03:28:04 INFO  BlockManager:54 - BlockManager stopped
2021-01-15 03:28:04 ERROR CoarseGrainedExecutorBackend:43 - RECEIVED SIGNAL TERM
4 INFO  BlockManager:54 - BlockManager stopped

这两行日志上面 有对应的insert NGQL,你贴一下吧

这是我的schama

CREATE SPACE csv(partition_num=1, replica_factor=1, vid_type=fixed_string(32))

-- 选择图空间 csv
USE csv;

-- 创建标签 user
CREATE TAG user(userId String);

-- 创建标签 course
CREATE TAG course(courseId int, courseName string);

-- 创建边类型 action
CREATE EDGE action (actionId int, duration double, feature0 double, feature1 double, feature2 double, feature3 double, label bool);

这是错误报告

2021-01-15 03:38:16 INFO  CoarseGrainedExecutorBackend:2566 - Started daemon with process name: 12782@2bf1fc2dba17
2021-01-15 03:38:16 INFO  SignalUtils:54 - Registered signal handler for TERM
2021-01-15 03:38:16 INFO  SignalUtils:54 - Registered signal handler for HUP
2021-01-15 03:38:16 INFO  SignalUtils:54 - Registered signal handler for INT
2021-01-15 03:38:17 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2021-01-15 03:38:17 INFO  SecurityManager:54 - Changing view acls to: root
2021-01-15 03:38:17 INFO  SecurityManager:54 - Changing modify acls to: root
2021-01-15 03:38:17 INFO  SecurityManager:54 - Changing view acls groups to: 
2021-01-15 03:38:17 INFO  SecurityManager:54 - Changing modify acls groups to: 
2021-01-15 03:38:17 INFO  SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
2021-01-15 03:38:18 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:38588 after 116 ms (0 ms spent in bootstraps)
2021-01-15 03:38:18 INFO  SecurityManager:54 - Changing view acls to: root
2021-01-15 03:38:18 INFO  SecurityManager:54 - Changing modify acls to: root
2021-01-15 03:38:18 INFO  SecurityManager:54 - Changing view acls groups to: 
2021-01-15 03:38:18 INFO  SecurityManager:54 - Changing modify acls groups to: 
2021-01-15 03:38:18 INFO  SecurityManager:54 - SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
2021-01-15 03:38:18 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:38588 after 1 ms (0 ms spent in bootstraps)
2021-01-15 03:38:18 INFO  DiskBlockManager:54 - Created local directory at /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-a2afee79-4fb7-40c4-96aa-45f74d8175f3/blockmgr-83157a77-ab43-4e80-9c60-985761e660b8
2021-01-15 03:38:18 INFO  MemoryStore:54 - MemoryStore started with capacity 366.3 MB
2021-01-15 03:38:18 INFO  WorkerWatcher:54 - Connecting to worker spark://Worker@172.17.0.11:35268
2021-01-15 03:38:18 INFO  CoarseGrainedExecutorBackend:54 - Connecting to driver: spark://CoarseGrainedScheduler@2bf1fc2dba17:38588
2021-01-15 03:38:18 INFO  TransportClientFactory:267 - Successfully created connection to /172.17.0.11:35268 after 1 ms (0 ms spent in bootstraps)
2021-01-15 03:38:18 INFO  WorkerWatcher:54 - Successfully connected to spark://Worker@172.17.0.11:35268
2021-01-15 03:38:19 INFO  CoarseGrainedExecutorBackend:54 - Successfully registered with driver
2021-01-15 03:38:19 INFO  Executor:54 - Starting executor ID 0 on host 172.17.0.11
2021-01-15 03:38:19 INFO  Utils:54 - Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 39538.
2021-01-15 03:38:19 INFO  NettyBlockTransferService:54 - Server created on 172.17.0.11:39538
2021-01-15 03:38:19 INFO  BlockManager:54 - Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
2021-01-15 03:38:19 INFO  BlockManagerMaster:54 - Registering BlockManager BlockManagerId(0, 172.17.0.11, 39538, None)
2021-01-15 03:38:19 INFO  BlockManagerMaster:54 - Registered BlockManager BlockManagerId(0, 172.17.0.11, 39538, None)
2021-01-15 03:38:19 INFO  BlockManager:54 - Initialized BlockManager: BlockManagerId(0, 172.17.0.11, 39538, None)
2021-01-15 03:38:30 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 2
2021-01-15 03:38:30 INFO  Executor:54 - Running task 0.0 in stage 2.0 (TID 2)
2021-01-15 03:38:30 INFO  Executor:54 - Fetching spark://2bf1fc2dba17:38588/jars/nebula-exchange-2.0.0.jar with timestamp 1610681895990
2021-01-15 03:38:30 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:38588 after 5 ms (0 ms spent in bootstraps)
2021-01-15 03:38:30 INFO  Utils:54 - Fetching spark://2bf1fc2dba17:38588/jars/nebula-exchange-2.0.0.jar to /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-a2afee79-4fb7-40c4-96aa-45f74d8175f3/spark-3746d5f3-1c71-419b-9c65-35b708c17985/fetchFileTemp6762209594934529385.tmp
2021-01-15 03:38:33 INFO  Utils:54 - Copying /tmp/spark-e444d8d7-d018-4952-9391-1d8ed812e397/executor-a2afee79-4fb7-40c4-96aa-45f74d8175f3/spark-3746d5f3-1c71-419b-9c65-35b708c17985/18551006691610681895990_cache to /opt/Code/app-20210115033816-0027/0/./nebula-exchange-2.0.0.jar
2021-01-15 03:38:33 INFO  Executor:54 - Adding file:/opt/Code/app-20210115033816-0027/0/./nebula-exchange-2.0.0.jar to class loader
2021-01-15 03:38:33 INFO  TorrentBroadcast:54 - Started reading broadcast variable 5
2021-01-15 03:38:34 INFO  TransportClientFactory:267 - Successfully created connection to 2bf1fc2dba17/172.17.0.11:41334 after 2 ms (0 ms spent in bootstraps)
2021-01-15 03:38:34 INFO  MemoryStore:54 - Block broadcast_5_piece0 stored as bytes in memory (estimated size 6.2 KB, free 366.3 MB)
2021-01-15 03:38:34 INFO  TorrentBroadcast:54 - Reading broadcast variable 5 took 109 ms
2021-01-15 03:38:34 INFO  MemoryStore:54 - Block broadcast_5 stored as values in memory (estimated size 11.5 KB, free 366.3 MB)
2021-01-15 03:38:34 INFO  CodeGenerator:54 - Code generated in 221.774407 ms
2021-01-15 03:38:34 INFO  FileScanRDD:54 - Reading File path: hdfs://master:9000/nebula/test2/course.csv, range: 0-235, partition values: [empty row]
2021-01-15 03:38:35 INFO  CodeGenerator:54 - Code generated in 18.718749 ms
2021-01-15 03:38:35 INFO  TorrentBroadcast:54 - Started reading broadcast variable 4
2021-01-15 03:38:35 INFO  MemoryStore:54 - Block broadcast_4_piece0 stored as bytes in memory (estimated size 23.9 KB, free 366.2 MB)
2021-01-15 03:38:35 INFO  TorrentBroadcast:54 - Reading broadcast variable 4 took 14 ms
2021-01-15 03:38:35 INFO  MemoryStore:54 - Block broadcast_4 stored as values in memory (estimated size 335.1 KB, free 365.9 MB)
2021-01-15 03:38:36 INFO  Executor:54 - Finished task 0.0 in stage 2.0 (TID 2). 1473 bytes result sent to driver
2021-01-15 03:38:36 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 3
2021-01-15 03:38:36 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 4
2021-01-15 03:38:36 INFO  Executor:54 - Running task 0.0 in stage 3.0 (TID 3)
2021-01-15 03:38:36 INFO  Executor:54 - Running task 24.0 in stage 3.0 (TID 4)
2021-01-15 03:38:36 INFO  MapOutputTrackerWorker:54 - Updating epoch to 1 and clearing cache
2021-01-15 03:38:36 INFO  TorrentBroadcast:54 - Started reading broadcast variable 6
2021-01-15 03:38:36 INFO  TransportClientFactory:267 - Successfully created connection to /172.17.0.18:44000 after 2 ms (0 ms spent in bootstraps)
2021-01-15 03:38:36 INFO  MemoryStore:54 - Block broadcast_6_piece0 stored as bytes in memory (estimated size 11.8 KB, free 365.9 MB)
2021-01-15 03:38:36 INFO  TorrentBroadcast:54 - Reading broadcast variable 6 took 76 ms
2021-01-15 03:38:36 INFO  MemoryStore:54 - Block broadcast_6 stored as values in memory (estimated size 23.2 KB, free 365.9 MB)
2021-01-15 03:38:36 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 0, fetching them
2021-01-15 03:38:36 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 0, fetching them
2021-01-15 03:38:36 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:38588)
2021-01-15 03:38:36 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:38:36 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:36 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:36 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 9 ms
2021-01-15 03:38:36 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 9 ms
2021-01-15 03:38:38 INFO  CodeGenerator:54 - Code generated in 23.22579 ms
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "Women in Islam": (2, "Women in Islam")
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "History of Ecology": (1, "History of Ecology")
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 0.0 in stage 3.0 (TID 3). 1835 bytes result sent to driver
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 24.0 in stage 3.0 (TID 4). 1835 bytes result sent to driver
2021-01-15 03:38:38 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 28
2021-01-15 03:38:38 INFO  Executor:54 - Running task 25.0 in stage 3.0 (TID 28)
2021-01-15 03:38:38 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 29
2021-01-15 03:38:38 INFO  Executor:54 - Running task 26.0 in stage 3.0 (TID 29)
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "Legacies of the Ancient World": (3, "Legacies of the Ancient World")
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "Environmental Disruptors of Development": (0, "Environmental Disruptors of Development")
2021-01-15 03:38:38 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: Invalid vid.
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 26.0 in stage 3.0 (TID 29). 1792 bytes result sent to driver
2021-01-15 03:38:38 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 30
2021-01-15 03:38:38 INFO  Executor:54 - Running task 27.0 in stage 3.0 (TID 30)
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "ITP Core 2": (4, "ITP Core 2")
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 27.0 in stage 3.0 (TID 30). 1792 bytes result sent to driver
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 25.0 in stage 3.0 (TID 28). 1792 bytes result sent to driver
2021-01-15 03:38:38 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 31
2021-01-15 03:38:38 INFO  Executor:54 - Running task 28.0 in stage 3.0 (TID 31)
2021-01-15 03:38:38 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 32
2021-01-15 03:38:38 INFO  Executor:54 - Running task 29.0 in stage 3.0 (TID 32)
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "The Research Paper: Octavia Butler\'s Kindred": (5, "The Research Paper: Octavia Butler\'s Kindred")
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 ERROR NebulaGraphClientWriter:151 - write vertex failed for Storage Error: Invalid vid.
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "Wikipedia": (7, "Wikipedia")
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 28.0 in stage 3.0 (TID 31). 1792 bytes result sent to driver
2021-01-15 03:38:38 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 33
2021-01-15 03:38:38 INFO  Executor:54 - Running task 30.0 in stage 3.0 (TID 33)
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "Neurobiology": (6, "Neurobiology")
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 29.0 in stage 3.0 (TID 32). 1792 bytes result sent to driver
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 30.0 in stage 3.0 (TID 33). 1792 bytes result sent to driver
2021-01-15 03:38:38 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 34
2021-01-15 03:38:38 INFO  Executor:54 - Running task 31.0 in stage 3.0 (TID 34)
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Getting 1 non-empty blocks including 1 local blocks and 0 remote blocks
2021-01-15 03:38:38 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:38 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:38 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:38 INFO  NebulaGraphClientWriter:145 - INSERT VERTEX course(courseId,courseName) VALUES "Media History and Theory": (8, "Media History and Theory")
2021-01-15 03:38:38 INFO  Executor:54 - Finished task 31.0 in stage 3.0 (TID 34). 1792 bytes result sent to driver
2021-01-15 03:38:43 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 41
2021-01-15 03:38:43 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 43
2021-01-15 03:38:43 INFO  Executor:54 - Running task 5.0 in stage 7.0 (TID 41)
2021-01-15 03:38:43 INFO  MapOutputTrackerWorker:54 - Updating epoch to 2 and clearing cache
2021-01-15 03:38:43 INFO  TorrentBroadcast:54 - Started reading broadcast variable 13
2021-01-15 03:38:43 INFO  Executor:54 - Running task 7.0 in stage 7.0 (TID 43)
2021-01-15 03:38:43 INFO  MemoryStore:54 - Block broadcast_13_piece0 stored as bytes in memory (estimated size 11.4 KB, free 366.3 MB)
2021-01-15 03:38:43 INFO  TorrentBroadcast:54 - Reading broadcast variable 13 took 33 ms
2021-01-15 03:38:43 INFO  MemoryStore:54 - Block broadcast_13 stored as values in memory (estimated size 22.0 KB, free 366.3 MB)
2021-01-15 03:38:43 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 1, fetching them
2021-01-15 03:38:43 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:38588)
2021-01-15 03:38:43 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 1, fetching them
2021-01-15 03:38:43 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:43 INFO  CodeGenerator:54 - Code generated in 16.589968 ms
2021-01-15 03:38:43 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:43 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:43 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:43 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:43 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:43 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:43 INFO  Executor:54 - Finished task 7.0 in stage 7.0 (TID 43). 1788 bytes result sent to driver
2021-01-15 03:38:43 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 44
2021-01-15 03:38:43 INFO  Executor:54 - Running task 8.0 in stage 7.0 (TID 44)
2021-01-15 03:38:43 INFO  Executor:54 - Finished task 5.0 in stage 7.0 (TID 41). 1788 bytes result sent to driver
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:43 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 45
2021-01-15 03:38:43 INFO  Executor:54 - Running task 9.0 in stage 7.0 (TID 45)
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:43 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:43 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:43 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:43 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:43 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:43 INFO  Executor:54 - Finished task 9.0 in stage 7.0 (TID 45). 1788 bytes result sent to driver
2021-01-15 03:38:43 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 50
2021-01-15 03:38:43 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:43 INFO  Executor:54 - Running task 12.0 in stage 7.0 (TID 50)
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:43 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:44 INFO  Executor:54 - Finished task 8.0 in stage 7.0 (TID 44). 1831 bytes result sent to driver
2021-01-15 03:38:44 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 54
2021-01-15 03:38:44 INFO  Executor:54 - Running task 14.0 in stage 7.0 (TID 54)
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:44 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:44 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:44 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:44 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:44 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:44 INFO  Executor:54 - Finished task 14.0 in stage 7.0 (TID 54). 1788 bytes result sent to driver
2021-01-15 03:38:44 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 60
2021-01-15 03:38:44 INFO  Executor:54 - Running task 17.0 in stage 7.0 (TID 60)
2021-01-15 03:38:44 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:44 INFO  Executor:54 - Finished task 12.0 in stage 7.0 (TID 50). 1788 bytes result sent to driver
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:44 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 61
2021-01-15 03:38:44 INFO  Executor:54 - Running task 18.0 in stage 7.0 (TID 61)
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 2 ms
2021-01-15 03:38:44 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:44 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:44 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:44 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:44 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:44 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:44 INFO  Executor:54 - Finished task 18.0 in stage 7.0 (TID 61). 1788 bytes result sent to driver
2021-01-15 03:38:44 INFO  Executor:54 - Finished task 17.0 in stage 7.0 (TID 60). 1788 bytes result sent to driver
2021-01-15 03:38:44 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 66
2021-01-15 03:38:44 INFO  Executor:54 - Running task 21.0 in stage 7.0 (TID 66)
2021-01-15 03:38:44 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 67
2021-01-15 03:38:44 INFO  Executor:54 - Running task 22.0 in stage 7.0 (TID 67)
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:44 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:44 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:44 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:44 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:44 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:44 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:44 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:44 INFO  Executor:54 - Finished task 21.0 in stage 7.0 (TID 66). 1788 bytes result sent to driver
2021-01-15 03:38:44 INFO  Executor:54 - Finished task 22.0 in stage 7.0 (TID 67). 1788 bytes result sent to driver
2021-01-15 03:38:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 76
2021-01-15 03:38:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 78
2021-01-15 03:38:46 INFO  Executor:54 - Running task 1.0 in stage 11.0 (TID 76)
2021-01-15 03:38:46 INFO  Executor:54 - Running task 3.0 in stage 11.0 (TID 78)
2021-01-15 03:38:46 INFO  MapOutputTrackerWorker:54 - Updating epoch to 3 and clearing cache
2021-01-15 03:38:46 INFO  TorrentBroadcast:54 - Started reading broadcast variable 20
2021-01-15 03:38:46 INFO  MemoryStore:54 - Block broadcast_20_piece0 stored as bytes in memory (estimated size 12.7 KB, free 366.3 MB)
2021-01-15 03:38:46 INFO  TorrentBroadcast:54 - Reading broadcast variable 20 took 14 ms
2021-01-15 03:38:46 INFO  MemoryStore:54 - Block broadcast_20 stored as values in memory (estimated size 26.6 KB, free 366.3 MB)
2021-01-15 03:38:46 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 2, fetching them
2021-01-15 03:38:46 INFO  MapOutputTrackerWorker:54 - Doing the fetch; tracker endpoint = NettyRpcEndpointRef(spark://MapOutputTracker@2bf1fc2dba17:38588)
2021-01-15 03:38:46 INFO  MapOutputTrackerWorker:54 - Don't have map outputs for shuffle 2, fetching them
2021-01-15 03:38:46 INFO  MapOutputTrackerWorker:54 - Got the output locations
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:46 INFO  CodeGenerator:54 - Code generated in 34.718126 ms
2021-01-15 03:38:46 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:46 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:46 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:46 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:46 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:46 INFO  Executor:54 - Finished task 3.0 in stage 11.0 (TID 78). 1792 bytes result sent to driver
2021-01-15 03:38:46 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 81
2021-01-15 03:38:46 INFO  Executor:54 - Running task 6.0 in stage 11.0 (TID 81)
2021-01-15 03:38:46 INFO  Executor:54 - Finished task 1.0 in stage 11.0 (TID 76). 1792 bytes result sent to driver
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 82
2021-01-15 03:38:46 INFO  Executor:54 - Running task 7.0 in stage 11.0 (TID 82)
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:46 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:46 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:46 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:46 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:46 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:46 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:46 INFO  Executor:54 - Finished task 7.0 in stage 11.0 (TID 82). 1792 bytes result sent to driver
2021-01-15 03:38:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 87
2021-01-15 03:38:46 INFO  Executor:54 - Running task 10.0 in stage 11.0 (TID 87)
2021-01-15 03:38:46 INFO  Executor:54 - Finished task 6.0 in stage 11.0 (TID 81). 1792 bytes result sent to driver
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:46 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 89
2021-01-15 03:38:46 INFO  Executor:54 - Running task 12.0 in stage 11.0 (TID 89)
2021-01-15 03:38:46 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:46 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:46 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:46 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:46 INFO  Executor:54 - Finished task 10.0 in stage 11.0 (TID 87). 1792 bytes result sent to driver
2021-01-15 03:38:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 91
2021-01-15 03:38:46 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:46 INFO  Executor:54 - Running task 14.0 in stage 11.0 (TID 91)
2021-01-15 03:38:46 INFO  Executor:54 - Finished task 12.0 in stage 11.0 (TID 89). 1792 bytes result sent to driver
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 2 ms
2021-01-15 03:38:46 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:46 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 95
2021-01-15 03:38:46 INFO  Executor:54 - Running task 17.0 in stage 11.0 (TID 95)
2021-01-15 03:38:46 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:46 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:46 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:47 INFO  Executor:54 - Finished task 14.0 in stage 11.0 (TID 91). 1792 bytes result sent to driver
2021-01-15 03:38:47 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 98
2021-01-15 03:38:47 INFO  Executor:54 - Running task 20.0 in stage 11.0 (TID 98)
2021-01-15 03:38:47 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:47 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:47 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:47 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 1 ms
2021-01-15 03:38:47 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:47 INFO  Executor:54 - Finished task 17.0 in stage 11.0 (TID 95). 1792 bytes result sent to driver
2021-01-15 03:38:47 INFO  CoarseGrainedExecutorBackend:54 - Got assigned task 100
2021-01-15 03:38:47 INFO  Executor:54 - Running task 22.0 in stage 11.0 (TID 100)
2021-01-15 03:38:47 INFO  ShuffleBlockFetcherIterator:54 - Getting 0 non-empty blocks including 0 local blocks and 0 remote blocks
2021-01-15 03:38:47 INFO  ShuffleBlockFetcherIterator:54 - Started 0 remote fetches in 0 ms
2021-01-15 03:38:47 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:47 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:47 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:47 INFO  NebulaPool:105 - Get connection to 172.17.0.11:3699
2021-01-15 03:38:47 INFO  Executor:54 - Finished task 20.0 in stage 11.0 (TID 98). 1792 bytes result sent to driver
2021-01-15 03:38:47 INFO  GraphProvider:47 - switch space csv
2021-01-15 03:38:47 INFO  NebulaGraphClientWriter:140 - Connection to List(172.17.0.11:45500, 172.17.0.16:45500, 172.17.0.18:45500)
2021-01-15 03:38:47 INFO  Executor:54 - Finished task 22.0 in stage 11.0 (TID 100). 1792 bytes result sent to driver
2021-01-15 03:38:47 INFO  CoarseGrainedExecutorBackend:54 - Driver commanded a shutdown
2021-01-15 03:38:47 ERROR CoarseGrainedExecutorBackend:43 - RECEIVED SIGNAL TERM

我刚刚,调整了一下,fix string的长度,为32,发现有些点能够导进去了,有些边也能导进去了,但是还有一些错误,

比如,某一个顶点,VID :The Research Paper: Octavia Butler’s Kindred,然后探索时候,没有,是否我的string要加大力度

course的vid 有个值是“Environmental Disruptors of Development” 也是太长了,所以点的插入失败:

write vertex failed for Storage Error: Invalid vid.

这个顶点所在的批次应该是因为 vid的长度超过了32 导致数据没有插入进去,创建space的时候尽量根据要插入的数据,把String的length设大一些

1 个赞

OK了,整个问题定位出来了,多谢官方大大,,,

问题:
1,配置文件格式
2,VID默认string为VID,然后create space时候VID长度短了,会导致插入失败

希望就能够构造出像String32,String64这样的数据类型,对个别的字段生效,直接设置fix_string感觉会爆炸的

感谢总结~
你提的这个建议会反馈给pm小姐姐~

1 个赞