Skip to content

集群正常运行,然后停机以后,再次启动就无法启动了 #1398

@liweidong1216

Description

@liweidong1216

错误日志如下:

2021-03-20 22:07:20 1743  [main] [INFO ] com.jcabi.manifests.Manifests [] - 83 attributes loaded from 233 stream(s) in 172ms, 83 saved, 3333 ignored: ["Agent-Class", "Ant-Version", "Archiver-Version", "Automatic-Module-Name", "Bnd-LastModified", "Build-Id", "Build-Jdk", "Build-Version", "Built-At", "Built-By", "Built-Date", "Built-On", "Bundle-ActivationPolicy", "Bundle-Activator", "Bundle-Category", "Bundle-ClassPath", "Bundle-ContactAddress", "Bundle-Copyright", "Bundle-Description", "Bundle-DocURL", "Bundle-License", "Bundle-ManifestVersion", "Bundle-Name", "Bundle-NativeCode", "Bundle-RequiredExecutionEnvironment", "Bundle-SymbolicName", "Bundle-Vendor", "Bundle-Version", "Class-Path", "Created-By", "DSTAMP", "DynamicImport-Package", "Eclipse-BuddyPolicy", "Eclipse-ExtensibleAPI", "Embed-Dependency", "Export-Package", "Extension-Name", "Extension-name", "Fragment-Host", "Ignore-Package", "Implementation-Build", "Implementation-Build-Date", "Implementation-Build-Id", "Implementation-Title", "Implementation-URL", "Implementation-Vendor", "Implementation-Vendor-Id", "Implementation-Version", "Import-Package", "Include-Resource", "JCabi-Build", "JCabi-Date", "JCabi-Version", "Log4jReleaseKey", "Log4jReleaseManager", "Log4jReleaseVersion", "Main-Class", "Manifest-Version", "Maven-Version", "Multi-Release", "Originally-Created-By", "Package", "Premain-Class", "Private-Package", "Provide-Capability", "Require-Bundle", "Require-Capability", "Sealed", "Specification-Title", "Specification-Vendor", "Specification-Version", "TODAY", "TSTAMP", "Tool", "X-Compile-Source-JDK", "X-Compile-Target-JDK", "hash", "implementation-version", "mode", "package", "service", "url", "version"]
2021-03-20 22:07:20 1748  [main] [INFO ] com.baidu.hugegraph.dist.HugeGremlinServer [] - 3.4.3
         \,,,/
         (o o)
-----oOOo-(3)-oOOo-----

2021-03-20 22:07:20 1838  [main] [INFO ] com.baidu.hugegraph.dist.HugeGremlinServer [] - Configuring Gremlin Server from /opt/hugegraph/hugegraph-0.11.2/conf/gremlin-server.yaml
2021-03-20 22:07:20 1980  [main] [INFO ] com.baidu.hugegraph.backend.store.BackendProviderFactory [] - Opening backend store 'rocksdb' in raft mode for graph 'hugegraph'
2021-03-20 22:07:20 2028  [main] [INFO ] com.alipay.sofa.jraft.util.JRaftServiceLoader [] - SPI service [com.alipay.sofa.jraft.rpc.RaftRpcFactory - com.alipay.sofa.jraft.rpc.impl.BoltRaftRpcFactory] loading.
Sofa-Middleware-Log SLF4J : Actual binding is of type [ com.alipay.remoting Log4j2 ]
2021-03-20 22:07:20 2110  [main] [INFO ] com.alipay.sofa.common.log [] - Sofa-Middleware-Log SLF4J : Actual binding is of type [ com.alipay.remoting Log4j2 ]
2021-03-20 22:07:20 2543  [main] [INFO ] com.baidu.hugegraph.backend.store.raft.RaftSharedContext [] - RPC server is started successfully
2021-03-20 22:07:21 2560  [main] [INFO ] com.baidu.hugegraph.backend.store.raft.RaftBackendStoreProvider [] - Init raft backend system store
2021-03-20 22:07:21 2585  [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Graph [hugegraph] was successfully configured via [conf/hugegraph.properties].
2021-03-20 22:07:21 2585  [main] [INFO ] org.apache.tinkerpop.gremlin.server.util.ServerGremlinExecutor [] - Initialized Gremlin thread pool.  Threads in pool named with pattern gremlin-*
2021-03-20 22:07:21 2888  [main] [INFO ] org.apache.tinkerpop.gremlin.server.util.ServerGremlinExecutor [] - Initialized GremlinExecutor and preparing GremlinScriptEngines instances.
2021-03-20 22:07:23 5501  [main] [INFO ] org.apache.tinkerpop.gremlin.server.util.ServerGremlinExecutor [] - Initialized gremlin-groovy GremlinScriptEngine and registered metrics
2021-03-20 22:07:23 5514  [main] [INFO ] org.apache.tinkerpop.gremlin.server.op.OpLoader [] - Adding the standard OpProcessor.
2021-03-20 22:07:23 5516  [main] [INFO ] org.apache.tinkerpop.gremlin.server.op.OpLoader [] - Adding the session OpProcessor.
2021-03-20 22:07:24 5562  [main] [INFO ] org.apache.tinkerpop.gremlin.server.op.OpLoader [] - Adding the traversal OpProcessor.
2021-03-20 22:07:24 5569  [main] [INFO ] org.apache.tinkerpop.gremlin.server.op.traversal.TraversalOpProcessor [] - Initialized cache for TraversalOpProcessor with size 1000 and expiration time of 600000 ms
2021-03-20 22:07:24 5570  [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Executing start up LifeCycleHook
2021-03-20 22:07:24 5583  [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Executed once at startup of Gremlin Server.
2021-03-20 22:07:24 5589  [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - idleConnectionTimeout was set to 0 which resolves to 0 seconds when configuring this value - this feature will be disabled
2021-03-20 22:07:24 5590  [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - keepAliveInterval was set to 0 which resolves to 0 seconds when configuring this value - this feature will be disabled
2021-03-20 22:07:24 5633  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - Configured application/vnd.graphbinary-v1.0 with org.apache.tinkerpop.gremlin.driver.ser.GraphBinaryMessageSerializerV1
2021-03-20 22:07:24 5640  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - Configured application/json with org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV1d0
2021-03-20 22:07:24 5652  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - Configured application/vnd.gremlin-v2.0+json with org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV2d0
2021-03-20 22:07:24 5653  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - application/json already has org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV1d0 configured - it will not be replaced by org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV2d0, change order of serialization configuration if this is not desired.
2021-03-20 22:07:24 5663  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - Configured application/vnd.gremlin-v3.0+json with org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV3d0
2021-03-20 22:07:24 5663  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - application/json already has org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV1d0 configured - it will not be replaced by org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV3d0, change order of serialization configuration if this is not desired.
2021-03-20 22:07:24 5674  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - Configured application/vnd.graphbinary-v1.0 with org.apache.tinkerpop.gremlin.driver.ser.GraphBinaryMessageSerializerV1
2021-03-20 22:07:24 5675  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - Configured application/json with org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV1d0
2021-03-20 22:07:24 5677  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - Configured application/vnd.gremlin-v2.0+json with org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV2d0
2021-03-20 22:07:24 5677  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - application/json already has org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV1d0 configured - it will not be replaced by org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV2d0, change order of serialization configuration if this is not desired.
2021-03-20 22:07:24 5681  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - Configured application/vnd.gremlin-v3.0+json with org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV3d0
2021-03-20 22:07:24 5682  [main] [INFO ] org.apache.tinkerpop.gremlin.server.AbstractChannelizer [] - application/json already has org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV1d0 configured - it will not be replaced by org.apache.tinkerpop.gremlin.driver.ser.GraphSONMessageSerializerV3d0, change order of serialization configuration if this is not desired.
2021-03-20 22:07:24 5701  [gremlin-server-boss-1] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Gremlin Server configured with worker thread pool of 1, gremlin pool of 4 and boss thread pool of 1.
2021-03-20 22:07:24 5701  [gremlin-server-boss-1] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Channel started at port 8182.
2021-03-20 22:07:24 5708  [main] [INFO ] com.baidu.hugegraph.server.RestServer [] - RestServer starting...
Mar 20, 2021 10:07:25 PM org.glassfish.grizzly.http.server.NetworkListener start
INFO: Started listener bound to [192.168.121.129:8080]
2021-03-20 22:07:25 6624  [main] [INFO ] com.baidu.hugegraph.server.RestServer [] - Graph 'hugegraph' was successfully configured via 'conf/hugegraph.properties'
2021-03-20 22:07:25 6629  [main] [INFO ] com.baidu.hugegraph.backend.store.raft.RaftBackendStoreProvider [] - Init raft backend schema store
2021-03-20 22:07:25 6641  [db-open-1] [INFO ] com.baidu.hugegraph.backend.store.rocksdb.RocksDBStore [] - Opening RocksDB with data path: /opt/hugegraph/hugegraph-0.11.2/data/m
2021-03-20 22:07:25 6921  [db-open-1] [INFO ] com.baidu.hugegraph.backend.store.rocksdb.RocksDBStore [] - Opening RocksDB with data path: /opt/hugegraph/hugegraph-0.11.2/data/s
main dict load finished, time elapsed 1290 ms
model load finished, time elapsed 26 ms.
2021-03-20 22:07:26 8364  [main] [INFO ] com.baidu.hugegraph.backend.store.raft.RaftBackendStoreProvider [] - Init raft backend graph store
2021-03-20 22:07:26 8365  [db-open-1] [INFO ] com.baidu.hugegraph.backend.store.rocksdb.RocksDBStore [] - Opening RocksDB with data path: /opt/hugegraph/hugegraph-0.11.2/data/g
2021-03-20 22:07:26 8424  [main] [INFO ] com.alipay.sofa.jraft.util.JRaftServiceLoader [] - SPI service [com.alipay.sofa.jraft.JRaftServiceFactory - com.alipay.sofa.jraft.core.DefaultJRaftServiceFactory] loading.
2021-03-20 22:07:26 8447  [main] [INFO ] com.alipay.sofa.jraft.util.JRaftServiceLoader [] - SPI service [com.alipay.sofa.jraft.util.JRaftSignalHandler - com.alipay.sofa.jraft.NodeDescribeSignalHandler] loading.
2021-03-20 22:07:26 8448  [main] [INFO ] com.alipay.sofa.jraft.util.JRaftServiceLoader [] - SPI service [com.alipay.sofa.jraft.util.JRaftSignalHandler - com.alipay.sofa.jraft.NodeMetricsSignalHandler] loading.
2021-03-20 22:07:26 8449  [main] [INFO ] com.alipay.sofa.jraft.util.JRaftServiceLoader [] - SPI service [com.alipay.sofa.jraft.util.JRaftSignalHandler - com.alipay.sofa.jraft.ThreadPoolMetricsSignalHandler] loading.
2021-03-20 22:07:26 8451  [main] [INFO ] com.alipay.sofa.jraft.util.JRaftServiceLoader [] - SPI service [com.alipay.sofa.jraft.util.timer.RaftTimerFactory - com.alipay.sofa.jraft.util.timer.DefaultRaftTimerFactory] loading.
2021-03-20 22:07:26 8455  [main] [INFO ] com.alipay.sofa.jraft.core.NodeImpl [] - The number of active nodes increment to 1.
2021-03-20 22:07:27 8650  [main] [INFO ] com.alipay.sofa.jraft.core.FSMCallerImpl [] - Starts FSMCaller successfully.
2021-03-20 22:07:27 8652  [main] [WARN ] com.alipay.sofa.jraft.core.NodeImpl [] - Do not set snapshot uri, ignore initSnapshotStorage.
2021-03-20 22:07:27 8653  [main] [INFO ] com.alipay.sofa.jraft.core.NodeImpl [] - Node <default/192.168.121.129:8281> target priority value has changed from: 0, to: -1.
2021-03-20 22:07:27 8689  [main] [INFO ] com.alipay.sofa.jraft.core.NodeImpl [] - Node <default/192.168.121.129:8281> init, term=12, lastLogId=LogId [index=7458, term=12], conf=192.168.121.128:8281,192.168.121.129:8281,192.168.121.130:8281, oldConf=.
2021-03-20 22:07:27 8692  [main] [WARN ] com.alipay.sofa.jraft.RaftGroupService [] - RPC server is not started in RaftGroupService.
2021-03-20 22:07:27 8692  [main] [INFO ] com.alipay.sofa.jraft.RaftGroupService [] - Start the RaftGroupService successfully.
2021-03-20 22:07:27 8694  [main] [INFO ] com.baidu.hugegraph.backend.store.raft.RaftBackendStoreProvider [] - The raft node is initialized
2021-03-20 22:07:30 11695 [main] [WARN ] com.baidu.hugegraph.backend.store.raft.RaftNode [] - Waiting for raft group 'default' election cost 3.0s
2021-03-20 22:07:30 11906 [Bolt-default-executor-5-thread-2] [INFO ] com.alipay.sofa.jraft.core.NodeImpl [] - Node <default/192.168.121.129:8281> received PreVoteRequest from 192.168.121.128:8281, term=13, currTerm=12, granted=true, requestLastLogId=LogId [index=7458, term=12], lastLogId=LogId [index=7458, term=12].
2021-03-20 22:07:30 11924 [Bolt-default-executor-5-thread-3] [INFO ] com.alipay.sofa.jraft.core.NodeImpl [] - Node <default/192.168.121.129:8281> received RequestVoteRequest from 192.168.121.128:8281, term=13, currTerm=12.
2021-03-20 22:07:30 11936 [Bolt-default-executor-5-thread-3] [INFO ] com.alipay.sofa.jraft.storage.impl.LocalRaftMetaStorage [] - Save raft meta, path=./raft-log/meta, term=13, votedFor=0.0.0.0:0, cost time=10 ms
2021-03-20 22:07:30 11937 [Bolt-default-executor-5-thread-3] [INFO ] com.alipay.sofa.jraft.storage.impl.LocalRaftMetaStorage [] - Save raft meta, path=./raft-log/meta, term=13, votedFor=192.168.121.128:8281, cost time=2 ms
2021-03-20 22:07:30 11963 [Rpc-netty-server-worker-1-thread-1] [WARN ] com.alipay.sofa.jraft.rpc.impl.BoltRaftRpcFactory [] - JRaft SET bolt.rpc.dispatch-msg-list-in-default-executor to be false for replicator pipeline optimistic.
2021-03-20 22:07:30 11968 [JRaft-FSMCaller-Disruptor-0] [INFO ] com.baidu.hugegraph.backend.store.raft.StoreStateMachine [] - The node 192.168.121.129:8281 become to follower
2021-03-20 22:07:30 11968 [JRaft-FSMCaller-Disruptor-0] [INFO ] com.alipay.sofa.jraft.core.StateMachineAdapter [] - onStartFollowing: LeaderChangeContext [leaderId=192.168.121.128:8281, term=13, status=Status[ENEWLEADER<10011>: Follower receives message from new leader with the same term.]].
2021-03-20 22:07:30 11983 [default/192.168.121.129:8281-AppendEntriesThread0] [INFO ] com.alipay.sofa.jraft.util.Recyclers [] - -Djraft.recyclers.maxCapacityPerThread: 4096.
2021-03-20 22:07:31 13450 [store-backend-executor33] [ERROR] com.baidu.hugegraph.backend.store.raft.StoreStateMachine [] - Failed to execute backend command: COMMIT_TX
java.nio.BufferUnderflowException: null
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:151) ~[?:1.8.0_212]
        at java.nio.ByteBuffer.get(ByteBuffer.java:715) ~[?:1.8.0_212]
        at com.baidu.hugegraph.backend.serializer.BytesBuffer.read(BytesBuffer.java:258) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.serializer.BytesBuffer.readIndexId(BytesBuffer.java:760) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.serializer.BytesBuffer.parseId(BytesBuffer.java:774) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.serializer.BinaryBackendEntry.<init>(BinaryBackendEntry.java:47) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.store.raft.StoreSerializer.readMutation(StoreSerializer.java:119) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.store.raft.StoreSerializer.readMutations(StoreSerializer.java:63) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.store.raft.StoreStateMachine.applyCommand(StoreStateMachine.java:175) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.store.raft.StoreStateMachine.lambda$onApply$1(StoreStateMachine.java:131) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_212]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_212]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_212]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_212]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]
2021-03-20 22:07:31 13455 [store-backend-executor33] [ERROR] com.alipay.sofa.jraft.util.LogThreadPoolExecutor [] - Uncaught exception in pool: store-backend-executor, com.alipay.sofa.jraft.util.LogThreadPoolExecutor@403a1a85[Running, pool size = 48, active threads = 48, queued tasks = 3747, completed tasks = 3650].
com.baidu.hugegraph.backend.BackendException: Backend error
        at com.baidu.hugegraph.backend.store.raft.StoreStateMachine.lambda$onApply$1(StoreStateMachine.java:135) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_212]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_212]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_212]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_212]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]
Caused by: java.nio.BufferUnderflowException
        at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:151) ~[?:1.8.0_212]
        at java.nio.ByteBuffer.get(ByteBuffer.java:715) ~[?:1.8.0_212]
        at com.baidu.hugegraph.backend.serializer.BytesBuffer.read(BytesBuffer.java:258) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.serializer.BytesBuffer.readIndexId(BytesBuffer.java:760) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.serializer.BytesBuffer.parseId(BytesBuffer.java:774) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.serializer.BinaryBackendEntry.<init>(BinaryBackendEntry.java:47) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.store.raft.StoreSerializer.readMutation(StoreSerializer.java:119) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.store.raft.StoreSerializer.readMutations(StoreSerializer.java:63) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.store.raft.StoreStateMachine.applyCommand(StoreStateMachine.java:175) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.backend.store.raft.StoreStateMachine.lambda$onApply$1(StoreStateMachine.java:131) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        ... 5 more
2021-03-20 22:07:33 14696 [main] [WARN ] com.baidu.hugegraph.backend.store.raft.RaftNode [] - Waiting for raft group 'default' election cost 6.002s
2021-03-20 22:07:33 14697 [main] [INFO ] com.baidu.hugegraph.backend.store.raft.RaftBackendStoreProvider [] - The raft store is started
Mar 20, 2021 10:07:33 PM org.glassfish.grizzly.http.server.NetworkListener shutdownNow
INFO: Stopped listener bound to [192.168.121.129:8080]
2021-03-20 22:07:33 14714 [main] [ERROR] com.baidu.hugegraph.dist.HugeGraphServer [] - HugeRestServer start error: 
com.baidu.hugegraph.backend.BackendException: The backend store of 'hugegraph' has not been initialized
        at com.baidu.hugegraph.core.GraphManager.checkBackendVersionOrExit(GraphManager.java:217) ~[hugegraph-api-0.11.2.jar:0.58.0.0]
        at com.baidu.hugegraph.core.GraphManager.<init>(GraphManager.java:77) ~[hugegraph-api-0.11.2.jar:0.58.0.0]
        at com.baidu.hugegraph.server.ApplicationConfig$GraphManagerFactory$1.onEvent(ApplicationConfig.java:108) ~[hugegraph-api-0.11.2.jar:0.58.0.0]
        at org.glassfish.jersey.server.internal.monitoring.CompositeApplicationEventListener.onEvent(CompositeApplicationEventListener.java:74) ~[jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.internal.monitoring.MonitoringContainerListener.onStartup(MonitoringContainerListener.java:81) ~[jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ApplicationHandler.onStartup(ApplicationHandler.java:1180) ~[jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.start(GrizzlyHttpContainer.java:357) ~[jersey-container-grizzly2-http-2.25.1.jar:?]
        at org.glassfish.grizzly.http.server.HttpHandlerChain.start(HttpHandlerChain.java:398) ~[grizzly-http-server-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.http.server.HttpServer.setupHttpHandler(HttpServer.java:293) ~[grizzly-http-server-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.http.server.HttpServer.start(HttpServer.java:269) ~[grizzly-http-server-2.4.4.jar:2.4.4]
        at com.baidu.hugegraph.server.RestServer.start(RestServer.java:64) ~[hugegraph-api-0.11.2.jar:0.58.0.0]
        at com.baidu.hugegraph.server.RestServer.start(RestServer.java:133) ~[hugegraph-api-0.11.2.jar:0.58.0.0]
        at com.baidu.hugegraph.dist.HugeRestServer.start(HugeRestServer.java:58) ~[hugegraph-dist-0.11.2.jar:?]
        at com.baidu.hugegraph.dist.HugeGraphServer.<init>(HugeGraphServer.java:55) [hugegraph-dist-0.11.2.jar:?]
        at com.baidu.hugegraph.dist.HugeGraphServer.main(HugeGraphServer.java:100) [hugegraph-dist-0.11.2.jar:?]
2021-03-20 22:07:33 14721 [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Shutting down OpProcessor[]
2021-03-20 22:07:33 14721 [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Shutting down OpProcessor[session]
2021-03-20 22:07:33 14722 [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Shutting down OpProcessor[traversal]
2021-03-20 22:07:33 14723 [main] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Shutting down thread pools.
2021-03-20 22:07:33 14726 [gremlin-server-stop] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Executing shutdown LifeCycleHook
2021-03-20 22:07:33 14726 [gremlin-server-stop] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Executed once at shutdown of Gremlin Server.
2021-03-20 22:07:35 16936 [gremlin-server-stop] [INFO ] com.baidu.hugegraph.HugeGraph [] - Close graph standardhugegraph[hugegraph]
2021-03-20 22:07:35 16965 [gremlin-server-stop] [INFO ] com.baidu.hugegraph.backend.store.raft.RaftSharedContext [] - Stopping raft nodes
2021-03-20 22:07:35 16968 [gremlin-server-stop] [WARN ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Exception while closing Graph instance [hugegraph]
java.lang.IllegalStateException: Ensure tx closed in all threads when closing graph 'hugegraph'
        at com.google.common.base.Preconditions.checkState(Preconditions.java:531) ~[guava-25.1-jre.jar:?]
        at com.baidu.hugegraph.util.E.checkState(E.java:68) ~[hugegraph-common-1.8.1.jar:1.8.1.0]
        at com.baidu.hugegraph.StandardHugeGraph.close(StandardHugeGraph.java:800) ~[hugegraph-core-0.11.2.jar:0.11.2.0]
        at org.apache.tinkerpop.gremlin.server.GremlinServer.lambda$null$7(GremlinServer.java:298) ~[gremlin-server-3.4.3.jar:3.4.3]
        at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649) ~[?:1.8.0_212]
        at org.apache.tinkerpop.gremlin.server.GremlinServer.lambda$stop$8(GremlinServer.java:295) ~[gremlin-server-3.4.3.jar:3.4.3]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]
2021-03-20 22:07:35 16970 [gremlin-server-stop] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Closed Graph instance [hugegraph]
2021-03-20 22:07:35 16971 [gremlin-server-stop] [INFO ] org.apache.tinkerpop.gremlin.server.GremlinServer [] - Gremlin Server - shutdown complete
Exception in thread "main" com.baidu.hugegraph.backend.BackendException: The backend store of 'hugegraph' has not been initialized
        at com.baidu.hugegraph.core.GraphManager.checkBackendVersionOrExit(GraphManager.java:217)
        at com.baidu.hugegraph.core.GraphManager.<init>(GraphManager.java:77)
        at com.baidu.hugegraph.server.ApplicationConfig$GraphManagerFactory$1.onEvent(ApplicationConfig.java:108)
        at org.glassfish.jersey.server.internal.monitoring.CompositeApplicationEventListener.onEvent(CompositeApplicationEventListener.java:74)
        at org.glassfish.jersey.server.internal.monitoring.MonitoringContainerListener.onStartup(MonitoringContainerListener.java:81)
        at org.glassfish.jersey.server.ApplicationHandler.onStartup(ApplicationHandler.java:1180)
        at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.start(GrizzlyHttpContainer.java:357)
        at org.glassfish.grizzly.http.server.HttpHandlerChain.start(HttpHandlerChain.java:398)
        at org.glassfish.grizzly.http.server.HttpServer.setupHttpHandler(HttpServer.java:293)
        at org.glassfish.grizzly.http.server.HttpServer.start(HttpServer.java:269)
        at com.baidu.hugegraph.server.RestServer.start(RestServer.java:64)
        at com.baidu.hugegraph.server.RestServer.start(RestServer.java:133)
        at com.baidu.hugegraph.dist.HugeRestServer.start(HugeRestServer.java:58)
        at com.baidu.hugegraph.dist.HugeGraphServer.<init>(HugeGraphServer.java:55)
        at com.baidu.hugegraph.dist.HugeGraphServer.main(HugeGraphServer.java:100)
2021-03-20 22:07:35 16985 [Bolt-conn-event-executor-4-thread-1] [INFO ] com.alipay.sofa.jraft.rpc.RpcRequestProcessor [] - Destroyed peer request context for default/192.168.121.129:8281
2021-03-20 22:07:37 19182 [Thread-1] [INFO ] com.baidu.hugegraph.HugeGraph [] - HugeGraph is shutting down

Specifications of environment 环境信息

  • hugegraph version:0.11.2
  • operating system: {centos 7.4, 32 CPUs, 64G RAM}
  • hugegraph backend: {rocksdb, cluster with 3 nodes}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions