Stage2 hook starts
Resource check is unsupported on aarch64 architecture. Proceeding anyway.
Using http://localhost:3000 as public URL
Stage2 hook ends
s6-rc: info: service s6rc-oneshot-runner: starting
s6-rc: info: service s6rc-oneshot-runner successfully started
s6-rc: info: service fix-attrs: starting
s6-rc: info: service fix-attrs successfully started
s6-rc: info: service legacy-cont-init: starting
s6-rc: info: service legacy-cont-init successfully started
s6-rc: info: service init-data: starting
s6-rc: info: service quiver: starting
s6-rc: info: service goss: starting
s6-rc: info: service dex: starting
s6-rc: info: service goss successfully started
Keeping previous database. If you want to start from scratch,
delete this container and respective docker volume attached to it.
Replacing old directory with symlink to data directory
s6-rc: info: service init-data successfully started
s6-rc: info: service redis: starting
s6-rc: info: service pulsar: starting
s6-rc: info: service postgres: starting
130:C 06 Dec 2023 21:54:22.898 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
130:C 06 Dec 2023 21:54:22.899 # Redis version=6.0.16, bits=64, commit=00000000, modified=0, pid=130, just started
130:C 06 Dec 2023 21:54:22.899 # Configuration loaded
                _._                                                  
           _.-``__ ''-._                                             
      _.-``    `.  `_.  ''-._           Redis 6.0.16 (00000000/0) 64 bit
  .-`` .-```.  ```\/    _.,_ ''-._                                   
 (    '      ,       .-`  | `,    )     Running in standalone mode
 |`-._`-...-` __...-.``-._|'` _.-'|     Port: 6379
 |    `-._   `._    /     _.-'    |     PID: 130
  `-._    `-._  `-./  _.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |           http://redis.io        
  `-._    `-._`-.__.-'_.-'    _.-'                                   
 |`-._`-._    `-.__.-'    _.-'_.-'|                                  
 |    `-._`-._        _.-'_.-'    |                                  
  `-._    `-._`-.__.-'_.-'    _.-'                                   
      `-._    `-.__.-'    _.-'                                       
          `-._        _.-'                                           
              `-.__.-'                                               

130:M 06 Dec 2023 21:54:22.910 # Server initialized
130:M 06 Dec 2023 21:54:22.910 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
130:M 06 Dec 2023 21:54:22.910 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo madvise > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled (set to 'madvise' or 'never').
130:M 06 Dec 2023 21:54:22.932 * Ready to accept connections
2023-12-06 21:54:22.968 UTC [132] LOG:  starting PostgreSQL 13.11 (Debian 13.11-0+deb11u1) on aarch64-unknown-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
2023-12-06 21:54:22.969 UTC [132] LOG:  listening on IPv4 address "0.0.0.0", port 5432
2023-12-06 21:54:22.969 UTC [132] LOG:  listening on IPv6 address "::", port 5432
2023-12-06 21:54:22.972 UTC [132] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
2023-12-06 21:54:22.978 UTC [172] LOG:  database system was shut down at 2023-12-06 21:39:09 UTC
2023-12-06 21:54:22.995 UTC [132] LOG:  database system is ready to accept connections
Loading settings from ('/opt/quiver-conf/quiver.conf.toml',)
Health check passed
Dex: ready
s6-rc: info: service dex successfully started
PONG

Redis: ready
s6-rc: info: service redis successfully started
/var/run/postgresql:5432 - accepting connections

PostgreSQL Server: ready
s6-rc: info: service postgres successfully started
s6-rc: info: service init-demo-data: starting
Keep existing demo schema ecommerce-demo
s6-rc: info: service init-demo-data successfully started
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by io.netty.util.internal.ReflectionUtil (file:/opt/apache-pulsar/lib/io.netty-netty-common-4.1.87.Final.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of io.netty.util.internal.ReflectionUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2023-12-06T21:54:24,542+0000 [main] WARN  org.apache.zookeeper.server.ServerCnxnFactory - maxCnxns is not configured, using default value 0.
{"module":"quiver_shard","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:24.709380Z","event":"loading_module"}
2023-12-06T21:54:24,975+0000 [main] ERROR org.apache.bookkeeper.bookie.Journal - Problems reading from data/standalone/bookkeeper0/current/lastMark (this is okay if it is the first time starting this bookie
{"module":"quiver_policy","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:25.542244Z","event":"loading_module"}
{"module":"quiver_dataframe","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:25.575038Z","event":"loading_module"}
2023-12-06T21:54:25,610+0000 [main] WARN  org.apache.pulsar.broker.protocol.ProtocolHandlerUtils - Protocol handler directory not found
2023-12-06T21:54:25,769+0000 [main] WARN  org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy - Failed to resolve network location for 172.17.0.2, using default rack for it : /default-rack.
2023-12-06T21:54:25,782+0000 [pulsar-registration-client-29-1] WARN  org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy - Failed to resolve network location for 127.0.0.1, using default rack for it : /default-rack.
{"memory_limit":8225542144,"logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.017140Z","event":"server_health_monitor_started"}
{"platform":"Linux-6.4.16-linuxkit-aarch64-with-glibc2.31","python_version":"3.11.6","arrow_version":"12.0.1","quiver_version":"0.79.0","server_heartbeat_interval":0.1,"server_trim_interval":30,"server_work_dir":null,"critical_rss_grace":30,"logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.025221Z","event":"server_startup"}
{"op_module":"gooddata_df_ops.ops.crosstab_op","logger":"quiver.dataframe","level":"info","timestamp":"2023-12-06T21:54:26.025832Z","event":"load_operation"}
2023-12-06T21:54:26,047+0000 [main] WARN  org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy - Failed to resolve network location for 172.17.0.2, using default rack for it : /default-rack.
2023-12-06T21:54:26,055+0000 [pulsar-registration-client-45-1] WARN  org.apache.bookkeeper.client.TopologyAwareEnsemblePlacementPolicy - Failed to resolve network location for 127.0.0.1, using default rack for it : /default-rack.
2023-12-06T21:54:26,075+0000 [main] WARN  org.apache.pulsar.broker.intercept.BrokerInterceptorUtils - Pulsar broker interceptors directory not found
{"cmd":"import quiver_dataframe; quiver_dataframe.worker_main()","socket":"/tmp/786eff8bc09a4bf8a8c95e30b583363a","process":540,"logger":"dataframe_worker","level":"info","timestamp":"2023-12-06T21:54:26.077598Z","event":"dataframe_worker_started"}
{"process":540,"line":"starting","logger":"dataframe_worker","level":"info","timestamp":"2023-12-06T21:54:26.644076Z","event":"worker_process_log"}
{"process":540,"line":"logging config: /usr/local/lib/python3.11/site-packages/quiver_node/server/default.logging.ini","logger":"dataframe_worker","level":"info","timestamp":"2023-12-06T21:54:26.644214Z","event":"worker_process_log"}
{"process":540,"op_module":"gooddata_df_ops.ops.crosstab_op","logger":"dataframe_worker","timestamp":"2023-12-06T21:54:26.646486Z","level":"info","event":"load_operation"}
{"process":540,"location":"grpc+unix:///tmp/786eff8bc09a4bf8a8c95e30b583363a","logger":"dataframe_worker","timestamp":"2023-12-06T21:54:26.667976Z","level":"info","event":"worker_flight_rpc"}
{"socket":"/tmp/786eff8bc09a4bf8a8c95e30b583363a","process":540,"logger":"dataframe_worker","level":"info","timestamp":"2023-12-06T21:54:26.714674Z","event":"dataframe_worker_up"}
{"name":"flight-window-svc","affinity":"FLIGHT_PATH","submit_on_get":true,"submit_on_info":true,"logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.714866Z","event":"registering_service"}
{"name":"policy_report","affinity":null,"submit_on_get":false,"submit_on_info":true,"logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.715068Z","event":"registering_service"}
{"name":"dataframe-svc","affinity":null,"submit_on_get":false,"submit_on_info":true,"logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.715111Z","event":"registering_service"}
{"savefile":":memory:","logger":"quiver.single_node","level":"info","timestamp":"2023-12-06T21:54:26.715517Z","event":"single_node_start"}
{"node_name":"aio-node","node_type":"shard","cluster_id":"3e4d825b5aeb4a26851fa6e7f141ab0d","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.715670Z","event":"server_connected_to_cluster"}
{"host":"0.0.0.0","port":8877,"logger":"quiver.health_check_http_server","level":"info","timestamp":"2023-12-06T21:54:26.716757Z","event":"health_server_started"}
{"listen_url":"grpc://0.0.0.0:16001","client_url":"grpc://localhost:16001","peer_url":"grpc://e594edb8dd07:16001","tls":false,"logger":"quiver.flight.server","level":"info","timestamp":"2023-12-06T21:54:26.717669Z","event":"flight_service_start"}
BEWARE: server listens on address other than localhost and is not set up with token authentication
BEWARE: your server may be reachable from the public and is not set up with authentication
{"module":"CacheShardModule","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.718110Z","event":"module_start"}
{"check_interval":60.0,"check_deadline":5.0,"reinit_deadline":5.0,"critical_threshold":2,"logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.721043Z","event":"storage_monitor_started"}
{"config":{"memory":{"memory_cache_size":"256M","memory_cache_size_bytes":268435456},"disk":{"disk_dir":"/data/quiver_shard_dir","disk_cache_size":"2G","disk_cache_size_bytes":2147483648,"mmap_cache_size":"512M","mmap_cache_size_bytes":536870912},"storage_kicker_threads":3,"storage_placement_threads":4,"storage_durable_sync_threads":4,"storage_durable_init_threads":4,"storage_free_threads":32,"recycle_bin_cleanup_delay":15,"recycle_bin_tasks":3,"recycle_bin_batch_size":100,"cache_count_limit":null,"durable_check_interval":60.0,"durable_check_deadline":5.0,"durable_reinit_deadline":5.0,"durable_critical_threshold":2,"durable_s3_writes_in_progress":60},"logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.721392Z","event":"storage_started"}
{"module":"PolicyModule","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.721552Z","event":"module_start"}
{"flight_count_limit":null,"reporting_engines":["PointInTimeReporting"],"logger":"quiver.policy","level":"info","timestamp":"2023-12-06T21:54:26.722014Z","event":"policy_started"}
{"module":"DataframeModule","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.722063Z","event":"module_start"}
{"service_name":"dataframe-svc","operations":["crosstab","simple-sort"],"mem_limit_bytes":1073741824,"task_overhead_multiplier":2.0,"task_threads":2,"task_workers":1,"max_worker_failures":null,"worker_socket_dir":"/tmp","logger":"quiver.dataframe","level":"info","timestamp":"2023-12-06T21:54:26.722161Z","event":"dataframe_module_start"}
{"name":"aio-node","peer_url":"grpc://e594edb8dd07:16001","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.722575Z","event":"shard_up"}
{"logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.723354Z","event":"storage_service_initialized"}
{"storclas_id":"result_cache_non_durable","storclas_ver":"v1","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.723522Z","event":"storclas_version_added"}
{"storclas_id":"result_cache_non_durable","storclas_ver":"v1","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.723560Z","event":"storclas_version_activated"}
{"storclas_id":"result_cache_non_durable","state":"enabled","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.723586Z","event":"storclas_state_changed"}
{"storclas_id":"raw_cache_non_durable","storclas_ver":"v1","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.723642Z","event":"storclas_version_added"}
{"storclas_id":"raw_cache_non_durable","storclas_ver":"v1","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.723676Z","event":"storclas_version_activated"}
{"storclas_id":"raw_cache_non_durable","state":"enabled","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.723881Z","event":"storclas_state_changed"}
{"storclas_id":"result_cache","storclas_ver":"v1","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.724053Z","event":"storclas_version_added"}
{"storclas_id":"result_cache","storclas_ver":"v1","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.724103Z","event":"storclas_version_activated"}
{"storclas_id":"result_cache","state":"enabled","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.724130Z","event":"storclas_state_changed"}
{"storclas_id":"raw_cache","storclas_ver":"v1","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.724183Z","event":"storclas_version_added"}
{"storclas_id":"raw_cache","storclas_ver":"v1","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.724215Z","event":"storclas_version_activated"}
{"storclas_id":"raw_cache","state":"enabled","logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:54:26.724236Z","event":"storclas_state_changed"}
{"config":{"storage_config":{"memory":{"memory_cache_size":"256M","memory_cache_size_bytes":268435456},"disk":{"disk_dir":"/data/quiver_shard_dir","disk_cache_size":"2G","disk_cache_size_bytes":2147483648,"mmap_cache_size":"512M","mmap_cache_size_bytes":536870912},"storage_kicker_threads":3,"storage_placement_threads":4,"storage_durable_sync_threads":4,"storage_durable_init_threads":4,"storage_free_threads":32,"recycle_bin_cleanup_delay":15,"recycle_bin_tasks":3,"recycle_bin_batch_size":100,"cache_count_limit":null,"durable_check_interval":60.0,"durable_check_deadline":5.0,"durable_reinit_deadline":5.0,"durable_critical_threshold":2,"durable_s3_writes_in_progress":60},"replication_start_delay":5,"replication_threads":2,"concurrent_put_requests":20,"put_queue_size":256,"critical_storage_ids":[],"critical_storage_grace":60.0},"logger":"quiver.shard","level":"info","timestamp":"2023-12-06T21:54:26.726694Z","event":"shard_configured"}
{"node_name":"aio-node","state":"up","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.726820Z","event":"set_node_state"}
{"name":"aio-node","peer_url":"grpc://e594edb8dd07:16001","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:54:26.759188Z","event":"shard_up"}
Dec 06, 2023 9:54:26 PM org.glassfish.jersey.server.wadl.WadlFeature configure
WARNING: JAXBContext implementation could not be found. WADL feature is disabled.
Dec 06, 2023 9:54:27 PM org.glassfish.jersey.server.wadl.WadlFeature configure
WARNING: JAXBContext implementation could not be found. WADL feature is disabled.
Dec 06, 2023 9:54:27 PM org.glassfish.jersey.server.wadl.WadlFeature configure
WARNING: JAXBContext implementation could not be found. WADL feature is disabled.
Dec 06, 2023 9:54:27 PM org.glassfish.jersey.internal.Errors logErrors
WARNING: The following warnings have been detected: WARNING: Return type, java.util.Map<java.lang.String, ? extends org.apache.pulsar.common.policies.data.NamespaceIsolationData>, of method, public java.util.Map<java.lang.String, ? extends org.apache.pulsar.common.policies.data.NamespaceIsolationData> org.apache.pulsar.broker.admin.impl.ClustersBase.getNamespaceIsolationPolicies(java.lang.String) throws java.lang.Exception, is not resolvable to a concrete type.

Dec 06, 2023 9:54:27 PM org.glassfish.jersey.server.wadl.WadlFeature configure
WARNING: JAXBContext implementation could not be found. WADL feature is disabled.
Dec 06, 2023 9:54:27 PM org.glassfish.jersey.internal.Errors logErrors
WARNING: The following warnings have been detected: WARNING: Return type, java.util.Map<java.lang.String, ? extends org.apache.pulsar.common.policies.data.NamespaceIsolationData>, of method, public java.util.Map<java.lang.String, ? extends org.apache.pulsar.common.policies.data.NamespaceIsolationData> org.apache.pulsar.broker.admin.impl.ClustersBase.getNamespaceIsolationPolicies(java.lang.String) throws java.lang.Exception, is not resolvable to a concrete type.

Dec 06, 2023 9:54:28 PM org.glassfish.jersey.server.wadl.WadlFeature configure
WARNING: JAXBContext implementation could not be found. WADL feature is disabled.
Dec 06, 2023 9:54:28 PM org.glassfish.jersey.server.wadl.WadlFeature configure
WARNING: JAXBContext implementation could not be found. WADL feature is disabled.
Dec 06, 2023 9:54:28 PM org.glassfish.jersey.server.wadl.WadlFeature configure
WARNING: JAXBContext implementation could not be found. WADL feature is disabled.
Quiver: ready
s6-rc: info: service quiver successfully started
{"logger":"quiver.shard.replication","level":"info","timestamp":"2023-12-06T21:54:31.763131Z","event":"replication_started"}
2023-12-06T21:54:32,820+0000 [metadata-store-23-1] WARN  org.apache.bookkeeper.proto.checksum.CRC32CDigestManager - Sse42Crc32C is not supported, will use a slower CRC32C implementation.
2023-12-06T21:54:33,035+0000 [BookKeeperClientWorker-OrderedExecutor-1-0] WARN  com.scurrilous.circe.checksum.Crc32cIntChecksum - Failed to load Circe JNI library. Falling back to Java based CRC32c provider
Apache Pulsar: ready
s6-rc: info: service pulsar successfully started
s6-rc: info: service result-cache: starting
s6-rc: info: service metadata-api: starting
s6-rc: info: service cache-garbage-collector: starting
s6-rc: info: service auth-service: starting
s6-rc: info: service cache-garbage-collector successfully started
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.pulsar.common.util.netty.DnsResolverUtil (file:/opt/apache-pulsar/lib/org.apache.pulsar-pulsar-common-2.10.4.jar) to method sun.net.InetAddressCachePolicy.get()
WARNING: Please consider reporting this to the maintainers of org.apache.pulsar.common.util.netty.DnsResolverUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
2023-12-06T21:54:40,697+0000 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xe9c739c0, L:/127.0.0.1:60418 - R:localhost/127.0.0.1:6650]] Connected to server
   __    __  __  ____  _   _    ___  ____  ____  _  _  ____   ___  ____
  /__\  (  )(  )(_  _)( )_( )  / __)( ___)(  _ \( \/ )(_  _) / __)( ___)
 /(__)\  )(__)(   )(   ) _ (   \__ \ )__)  )   / \  /  _)(_ ( (__  )__)
(__)(__)(______) (__) (_) (_)  (___/(____)(_)\_)  \/  (____) \___)(____)
:: Spring Boot (v2.6.15) :: HTTP port = 9050/9051 :: PID: 763
:: Build from: b492c70   ::   2023-10-05 13:24:20+0000

______  _____  _____  _   _  _      _____   _____   ___   _____  _   _  _____
| ___ \|  ___|/  ___|| | | || |    |_   _| /  __ \ / _ \ /  __ \| | | ||  ___|
| |_/ /| |__  \ `--. | | | || |      | |   | /  \// /_\ \| /  \/| |_| || |__
|    / |  __|  `--. \| | | || |      | |   | |    |  _  || |    |  _  ||  __|
| |\ \ | |___ /\__/ /| |_| || |____  | |   | \__/\| | | || \__/\| | | || |___
\_| \_|\____/ \____/  \___/ \_____/  \_/    \____/\_| |_/ \____/\_| |_/\____/
:: Spring Boot (v2.6.15) :: HTTP port = 9040/9041 :: PID: 760
:: Build from: b492c70   ::   2023-10-05 13:24:20+0000

2023-12-06T21:54:41,161+0000 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Starting Pulsar producer perf with config: {"topicName":"persistent://public/default/caches.garbage-collect","producerName":null,"sendTimeoutMs":30000,"blockIfQueueFull":false,"maxPendingMessages":1000,"maxPendingMessagesAcrossPartitions":50000,"messageRoutingMode":"RoundRobinPartition","hashingScheme":"JavaStringHash","cryptoFailureAction":"FAIL","batchingMaxPublishDelayMicros":1000,"batchingPartitionSwitchFrequencyByPublishDelay":10,"batchingMaxMessages":1000,"batchingMaxBytes":131072,"batchingEnabled":true,"chunkingEnabled":false,"compressionType":"NONE","initialSequenceId":null,"autoUpdatePartitions":true,"autoUpdatePartitionsIntervalSeconds":60,"multiSchema":true,"accessMode":"Shared","lazyStartPartitionedProducers":false,"properties":{},"initialSubscriptionName":null}
2023-12-06T21:54:41,187+0000 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - Pulsar client config: {"serviceUrl":"pulsar://localhost:6650","authPluginClassName":null,"authParams":null,"authParamMap":null,"operationTimeoutMs":30000,"lookupTimeoutMs":30000,"statsIntervalSeconds":60,"numIoThreads":1,"numListenerThreads":1,"connectionsPerBroker":1,"useTcpNoDelay":true,"useTls":false,"tlsTrustCertsFilePath":"","tlsAllowInsecureConnection":false,"tlsHostnameVerificationEnable":false,"concurrentLookupRequest":5000,"maxLookupRequest":50000,"maxLookupRedirects":20,"maxNumberOfRejectedRequestPerConnection":50,"keepAliveIntervalSeconds":30,"connectionTimeoutMs":10000,"requestTimeoutMs":60000,"initialBackoffIntervalNanos":100000000,"maxBackoffIntervalNanos":60000000000,"enableBusyWait":false,"listenerName":null,"useKeyStoreTls":false,"sslProvider":null,"tlsTrustStoreType":"JKS","tlsTrustStorePath":"","tlsTrustStorePassword":"*****","tlsCiphers":[],"tlsProtocols":[],"memoryLimitBytes":0,"proxyServiceUrl":null,"proxyProtocol":null,"enableTransaction":false,"dnsLookupBindAddress":null,"dnsLookupBindPort":0,"socks5ProxyAddress":null,"socks5ProxyUsername":null,"socks5ProxyPassword":null}
______  ____________________________ ________ _______ _______________
___   |/  /___  ____/___  __/___    |___  __ \___    |___  __/___    |
__  /|_/ / __  __/   __  /   __  /| |__  / / /__  /| |__  /   __  /| |
_  /  / /  _  /___   _  /    _  ___ |_  /_/ / _  ___ |_  /    _  ___ |
/_/  /_/   /_____/   /_/     /_/  |_|/_____/  /_/  |_|/_/     /_/  |_|

:: Spring Boot (v2.6.15) :: HTTP port = 9007/9008 :: PID: 761
:: Build from: d46c33b   ::   2023-10-17 10:48:47+0000

2023-12-06T21:54:41,562+0000 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/default/caches.garbage-collect] [null] Creating producer on cnx [id: 0xe9c739c0, L:/127.0.0.1:60418 - R:localhost/127.0.0.1:6650]
2023-12-06T21:54:41,900+0000 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/default/caches.garbage-collect] [standalone-0-1] Created producer on cnx [id: 0xe9c739c0, L:/127.0.0.1:60418 - R:localhost/127.0.0.1:6650]
2023-12-06T21:54:42,068+0000 [pulsar-client-io-1-1] WARN  com.scurrilous.circe.checksum.Crc32cIntChecksum - Failed to load Circe JNI library. Falling back to Java based CRC32c provider
2023-12-06T21:54:42,148+0000 [main] INFO  org.apache.pulsar.client.impl.PulsarClientImpl - Client closing. URL: pulsar://localhost:6650
2023-12-06T21:54:42,165+0000 [main] INFO  org.apache.pulsar.client.impl.ProducerStatsRecorderImpl - [persistent://public/default/caches.garbage-collect] [standalone-0-1] Pending messages: 0 --- Publish throughput: 1.04 msg/s --- 0.00 Mbit/s --- Latency: med: 115.000 ms - 95pct: 115.000 ms - 99pct: 115.000 ms - 99.9pct: 115.000 ms - max: 115.000 ms --- BatchSize: med: 1.000 - 95pct: 1.000 - 99pct: 1.000 - 99.9pct: 1.000 - max: 1.000 --- MsgSize: med: 2.000 bytes - 95pct: 2.000 bytes - 99pct: 2.000 bytes - 99.9pct: 2.000 bytes - max: 2.000 bytes --- Ack received rate: 1.04 ack/s --- Failed messages: 0 --- Pending messages: 0
2023-12-06T21:54:42,178+0000 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ProducerImpl - [persistent://public/default/caches.garbage-collect] [standalone-0-1] Closed Producer
2023-12-06T21:54:42,189+0000 [pulsar-client-io-1-1] INFO  org.apache.pulsar.client.impl.ClientCnx - [id: 0xe9c739c0, L:/127.0.0.1:60418 ! R:localhost/127.0.0.1:6650] Disconnected
Auth. service: not ready
Result Cache: not ready
Metadata API: not ready
2023-12-06T21:54:44,245+0000 [main] INFO  org.apache.pulsar.client.cli.PulsarClientTool - 1 messages successfully produced
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.pulsar.common.util.netty.DnsResolverUtil (file:/opt/auth-service/BOOT-INF/lib/pulsar-common-2.10.4.jar) to method sun.net.InetAddressCachePolicy.get()
WARNING: Please consider reporting this to the maintainers of org.apache.pulsar.common.util.netty.DnsResolverUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.pulsar.common.util.netty.DnsResolverUtil (file:/opt/result-cache/BOOT-INF/lib/pulsar-common-2.10.4.jar) to method sun.net.InetAddressCachePolicy.get()
WARNING: Please consider reporting this to the maintainers of org.apache.pulsar.common.util.netty.DnsResolverUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Result Cache: not ready
Auth. service: not ready
Metadata API: not ready
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.pulsar.common.util.netty.DnsResolverUtil (file:/opt/metadata-api/BOOT-INF/lib/pulsar-common-2.10.4.jar) to method sun.net.InetAddressCachePolicy.get()
WARNING: Please consider reporting this to the maintainers of org.apache.pulsar.common.util.netty.DnsResolverUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
ts="2023-12-06 21:54:47.584" level=WARN msg="'spring.sleuth.propagation-keys' has been renamed to 'spring.sleuth.baggage.remote-fields' and will be removed in a future release." logger=org.springframework.cloud.sleuth.autoconfig.brave.BraveBaggageConfiguration thread=main
Result Cache: not ready
Auth. service: not ready
Metadata API: not ready
ts="2023-12-06 21:54:50.192" level=WARN msg="'spring.sleuth.propagation-keys' has been renamed to 'spring.sleuth.baggage.remote-fields' and will be removed in a future release." logger=org.springframework.cloud.sleuth.autoconfig.brave.BraveBaggageConfiguration thread=main
ts="2023-12-06 21:54:51.300" level=WARN msg="'spring.sleuth.propagation-keys' has been renamed to 'spring.sleuth.baggage.remote-fields' and will be removed in a future release." logger=org.springframework.cloud.sleuth.autoconfig.brave.BraveBaggageConfiguration thread=main
Result Cache: not ready
Metadata API: not ready
Auth. service: not ready
Result Cache: not ready
Metadata API: not ready
ts="2023-12-06 21:54:56.532" level=ERROR msg="Error during GRPC Healthcheck call" logger=com.gooddata.tiger.grpc.healthcheck.GrpcHealthCheck thread=boundedElastic-3 action=grpcHealthCheck spanId=d79798762c1a48b8 traceId=d79798762c1a48b8 exc="io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
	at io.grpc.Status.asRuntimeException(Status.java:535)
	at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:487)
	at brave.grpc.TracingClientInterceptor$TracingClientCallListener.onClose(TracingClientInterceptor.java:202)
	at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
	at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
	at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
	at io.micrometer.core.instrument.binder.grpc.MetricCollectingClientCallListener.onClose(MetricCollectingClientCallListener.java:57)
	at io.grpc.internal.DelayedClientCall$DelayedListener$3.run(DelayedClientCall.java:468)
	at io.grpc.internal.DelayedClientCall$DelayedListener.delayOrExecute(DelayedClientCall.java:432)
	at io.grpc.internal.DelayedClientCall$DelayedListener.onClose(DelayedClientCall.java:465)
	at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:562)
	at io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:70)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:743)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:722)
	at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:6572
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:777)
	at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337)
	at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:829)
"
Auth. service: not ready
ts="2023-12-06 21:54:56.882" level=WARN msg="Failed to load Circe JNI library. Falling back to Java based CRC32c provider" logger=com.scurrilous.circe.checksum.Crc32cIntChecksum thread=main
Metadata API: not ready
ts="2023-12-06 21:54:59.465" level=ERROR msg="Error during GRPC Healthcheck call" logger=com.gooddata.tiger.grpc.healthcheck.GrpcHealthCheck thread=boundedElastic-3 action=grpcHealthCheck spanId=fd089f742000a36f traceId=fd089f742000a36f exc="io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
	at io.grpc.Status.asRuntimeException(Status.java:535)
	at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:487)
	at brave.grpc.TracingClientInterceptor$TracingClientCallListener.onClose(TracingClientInterceptor.java:202)
	at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
	at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
	at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
	at io.micrometer.core.instrument.binder.grpc.MetricCollectingClientCallListener.onClose(MetricCollectingClientCallListener.java:57)
	at io.grpc.internal.DelayedClientCall$DelayedListener$3.run(DelayedClientCall.java:468)
	at io.grpc.internal.DelayedClientCall$DelayedListener.delayOrExecute(DelayedClientCall.java:432)
	at io.grpc.internal.DelayedClientCall$DelayedListener.onClose(DelayedClientCall.java:465)
	at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:562)
	at io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:70)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:743)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:722)
	at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:6572
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:777)
	at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337)
	at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:829)
"
ts="2023-12-06 21:54:59.605" level=ERROR msg="Error during GRPC Healthcheck call" logger=com.gooddata.tiger.grpc.healthcheck.GrpcHealthCheck thread=boundedElastic-4 action=grpcHealthCheck spanId=42613ee5a9744bbb traceId=42613ee5a9744bbb exc="io.grpc.StatusRuntimeException: UNAVAILABLE: io exception
	at io.grpc.Status.asRuntimeException(Status.java:535)
	at io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:487)
	at brave.grpc.TracingClientInterceptor$TracingClientCallListener.onClose(TracingClientInterceptor.java:202)
	at io.grpc.PartialForwardingClientCallListener.onClose(PartialForwardingClientCallListener.java:39)
	at io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:23)
	at io.grpc.ForwardingClientCallListener$SimpleForwardingClientCallListener.onClose(ForwardingClientCallListener.java:40)
	at io.micrometer.core.instrument.binder.grpc.MetricCollectingClientCallListener.onClose(MetricCollectingClientCallListener.java:57)
	at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:562)
	at io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:70)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInternal(ClientCallImpl.java:743)
	at io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:722)
	at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)
	at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:6572
Caused by: java.net.ConnectException: Connection refused
	at java.base/sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
	at java.base/sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:777)
	at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337)
	at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	at java.base/java.lang.Thread.run(Thread.java:829)
"
Auth. service: not ready
Result Cache: not ready
Database is up to date, no changesets to execute

UPDATE SUMMARY
Run:                          0
Previously run:             114
Filtered out:                 0
-------------------------------
Total change sets:          114

ts="2023-12-06 21:55:01.817" level=WARN msg="Failed to load Circe JNI library. Falling back to Java based CRC32c provider" logger=com.scurrilous.circe.checksum.Crc32cIntChecksum thread=main
ts="2023-12-06 21:55:01.835" level=WARN msg="Pulsar message doesn't contain AuthContext" logger=com.gooddata.tiger.pulsar.consumer.PulsarListener thread=pulsar-external-listener-3-1 action=pulsarReceiveMessage
{"result":"success","duration":0.0029686670750379562,"waited":0.001835542032495141,"sync_duration":null,"sync_forced":null,"parent_span_id":"8e8df1550c258fd9","rq_action":"_list-limit-policies","rq_id":"e5f9fbd5e7714ba087958a39b6402a24","rq_method":"DO_ACTION","trace_id":"8e8df1550c258fd9","span_id":"b4fd003663c2d2b2","logger":"quiver.flight.request","level":"info","timestamp":"2023-12-06T21:55:01.910633Z","event":"flight_rpc_finished"}
{"result":"success","duration":0.0011175839463248849,"waited":0.00023887492716312408,"sync_duration":null,"sync_forced":null,"parent_span_id":"8e8df1550c258fd9","rq_action":"_upsert-limit-policy","rq_id":"f76eb32f73664f6c85a73cc1ff4cb4ad","rq_method":"DO_ACTION","trace_id":"8e8df1550c258fd9","span_id":"cb7bdea6764625dc","logger":"quiver.flight.request","level":"info","timestamp":"2023-12-06T21:55:01.939710Z","event":"flight_rpc_finished"}
{"cached_amount":null,"total_amount":null,"policy_type":"HierarchicalLimitPolicyConfig","policy_id":"default","logger":"quiver.policy.limit","level":"info","timestamp":"2023-12-06T21:55:01.941161Z","event":"policy_changed"}
Result Cache: ready
s6-rc: info: service result-cache successfully started
Auth. service: ready
s6-rc: info: service auth-service successfully started
Metadata API: ready
Metadata API: ready
s6-rc: info: service metadata-api successfully started
s6-rc: info: service bootstrap-org: starting
s6-rc: info: service sql-executor: starting
s6-rc: info: service calcique: starting
+ : 3000
+ : localhost
+ H_JSON='Content-type: application/json'
+ H_GDC_JSON='Content-type: application/vnd.gooddata.api+json'
+ FAKE_HOST='X-Forwarded-Host: localhost:3000'
+ DEFINITION_FILE=
+ METADATA_HOST=localhost
+ METADATA_ACTUATOR_PORT=9008
+ METADATA_GRPC_PORT=6572
+ METADATA_HTTP_PORT=9007
+ AUTH_SERVICE_HOST=localhost
+ AUTH_SERVICE_ACTUATOR_PORT=9051
+ AUTH_SERVICE_HTTP_PORT=9050
+ GRPC_PASSWORD=SuperSecretPassword
+ TOKEN_SECRET=admin123
+ getopts f:m:p:g:j:a:q:r:w:U:P:T: o
+ case "${o}" in
+ DEFINITION_FILE=/opt/bootstrap/bootstrap.json
+ getopts f:m:p:g:j:a:q:r:w:U:P:T: o
+ case "${o}" in
+ USERNAME=demo@example.com
+ getopts f:m:p:g:j:a:q:r:w:U:P:T: o
+ case "${o}" in
+ PASSWORD=demo123
+ getopts f:m:p:g:j:a:q:r:w:U:P:T: o
+ case "${o}" in
+ TOKEN_SECRET=admin123
+ getopts f:m:p:g:j:a:q:r:w:U:P:T: o
+ shift 8
+ '[' -z /opt/bootstrap/bootstrap.json ']'
+ curl --output /dev/null -fs http://localhost:9008/actuator/health/readiness
++ printf bootstrap:%s SuperSecretPassword
++ base64
++ tr -d '\n'
+ AUTHORIZATION=Ym9vdHN0cmFwOlN1cGVyU2VjcmV0UGFzc3dvcmQ=
++ echo -n admin:bootstrap:admin123
++ base64
+ BOOTSTRAP_TOKEN=YWRtaW46Ym9vdHN0cmFwOmFkbWluMTIz
++ python3 -c 'import crypt; print(crypt.crypt('\''admin123'\'', crypt.mksalt(crypt.METHOD_SHA256)))'
<string>:1: DeprecationWarning: 'crypt' is deprecated and slated for removal in Python 3.13
+ TOKEN_HASH='$5$Vdu4tjvxMlm0A3/T$30MN.6YYeEbbiMtg6TTpxxyiYzPUkvYT9c6fKMJajf/'
+ jq '.organizations[0].hostname="localhost" |
    .organizations[0].initialToken.cryptedToken="$5$Vdu4tjvxMlm0A3/T$30MN.6YYeEbbiMtg6TTpxxyiYzPUkvYT9c6fKMJajf/"' /opt/bootstrap/bootstrap.json
+ grpcurl -H 'Authorization: Basic Ym9vdHN0cmFwOlN1cGVyU2VjcmV0UGFzc3dvcmQ=' -plaintext -d @ localhost:6572 tiger.MetadataStorePrivilegedService/ensureOrganizationsExists
{
  
}
+ '[' -z demo@example.com ']'
+ '[' -z demo123 ']'
+ curl --output /dev/null -fs http://localhost:9051/actuator/health/readiness
+ set +e
++ get_dex_user demo@example.com YWRtaW46Ym9vdHN0cmFwOmFkbWluMTIz http://localhost:9050
++ email=demo@example.com
++ token=YWRtaW46Ym9vdHN0cmFwOmFkbWluMTIz
++ api_host=http://localhost:9050
++ jq .authenticationId -r
++ curl -fs -X GET -H 'Content-type: application/json' -H 'X-Forwarded-Host: localhost:3000' -H 'Authorization: Bearer YWRtaW46Ym9vdHN0cmFwOmFkbWluMTIz' http://localhost:9050/api/v1/auth/users/demo@example.com
+ auth_id=
+ set -e
++ make_dex_user demo@example.com demo123 'Demo User' YWRtaW46Ym9vdHN0cmFwOmFkbWluMTIz http://localhost:9050
++ email=demo@example.com
++ password=demo123
++ dn='Demo User'
++ token=YWRtaW46Ym9vdHN0cmFwOmFkbWluMTIz
++ api_host=http://localhost:9050
++ curl -fs -X POST -H 'Content-type: application/json' -H 'X-Forwarded-Host: localhost:3000' -d '{"email": "demo@example.com","password": "demo123","displayName": "Demo User"}' -H 'Authorization: Bearer YWRtaW46Ym9vdHN0cmFwOmFkbWluMTIz' http://localhost:9050/api/v1/auth/users
++ jq .authenticationId -r
+ auth_id=
s6-rc: warning: unable to start service bootstrap-org: command exited 22
 ____  ____  _     ____  _  ____  _     _____
/   _\/  _ \/ \   /   _\/ \/  _ \/ \ /\/  __/
|  /  | / \|| |   |  /  | || / \|| | |||  \
|  \__| |-||| |_/\|  \_ | || \_\|| \_/||  /_
\____/\_/ \|\____/\____/\_/\____\\____/\____\

:: Spring Boot (v2.6.15) :: HTTP port = 9011/9012 :: PID: 1326
:: Build from: b492c70   ::   2023-10-05 13:24:20+0000

 (              (                   )                                     )    (
 )\ )     (     )\ )             ( /(           (              *   )   ( /(    )\ )
 (()/(   ( )\   (()/(       (     )\())  (       )\       (   ` )  /(   )\())  (()/(
 /(_))  )((_)   /(_))      (\   ((_)\   )\    ((_)      )\   ( )(_))    ((_)\  /(_))
  (_))   ((_)_   (_))       ((_)  __((_) ((_)   )\___  _ ((_) (_(_())   ((_)   (_))
 / __|   / _ \  | |        | __| \ \/ / | __|   / __| | | | | |_   _|   / _ \  | _ \
 \__ \  | (_) | | |__      | _|   >  <  | _|   | (__  | |_| |   | |    | (_) | |   /
 |___/   \__\_\ |____|     |___| /_/\_\ |___|   \___|  \___/    |_|     \___/  |_|_\
 :: Spring Boot (v2.6.15) :: HTTP port = 9100/9101 :: PID: 1325
 :: Build from: b492c70   ::   2023-10-05 13:24:20+0000

WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.pulsar.common.util.netty.DnsResolverUtil (file:/opt/calcique/BOOT-INF/lib/pulsar-common-2.10.4.jar) to method sun.net.InetAddressCachePolicy.get()
WARNING: Please consider reporting this to the maintainers of org.apache.pulsar.common.util.netty.DnsResolverUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.pulsar.common.util.netty.DnsResolverUtil (file:/opt/sql-executor/BOOT-INF/lib/pulsar-common-2.10.4.jar) to method sun.net.InetAddressCachePolicy.get()
WARNING: Please consider reporting this to the maintainers of org.apache.pulsar.common.util.netty.DnsResolverUtil
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
Calcique: not ready
SQL Executor: not ready
ts="2023-12-06 21:55:12.417" level=WARN msg="'spring.sleuth.propagation-keys' has been renamed to 'spring.sleuth.baggage.remote-fields' and will be removed in a future release." logger=org.springframework.cloud.sleuth.autoconfig.brave.BraveBaggageConfiguration thread=main
ts="2023-12-06 21:55:12.602" level=WARN msg="'spring.sleuth.propagation-keys' has been renamed to 'spring.sleuth.baggage.remote-fields' and will be removed in a future release." logger=org.springframework.cloud.sleuth.autoconfig.brave.BraveBaggageConfiguration thread=main
Calcique: not ready
SQL Executor: not ready
ts="2023-12-06 21:55:16.239" level=WARN msg="Unable to patch Guava classes: [source error] addCallback(com.google.common.util.concurrent.ListenableFuture,com.google.common.util.concurrent.FutureCallback,java.util.concurrent.Executor) not found in oadd.com.google.common.util.concurrent.Futures" logger=oadd.org.apache.drill.common.util.GuavaPatcher thread=main
Database is up to date, no changesets to execute

UPDATE SUMMARY
Run:                          0
Previously run:               4
Filtered out:                 0
-------------------------------
Total change sets:            4

SQL Executor: ready
Calcique: ready
Calcique: ready
s6-rc: info: service calcique successfully started
SQL Executor: ready
s6-rc: info: service sql-executor successfully started
s6-rc: info: service scan-model: starting
  _____                 __  __           _      _
 / ____|               |  \/  |         | |    | |
| (___   ___ __ _ _ __ | \  / | ___   __| | ___| |
 \___ \ / __/ _` | '_ \| |\/| |/ _ \ / _` |/ _ \ |
 ____) | (_| (_| | | | | |  | | (_) | (_| |  __/ |
|_____/ \___\__,_|_| |_|_|  |_|\___/ \__,_|\___|_|

:: Spring Boot (v2.6.15) :: HTTP port = 9060/9061 :: PID: 1646
:: Build from: b492c70 :: 2023-10-05 13:24:20+0000

ts="2023-12-06 21:55:24.229" level=WARN msg="'spring.sleuth.propagation-keys' has been renamed to 'spring.sleuth.baggage.remote-fields' and will be removed in a future release." logger=org.springframework.cloud.sleuth.autoconfig.brave.BraveBaggageConfiguration thread=main
Scan Model: ready
Scan Model: ready
s6-rc: info: service scan-model successfully started
/run/s6/basedir/scripts/rc.init: warning: s6-rc failed to properly bring all the services up! Check your logs (in /run/uncaught-logs/current if you have in-container logging) for more information.
/run/s6/basedir/scripts/rc.init: fatal: stopping the container.
s6-rc: info: service init-demo-data: stopping
s6-rc: info: service quiver: stopping
s6-rc: info: service scan-model: stopping
s6-rc: info: service goss: stopping
s6-rc: info: service cache-garbage-collector: stopping
s6-rc: info: service auth-service: stopping
s6-rc: info: service calcique: stopping
s6-rc: info: service cache-garbage-collector successfully stopped
s6-rc: info: service goss successfully stopped
s6-rc: info: service init-demo-data successfully stopped
{"logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:55:30.847667Z","event":"server_shutdown_initiated"}
{"node_name":"aio-node","state":"stopping","logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:55:30.854387Z","event":"set_node_state"}
{"logger":"quiver.flight.server","level":"info","timestamp":"2023-12-06T21:55:30.858475Z","event":"flight_service_shutdown"}
{"logger":"quiver.flight.server","level":"info","timestamp":"2023-12-06T21:55:30.867471Z","event":"flight_service_finished"}
{"logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:55:30.868562Z","event":"storage_io_shutdown"}
{"logger":"quiver.storage","level":"info","timestamp":"2023-12-06T21:55:30.869072Z","event":"wait_for_durable_data_sync"}
{"logger":"quiver.shard.replication","level":"info","timestamp":"2023-12-06T21:55:31.862983Z","event":"replication_shutdown"}
{"pending_tasks":0,"logger":"quiver.dataframe.service","level":"info","timestamp":"2023-12-06T21:55:32.382603Z","event":"dataframe_service_stopping"}
{"process_id":540,"logger":"dataframe_worker","level":"info","timestamp":"2023-12-06T21:55:32.383209Z","event":"dataframe_worker_stopping"}
{"process":540,"rc":null,"logger":"dataframe_worker","level":"info","timestamp":"2023-12-06T21:55:32.391195Z","event":"worker_finished"}
{"logger":"dataframe_worker","level":"info","timestamp":"2023-12-06T21:55:32.392151Z","event":"dataframe_worker_pool_stopped"}
{"logger":"quiver.server","level":"info","timestamp":"2023-12-06T21:55:32.395373Z","event":"server_main_finished"}
s6-rc: info: service quiver successfully stopped
s6-rc: info: service scan-model successfully stopped
s6-rc: info: service sql-executor: stopping
s6-rc: info: service auth-service successfully stopped
s6-rc: info: service dex: stopping
s6-rc: info: service dex successfully stopped
s6-rc: info: service calcique successfully stopped
s6-rc: info: service sql-executor successfully stopped
s6-rc: info: service result-cache: stopping
s6-rc: info: service metadata-api: stopping
s6-rc: info: service metadata-api successfully stopped
s6-rc: info: service postgres: stopping
2023-12-06 21:55:42.857 UTC [132] LOG:  received fast shutdown request
2023-12-06 21:55:42.859 UTC [132] LOG:  aborting any active transactions
2023-12-06 21:55:42.861 UTC [132] LOG:  background worker "logical replication launcher" (PID 183) exited with exit code 1
2023-12-06 21:55:42.862 UTC [175] LOG:  shutting down
2023-12-06 21:55:42.885 UTC [132] LOG:  database system is shut down
s6-rc: info: service postgres successfully stopped
s6-rc: info: service result-cache successfully stopped
s6-rc: info: service redis: stopping
s6-rc: info: service pulsar: stopping
130:signal-handler (1701899742) Received SIGTERM scheduling shutdown...
130:M 06 Dec 2023 21:55:42.994 # User requested shutdown...
130:M 06 Dec 2023 21:55:42.994 # Redis is now ready to exit, bye bye...
s6-rc: info: service redis successfully stopped
2023-12-06T21:55:43,164+0000 [broker-client-shared-internal-executor-19-1] ERROR org.apache.pulsar.broker.service.SystemTopicBasedTopicPoliciesService - Read more topic policies exception, close the read now!
java.util.concurrent.CompletionException: org.apache.pulsar.client.api.PulsarClientException$AlreadyClosedException: The consumer which subscribes the topic persistent://public/default/__change_events with subscription name reader-b6c4e9b371 was already closed when cleaning and closing the consumers
	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:331) ~[?:?]
	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:346) ~[?:?]
	at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:632) ~[?:?]
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506) ~[?:?]
	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2088) ~[?:?]
	at org.apache.pulsar.client.impl.ConsumerBase.failPendingReceives(ConsumerBase.java:274) ~[org.apache.pulsar-pulsar-client-original-2.10.4.jar:2.10.4]
	at org.apache.pulsar.client.impl.ConsumerBase.lambda$failPendingReceive$1(ConsumerBase.java:257) ~[org.apache.pulsar-pulsar-client-original-2.10.4.jar:2.10.4]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
Caused by: org.apache.pulsar.client.api.PulsarClientException$AlreadyClosedException: The consumer which subscribes the topic persistent://public/default/__change_events with subscription name reader-b6c4e9b371 was already closed when cleaning and closing the consumers
	at org.apache.pulsar.client.impl.ConsumerBase.failPendingReceives(ConsumerBase.java:276) ~[org.apache.pulsar-pulsar-client-original-2.10.4.jar:2.10.4]
	... 5 more
2023-12-06T21:55:45,650+0000 [metadata-store-zk-session-watcher-24-1] ERROR org.apache.pulsar.metadata.impl.ZKSessionWatcher - ZooKeeper session expired
2023-12-06T21:55:45,651+0000 [metadata-store-zk-session-watcher-24-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@3161b587[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@5938330e[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@4839ca64]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@2ffd611d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.handleSessionEvent(LockManagerImpl.java:122) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:134) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkConnectionStatus(ZKSessionWatcher.java:110) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.common.util.Runnables$CatchingAndLoggingRunnable.run(Runnables.java:54) ~[org.apache.pulsar-pulsar-common-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,652+0000 [metadata-store-zk-session-watcher-24-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@d5847f6[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@374597af[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@31a901c9]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@49e93ac9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.handleSessionEvent(LockManagerImpl.java:122) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:134) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkConnectionStatus(ZKSessionWatcher.java:110) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.common.util.Runnables$CatchingAndLoggingRunnable.run(Runnables.java:54) ~[org.apache.pulsar-pulsar-common-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,652+0000 [metadata-store-zk-session-watcher-24-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@64fc550e[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@528a24b4[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@2b54d065]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@49e93ac9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.handleSessionEvent(LockManagerImpl.java:122) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:134) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkConnectionStatus(ZKSessionWatcher.java:110) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.common.util.Runnables$CatchingAndLoggingRunnable.run(Runnables.java:54) ~[org.apache.pulsar-pulsar-common-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,652+0000 [metadata-store-zk-session-watcher-24-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@6a3500e2[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@64c3142a[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@67ef3382]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@6ce76c8f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.handleSessionEvent(LockManagerImpl.java:122) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:134) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkConnectionStatus(ZKSessionWatcher.java:110) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.common.util.Runnables$CatchingAndLoggingRunnable.run(Runnables.java:54) ~[org.apache.pulsar-pulsar-common-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,653+0000 [metadata-store-zk-session-watcher-24-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@1bb0a8e4[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@e1415c3[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@4c6426f3]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@49e93ac9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LeaderElectionImpl.handleSessionNotification(LeaderElectionImpl.java:282) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:134) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkConnectionStatus(ZKSessionWatcher.java:110) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.common.util.Runnables$CatchingAndLoggingRunnable.run(Runnables.java:54) ~[org.apache.pulsar-pulsar-common-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,653+0000 [metadata-store-23-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@434a0d50[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@1e8de9a[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@3edd36c0]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@2ffd611d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.handleSessionEvent(LockManagerImpl.java:122) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:167) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.process(ZKSessionWatcher.java:121) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$new$0(ZKMetadataStore.java:101) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,654+0000 [metadata-store-23-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@4b089855[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@5b6fcfcc[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@1cb4c635]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@49e93ac9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.handleSessionEvent(LockManagerImpl.java:122) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:167) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.process(ZKSessionWatcher.java:121) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$new$0(ZKMetadataStore.java:101) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,654+0000 [metadata-store-23-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@47b06d67[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@583b2ce9[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@7d8f898d]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@49e93ac9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.handleSessionEvent(LockManagerImpl.java:122) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:167) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.process(ZKSessionWatcher.java:121) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$new$0(ZKMetadataStore.java:101) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,654+0000 [metadata-store-23-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@486a953e[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@48f58ff4[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@49a8be67]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@6ce76c8f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LockManagerImpl.handleSessionEvent(LockManagerImpl.java:122) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:167) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.process(ZKSessionWatcher.java:121) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$new$0(ZKMetadataStore.java:101) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,654+0000 [metadata-store-23-1] WARN  org.apache.pulsar.metadata.impl.AbstractMetadataStore - Error in processing session event
java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask@64cc76b6[Not completed, task = java.util.concurrent.Executors$RunnableAdapter@cf51201[Wrapped task = org.apache.bookkeeper.common.util.SafeRunnable$1@689bb644]] rejected from java.util.concurrent.ScheduledThreadPoolExecutor@49e93ac9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0]
	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2055) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:825) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:340) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.schedule(ScheduledThreadPoolExecutor.java:562) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor.execute(ScheduledThreadPoolExecutor.java:705) ~[?:?]
	at java.util.concurrent.Executors$DelegatedExecutorService.execute(Executors.java:687) ~[?:?]
	at org.apache.pulsar.metadata.coordination.impl.LeaderElectionImpl.handleSessionNotification(LeaderElectionImpl.java:282) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.lambda$receivedSessionEvent$11(AbstractMetadataStore.java:298) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.CopyOnWriteArrayList.forEach(CopyOnWriteArrayList.java:807) ~[?:?]
	at org.apache.pulsar.metadata.impl.AbstractMetadataStore.receivedSessionEvent(AbstractMetadataStore.java:296) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.receivedSessionEvent(ZKMetadataStore.java:152) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.checkState(ZKSessionWatcher.java:167) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKSessionWatcher.process(ZKSessionWatcher.java:121) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$new$0(ZKMetadataStore.java:101) ~[org.apache.pulsar-pulsar-metadata-2.10.4.jar:2.10.4]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[io.netty-netty-common-4.1.87.Final.jar:4.1.87.Final]
	at java.lang.Thread.run(Thread.java:829) ~[?:?]
2023-12-06T21:55:45,656+0000 [metadata-store-23-1] ERROR org.apache.pulsar.metadata.impl.ZKMetadataStore - Failed to recreate persistent watch on ZooKeeper: SESSIONEXPIRED
s6-rc: info: service pulsar successfully stopped
s6-rc: info: service init-data: stopping
s6-rc: info: service init-data successfully stopped
s6-rc: info: service legacy-cont-init: stopping
s6-rc: info: service legacy-cont-init successfully stopped
s6-rc: info: service fix-attrs: stopping
s6-rc: info: service fix-attrs successfully stopped
s6-rc: info: service s6rc-oneshot-runner: stopping
s6-rc: info: service s6rc-oneshot-runner successfully stopped