W0111 12:32:08.877314   21412 azure.go:92] WARNING: the azure auth plugin is deprecated in v1.22+, unavailable in v1.26+; use https://github.com/Azure/kubelogin instead.
To learn more, consult https://kubernetes.io/docs/reference/access-authn-authz/authentication/#client-go-credential-plugins
[2023-01-10 12:34:20 +0000] [1] [INFO] Starting gunicorn 20.1.0
[2023-01-10 12:34:20 +0000] [1] [INFO] Listening at: http://0.0.0.0:7000 (1)
[2023-01-10 12:34:20 +0000] [1] [INFO] Using worker: uvicorn.workers.UvicornWorker
[2023-01-10 12:34:20 +0000] [7] [INFO] Booting worker with pid: 7
←[32m2023-01-10T12:34:21.072072+0000←[0m | 7 | ←[34mopal_common.fetcher.fetcher_register    ←[0m|←[1m INFO  | Loading FetcherProvider 'FastApiRpcFetchProvider' found at: <class 'opal_common.fetcher.providers.fastapi_rpc_fetch_provider.FastApiRpcFetchProvider'>←[0m
←[32m2023-01-10T12:34:21.072285+0000←[0m | 7 | ←[34mopal_common.fetcher.fetcher_register    ←[0m|←[1m INFO  | Loading FetcherProvider 'HttpFetchProvider' found at: <class 'opal_common.fetcher.providers.http_fetch_provider.HttpFetchProvider'>←[0m
←[32m2023-01-10T12:34:21.072371+0000←[0m | 7 | ←[34mopal_common.fetcher.fetcher_register    ←[0m|←[1m INFO  | Fetcher Register loaded←[0m
←[32m2023-01-10T12:34:21.072593+0000←[0m | 7 | ←[34mopal_client.callbacks.register          ←[0m|←[1m INFO  | Callbacks register loaded←[0m
←[32m2023-01-10T12:34:21.072790+0000←[0m | 7 | ←[34mopal_client.client                      ←[0m|←[1m INFO  | API authentication disabled (public encryption key was not provided)←[0m
←[32m2023-01-10T12:34:21.100402+0000←[0m | 7 | ←[34mopal_client.opa.runner                  ←[0m|←[1m INFO  | Launching opa runner←[0m
←[32m2023-01-10T12:34:21.100900+0000←[0m | 7 | ←[34mopal_client.opa.runner                  ←[0m|←[1m INFO  | Running OPA inline: opa run --server --addr=:8181 --authentication=off --authorization=off --log-level=info←[0m
←[32m2023-01-10T12:34:21.114836+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Initializing server. ←[38;2;191;191;191m{"addrs": [":8181"], "diagnostic-addrs": [], "time": "2023-01-10T12:34:21Z"}←[0m←[1m←[0m
←[32m2023-01-10T12:34:21.616648+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T12:34:21Z"}←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.103868+0000←[0m | 7 | ←[34mopal_client.opa.runner                  ←[0m|←[1m INFO  | Running OPA initial start callbacks←[0m
←[32m2023-01-10T12:34:22.104213+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Launching data updater←[0m
←[32m2023-01-10T12:34:22.104353+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Launching policy updater←[0m
←[32m2023-01-10T12:34:22.104444+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Subscribing to topics: ['policy_data']←[0m
←[32m2023-01-10T12:34:22.104643+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Subscribing to topics: ['policy:.']←[0m
←[32m2023-01-10T12:34:22.104845+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Trying to connect to Pub/Sub server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T12:34:22.105116+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T12:34:22.106554+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Trying to connect to Pub/Sub server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T12:34:22.106696+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T12:34:22.117723+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Connected to server←[0m
←[32m2023-01-10T12:34:22.117873+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (full bundle)←[0m
←[32m2023-01-10T12:34:22.118119+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T12:34:22.120643+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Connected to server←[0m
←[32m2023-01-10T12:34:22.120720+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Performing data configuration, reason: Initial load←[0m
←[32m2023-01-10T12:34:22.120779+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Getting data-sources configuration from 'http://opal-server-loadbalancer:7002/data/config'←[0m
←[32m2023-01-10T12:34:22.123750+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Triggering data update with id: 2131ebc0ecb642d296764f1605e408bf←[0m
←[32m2023-01-10T12:34:22.123857+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Fetching policy data←[0m
←[32m2023-01-10T12:34:22.123957+0000←[0m | 7 | ←[34mopal_client.data.fetcher                ←[0m|←[1m INFO  | Fetching data from url: https://9027-183-83-252-7.in.ngrok.io/policy-data←[0m
←[32m2023-01-10T12:34:22.126193+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Connected to PubSub server ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T12:34:22.126659+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: ea992ea47f3f25c5f667336aa868482d7b567c6e←[0m
←[32m2023-01-10T12:34:22.126846+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Got policy bundle with 2 rego files, 1 data files, commit hash: 'ea992ea47f3f25c5f667336aa868482d7b567c6e'←[0m
←[32m2023-01-10T12:34:22.129015+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/policies←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.129198+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/policies -> 200←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.130360+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.130832+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data -> 204←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.131781+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/utils.rego←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.132793+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/utils.rego -> 200←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.133787+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/rbac.rego←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.135945+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/rbac.rego -> 200←[0m←[1m←[0m
←[32m2023-01-10T12:34:22.136447+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Connected to PubSub server ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T12:34:22.752129+0000←[0m | 7 | ←[34masyncio.runners                         ←[0m|←[31m←[1mERROR  | Task exception was never retrieved
future: <Task finished name='Task-51' coro=<DataUpdater.update_policy_data() done, defined at /usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/data/updater.py:305> exception=ContentTypeError(RequestInfo(url=URL('https://9027-183-83-252-7.in.ngrok.io/policy-data'), method='GET', headers=<CIMultiDictProxy('Host': '9027-183-83-252-7.in.ngrok.io', 'Accept': '*/*', 'Accept-Encoding': 'gzip, deflate', 'User-Agent': 'Python/3.10 aiohttp/3.8.3')>, real_url=URL('https://9027-183-83-252-7.in.ngrok.io/policy-data')), (), message='Attempt to decode JSON with unexpected mimetype: text/html', headers=<CIMultiDictProxy('Connection': 'close', 'Content-Type': 'text/html', 'Ngrok-Error-Code': 'ERR_NGROK_3200', 'Ngrok-Trace-Id': '2ad83e12ce3501b6e1f72903beb53d93', 'Referrer-Policy': 'no-referrer', 'Date': 'Tue, 10 Jan 2023 12:34:22 GMT', 'Content-Length': '903')>)>←[0m
←[33m←[1mTraceback (most recent call last):←[0m

> File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/data/updater.py", line 358, in update_policy_data
    error_content = await result.json()
                          │      └ <function ClientResponse.json at 0x7f834ab97f40>
                          └ <ClientResponse(https://9027-183-83-252-7.in.ngrok.io/policy-data) [404 Not Found]>
                            <CIMultiDictProxy('Connection': 'close', ...
  File "/usr/local/lib/python3.10/site-packages/aiohttp/client_reqrep.py", line 1104, in json
    raise ContentTypeError(
          └ <class 'aiohttp.client_exceptions.ContentTypeError'>

←[31m←[1maiohttp.client_exceptions.ContentTypeError←[0m:←[1m 0, message='Attempt to decode JSON with unexpected mimetype: text/html', url=URL('https://9027-183-83-252-7.in.ngrok.io/policy-data')←[0m
←[32m2023-01-10T12:34:54.018056+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /←[0m←[1m←[0m
←[32m2023-01-10T12:34:54.018588+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET / -> 200←[0m←[1m←[0m
←[32m2023-01-10T12:35:01.966062+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-10T12:35:01.966767+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-10T12:35:37.856543+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data/users←[0m←[1m←[0m
←[32m2023-01-10T12:35:37.857156+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data/users -> 200←[0m←[1m←[0m
←[32m2023-01-10T12:35:45.360718+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-10T12:35:45.361089+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-10T12:36:27.555889+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-10T12:36:27.556152+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'ea992ea47f3f25c5f667336aa868482d7b567c6e', 'new_policy_hash': '68278257032602d91bcaee36dadb50bf02d8001b', 'changed_directories': ['.']}←[0m
←[32m2023-01-10T12:36:27.556246+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: 'ea992ea47f3f25c5f667336aa868482d7b567c6e'←[0m
←[32m2023-01-10T12:36:27.556464+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T12:36:27.578295+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 68278257032602d91bcaee36dadb50bf02d8001b←[0m
←[32m2023-01-10T12:36:27.578579+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): 'ea992ea47f3f25c5f667336aa868482d7b567c6e' -> '68278257032602d91bcaee36dadb50bf02d8001b'←[0m
←[32m2023-01-10T12:36:27.580535+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data←[0m←[1m←[0m
←[32m2023-01-10T12:36:27.580988+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data -> 204←[0m←[1m←[0m
←[32m2023-01-10T12:36:27.583688+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-10T12:36:27.583909+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'ea992ea47f3f25c5f667336aa868482d7b567c6e', 'new_policy_hash': '68278257032602d91bcaee36dadb50bf02d8001b', 'changed_directories': ['.']}←[0m
←[32m2023-01-10T12:36:27.584030+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '68278257032602d91bcaee36dadb50bf02d8001b'←[0m
←[32m2023-01-10T12:36:27.584204+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T12:36:27.593900+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 68278257032602d91bcaee36dadb50bf02d8001b←[0m
←[32m2023-01-10T12:36:27.594165+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '68278257032602d91bcaee36dadb50bf02d8001b' -> '68278257032602d91bcaee36dadb50bf02d8001b'←[0m
←[32m2023-01-10T12:36:27.596263+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-10T12:36:27.596415+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'ea992ea47f3f25c5f667336aa868482d7b567c6e', 'new_policy_hash': '68278257032602d91bcaee36dadb50bf02d8001b', 'changed_directories': ['.']}←[0m
←[32m2023-01-10T12:36:27.596492+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '68278257032602d91bcaee36dadb50bf02d8001b'←[0m
←[32m2023-01-10T12:36:27.596656+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T12:36:27.606069+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 68278257032602d91bcaee36dadb50bf02d8001b←[0m
←[32m2023-01-10T12:36:27.606281+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '68278257032602d91bcaee36dadb50bf02d8001b' -> '68278257032602d91bcaee36dadb50bf02d8001b'←[0m
←[32m2023-01-10T12:36:33.925568+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-10T12:36:33.926262+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-10T12:37:07.350547+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-10T12:37:07.350916+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '68278257032602d91bcaee36dadb50bf02d8001b', 'new_policy_hash': '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f', 'changed_directories': ['.']}←[0m
←[32m2023-01-10T12:37:07.351007+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '68278257032602d91bcaee36dadb50bf02d8001b'←[0m
←[32m2023-01-10T12:37:07.351263+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T12:37:07.363090+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 6dde8b623fb3f81342c68262a5a1f5b5abe2f88f←[0m
←[32m2023-01-10T12:37:07.363434+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '68278257032602d91bcaee36dadb50bf02d8001b' -> '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-10T12:37:07.364617+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data←[0m←[1m←[0m
←[32m2023-01-10T12:37:07.365098+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data -> 204←[0m←[1m←[0m
←[32m2023-01-10T12:37:07.365858+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-10T12:37:07.366086+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '68278257032602d91bcaee36dadb50bf02d8001b', 'new_policy_hash': '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f', 'changed_directories': ['.']}←[0m
←[32m2023-01-10T12:37:07.366171+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-10T12:37:07.366381+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T12:37:07.375145+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 6dde8b623fb3f81342c68262a5a1f5b5abe2f88f←[0m
←[32m2023-01-10T12:37:07.375440+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-10T12:37:07.377764+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-10T12:37:07.377909+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '68278257032602d91bcaee36dadb50bf02d8001b', 'new_policy_hash': '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f', 'changed_directories': ['.']}←[0m
←[32m2023-01-10T12:37:07.377988+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-10T12:37:07.378153+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T12:37:07.386444+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 6dde8b623fb3f81342c68262a5a1f5b5abe2f88f←[0m
←[32m2023-01-10T12:37:07.386726+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-10T12:37:15.440967+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-10T12:37:15.441428+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-10T13:34:21.477669+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T13:34:21Z"}←[0m←[1m←[0m
←[32m2023-01-10T15:05:44.488611+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T15:05:44Z"}←[0m←[1m←[0m
←[32m2023-01-10T16:12:46.779101+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Connection was terminated.←[0m
←[32m2023-01-10T16:12:46.779316+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Closing RPC client←[0m
←[32m2023-01-10T16:12:46.779559+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC Reader task was cancelled.←[0m
←[32m2023-01-10T16:12:46.779699+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Connection gracefully closed by server -- Trying to reconnect.←[0m
←[32m2023-01-10T16:12:46.779793+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Closing RPC client←[0m
←[32m2023-01-10T16:12:46.779939+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Trying to connect to Pub/Sub server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:46.780110+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:46.781433+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Connection was terminated.←[0m
←[32m2023-01-10T16:12:46.781553+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Closing RPC client←[0m
←[32m2023-01-10T16:12:46.781707+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Disconnected from server←[0m
←[32m2023-01-10T16:12:46.781874+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC Reader task was cancelled.←[0m
←[32m2023-01-10T16:12:46.781981+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Connection gracefully closed by server -- Trying to reconnect.←[0m
←[32m2023-01-10T16:12:46.782061+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Closing RPC client←[0m
←[32m2023-01-10T16:12:46.782206+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Trying to connect to Pub/Sub server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:46.782352+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:47.807929+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:12:47.808242+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:12:48.021856+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:48.410710+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:49.055949+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:12:49.439868+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:12:49.900944+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:50.416484+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:50.911918+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:12:52.126557+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:53.151923+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:12:55.897652+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:56.927923+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:12:57.503875+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:12:58.528120+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:12:59.551877+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:13:05.926547+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:13:06.943848+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:13:10.852853+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:13:10.916055+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:13:11.871983+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:13:11.935818+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:13:29.263948+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:13:30.271881+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:13:32.658236+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:13:33.667929+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:13:57.815345+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:13:58.847927+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:14:01.147029+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:14:02.175914+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:14:14.064948+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:14:15.071929+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:15:01.119639+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:15:02.143853+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:15:17.824828+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:15:18.847901+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:15:49.082875+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:15:50.111926+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:15:55.059740+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:15:56.063940+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:16:06.879357+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:16:07.903880+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:16:23.344276+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:16:24.351891+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:16:30.617642+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:16:31.647889+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:17:02.944616+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:17:03.967926+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:17:42.027367+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:17:43.039965+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:18:21.614224+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:18:22.623913+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:18:44.700765+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:18:45.727864+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:19:21.949094+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:19:22.975912+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:20:14.149171+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:20:15.167961+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | RPC connection was refused by server←[0m
←[32m2023-01-10T16:20:55.494773+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:20:55.536659+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Connected to server←[0m
←[32m2023-01-10T16:20:55.536877+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Performing data configuration, reason: Initial load←[0m
←[32m2023-01-10T16:20:55.537039+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Getting data-sources configuration from 'http://opal-server-loadbalancer:7002/data/config'←[0m
←[32m2023-01-10T16:20:55.540286+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Triggering data update with id: 7f2733ffb82c42bc805a4660388de208←[0m
←[32m2023-01-10T16:20:55.540437+0000←[0m | 7 | ←[34mopal_client.data.updater                ←[0m|←[1m INFO  | Fetching policy data←[0m
←[32m2023-01-10T16:20:55.540587+0000←[0m | 7 | ←[34mopal_client.data.fetcher                ←[0m|←[1m INFO  | Fetching data from url: https://9027-183-83-252-7.in.ngrok.io/policy-data←[0m
←[32m2023-01-10T16:20:55.541217+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Connected to PubSub server ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:20:56.239197+0000←[0m | 7 | ←[34masyncio.runners                         ←[0m|←[31m←[1mERROR  | Task exception was never retrieved
future: <Task finished name='Task-142' coro=<DataUpdater.update_policy_data() done, defined at /usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/data/updater.py:305> exception=ContentTypeError(RequestInfo(url=URL('https://9027-183-83-252-7.in.ngrok.io/policy-data'), method='GET', headers=<CIMultiDictProxy('Host': '9027-183-83-252-7.in.ngrok.io', 'Accept': '*/*', 'Accept-Encoding': 'gzip, deflate', 'User-Agent': 'Python/3.10 aiohttp/3.8.3')>, real_url=URL('https://9027-183-83-252-7.in.ngrok.io/policy-data')), (), message='Attempt to decode JSON with unexpected mimetype: text/html', headers=<CIMultiDictProxy('Connection': 'close', 'Content-Type': 'text/html', 'Ngrok-Error-Code': 'ERR_NGROK_3200', 'Ngrok-Trace-Id': '787c7213f7490860e5cc9f8e82cce197', 'Referrer-Policy': 'no-referrer', 'Date': 'Tue, 10 Jan 2023 16:20:56 GMT', 'Content-Length': '903')>)>←[0m
←[33m←[1mTraceback (most recent call last):←[0m

> File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/data/updater.py", line 358, in update_policy_data
    error_content = await result.json()
                          │      └ <function ClientResponse.json at 0x7f834ab97f40>
                          └ <ClientResponse(https://9027-183-83-252-7.in.ngrok.io/policy-data) [404 Not Found]>
                            <CIMultiDictProxy('Connection': 'close', ...
  File "/usr/local/lib/python3.10/site-packages/aiohttp/client_reqrep.py", line 1104, in json
    raise ContentTypeError(
          └ <class 'aiohttp.client_exceptions.ContentTypeError'>

←[31m←[1maiohttp.client_exceptions.ContentTypeError←[0m:←[1m 0, message='Attempt to decode JSON with unexpected mimetype: text/html', url=URL('https://9027-183-83-252-7.in.ngrok.io/policy-data')←[0m
←[32m2023-01-10T16:21:22.593861+0000←[0m | 7 | ←[34mfastapi_websocket_rpc.websocket_rpc_c...←[0m|←[1m INFO  | Trying server - ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:21:22.644770+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Connected to server←[0m
←[32m2023-01-10T16:21:22.644892+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-10T16:21:22.645092+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T16:21:22.654725+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 6dde8b623fb3f81342c68262a5a1f5b5abe2f88f←[0m
←[32m2023-01-10T16:21:22.655087+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-10T16:21:22.655442+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[1m INFO  | Connected to PubSub server ws://opal-server-loadbalancer:7002/ws←[0m
←[32m2023-01-10T16:25:37.490927+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T16:25:37Z"}←[0m←[1m←[0m
←[32m2023-01-10T16:25:52.533144+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /←[0m←[1m←[0m
←[32m2023-01-10T16:25:52.533450+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET / -> 200←[0m←[1m←[0m
←[32m2023-01-10T16:26:54.979339+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-10T16:26:54.979955+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-10T16:26:58.796708+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-10T16:26:58.797242+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-10T16:27:55.238809+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-10T16:27:55.239096+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f', 'new_policy_hash': '8d1d81496583b13a5a0d810142ed61feb6a8317f', 'changed_directories': ['.']}←[0m
←[32m2023-01-10T16:27:55.239222+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-10T16:27:55.239484+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T16:27:55.249420+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 8d1d81496583b13a5a0d810142ed61feb6a8317f←[0m
←[32m2023-01-10T16:27:55.249767+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> '8d1d81496583b13a5a0d810142ed61feb6a8317f'←[0m
←[32m2023-01-10T16:27:55.251192+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data←[0m←[1m←[0m
←[32m2023-01-10T16:27:55.251693+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data -> 204←[0m←[1m←[0m
←[32m2023-01-10T16:27:55.252420+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-10T16:27:55.252603+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f', 'new_policy_hash': '8d1d81496583b13a5a0d810142ed61feb6a8317f', 'changed_directories': ['.']}←[0m
←[32m2023-01-10T16:27:55.252710+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '8d1d81496583b13a5a0d810142ed61feb6a8317f'←[0m
←[32m2023-01-10T16:27:55.252859+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-10T16:27:55.264408+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 8d1d81496583b13a5a0d810142ed61feb6a8317f←[0m
←[32m2023-01-10T16:27:55.264575+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '8d1d81496583b13a5a0d810142ed61feb6a8317f' -> '8d1d81496583b13a5a0d810142ed61feb6a8317f'←[0m
←[32m2023-01-10T16:28:06.069322+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-10T16:28:06.069734+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-10T17:32:09.666595+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T17:32:09Z"}←[0m←[1m←[0m
←[32m2023-01-10T18:49:56.495390+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T18:49:56Z"}←[0m←[1m←[0m
←[32m2023-01-10T20:31:20.482770+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T20:31:20Z"}←[0m←[1m←[0m
←[32m2023-01-10T21:38:36.473023+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T21:38:36Z"}←[0m←[1m←[0m
←[32m2023-01-10T22:50:28.490185+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T22:50:28Z"}←[0m←[1m←[0m
←[32m2023-01-10T23:51:54.561687+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-10T23:51:54Z"}←[0m←[1m←[0m
←[32m2023-01-11T01:39:10.675802+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-11T01:39:10Z"}←[0m←[1m←[0m
←[32m2023-01-11T02:40:41.611543+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-11T02:40:41Z"}←[0m←[1m←[0m
←[32m2023-01-11T04:04:34.498240+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-11T04:04:34Z"}←[0m←[1m←[0m
←[32m2023-01-11T05:12:33.507275+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-11T05:12:33Z"}←[0m←[1m←[0m
←[32m2023-01-11T06:31:27.927950+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:31:27.928199+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '8d1d81496583b13a5a0d810142ed61feb6a8317f', 'new_policy_hash': 'be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848', 'changed_directories': ['.', 'Service1', 'Service2']}←[0m
←[32m2023-01-11T06:31:27.928287+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '8d1d81496583b13a5a0d810142ed61feb6a8317f'←[0m
←[32m2023-01-11T06:31:27.928489+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:31:27.941024+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848←[0m
←[32m2023-01-11T06:31:27.941366+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '8d1d81496583b13a5a0d810142ed61feb6a8317f' -> 'be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848'←[0m
←[32m2023-01-11T06:31:27.942812+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service2←[0m←[1m←[0m
←[32m2023-01-11T06:31:27.943280+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service2 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:31:27.944260+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service1←[0m←[1m←[0m
←[32m2023-01-11T06:31:27.944665+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service1 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:31:27.945650+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:31:27.947117+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.949250+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.950729+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.951243+0000←[0m | 7 | ←[34mopal_client...base_policy_store_client  ←[0m|←[31m←[1mERROR  | OPA transaction failed, transaction id=be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848, actions=['set_policies'], error=RetryError(<Future at 0x7f834a2dceb0 state=finished raised ValueError>)←[0m
←[32m2023-01-11T06:31:29.951411+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[31m←[1mERROR  | Failed to trigger a pub/sub callback←[0m
←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 51, in __call__
    result = await fn(*args, **kwargs)
                   │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                   │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                   └ <function OpaClient.set_policy at 0x7f834a535510>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 257, in set_policy
    return await proxy_response_unless_invalid(
                 └ <function proxy_response_unless_invalid at 0x7f834a5348b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 60, in proxy_response_unless_invalid
    raise ValueError(

←[31m←[1mValueError←[0m:←[1m OPA Client: unexpected status code: 400, error: {'code': 'invalid_parameter', 'message': 'error(s) occurred while compiling module(s)', 'errors': [{'code': 'rego_type_error', 'message': 'multiple default rules named allow found', 'location': {'file': 'Service1/rbac.rego', 'row': 25, 'col': 1}}]}←[0m


←[1mThe above exception was the direct cause of the following exception:←[0m


←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/bin/gunicorn", line 33, in <module>
    sys.exit(load_entry_point('gunicorn==20.1.0', 'console_scripts', 'gunicorn')())
    │   │    └ <function importlib_load_entry_point at 0x7f834d86ecb0>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 67, in run
    WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
    └ <class 'gunicorn.app.wsgiapp.WSGIApplication'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 231, in run
    super().run()
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 72, in run
    Arbiter(self).run()
    │       └ <gunicorn.app.wsgiapp.WSGIApplication object at 0x7f834d84fee0>
    └ <class 'gunicorn.arbiter.Arbiter'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 202, in run
    self.manage_workers()
    │    └ <function Arbiter.manage_workers at 0x7f834cd12d40>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 551, in manage_workers
    self.spawn_workers()
    │    └ <function Arbiter.spawn_workers at 0x7f834cd12e60>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers
    self.spawn_worker()
    │    └ <function Arbiter.spawn_worker at 0x7f834cd12dd0>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
    worker.init_process()
    │      └ <function UvicornWorker.init_process at 0x7f834b31c0d0>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 66, in init_process
    super(UvicornWorker, self).init_process()
          │              └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
          └ <class 'uvicorn.workers.UvicornWorker'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/workers/base.py", line 142, in init_process
    self.run()
    │    └ <function UvicornWorker.run at 0x7f834b31c280>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 83, in run
    return asyncio.run(self._serve())
           │       │   │    └ <function UvicornWorker._serve at 0x7f834b31c1f0>
           │       │   └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
           │       └ <function run at 0x7f834c8c1870>
           └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
           │    │                  └ <coroutine object UvicornWorker._serve at 0x7f834a218900>
           │    └ <method 'run_until_complete' of 'uvloop.loop.Loop' objects>
           └ <uvloop.Loop running=True closed=False debug=False>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/websocket_rpc_client.py", line 200, in reader
    await self.channel.on_message(raw_message)
          │    │       │          └ {'request': {'method': 'notify', 'arguments': {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8...
          │    │       └ <function RpcChannel.on_message at 0x7f834a700430>
          │    └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
          └ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f834a520f70>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 223, in on_message
    await self.on_request(message.request)
          │    │          │       └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
          │    │          └ RpcMessage(request=RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscri...
          │    └ <function RpcChannel.on_request at 0x7f834a700940>
          └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 314, in on_request
    result = await method(**message.arguments)
                   │        │       └ {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'po...
                   │        └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
                   └ <bound method RpcEventClientMethods.notify of <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7...
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/rpc_event_methods.py", line 89, in notify
    await self.client.trigger_topic(topic=subscription["topic"], data=data)
          │    │      │                   │                           └ {'old_policy_hash': '8d1d81496583b13a5a0d810142ed61feb6a8317f', 'new_policy_hash': 'be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848'...
          │    │      │                   └ {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'policy:.', 'notifie...
          │    │      └ <function PubSubClient.trigger_topic at 0x7f834a659750>
          │    └ <fastapi_websocket_pubsub.pub_sub_client.PubSubClient object at 0x7f834a287190>
          └ <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7f834a21cc10>
> File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/pub_sub_client.py", line 325, in trigger_topic
    await asyncio.gather(*futures)
          │       │       └ [<coroutine object PolicyUpdater._update_policy_callback at 0x7f8348103bc0>]
          │       └ <function gather at 0x7f834c91f2e0>
          └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 145, in _update_policy_callback
    await self.update_policy(directories)
          │    │             └ ['.']
          │    └ <function PolicyUpdater.update_policy at 0x7f834a54a9e0>
          └ <opal_client.policy.updater.PolicyUpdater object at 0x7f834a55c070>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 311, in update_policy
    await store_transaction.set_policies(bundle)
          │                 │            └ PolicyBundle(manifest=['Service2/data.json', 'Service1/data.json', 'Service1/rbac.rego', 'Service1/utils.rego'], hash='be7a94...
          │                 └ <function AbstractPolicyStore.set_policies at 0x7f834a65a320>
          └ <opal_client.policy_store.base_policy_store_client.PolicyStoreTransactionContextManager object at 0x7f834a2dece0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 346, in set_policies
    return await self._set_policies_from_delta_bundle(bundle)
                 │    │                               └ PolicyBundle(manifest=['Service2/data.json', 'Service1/data.json', 'Service1/rbac.rego', 'Service1/utils.rego'], hash='be7a94...
                 │    └ <function OpaClient._set_policies_from_delta_bundle at 0x7f834a536050>
                 └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 386, in _set_policies_from_delta_bundle
    await self.set_policy(policy_id=module.path, policy_code=module.rego)
          │    │                    │      │                 │      └ '# Role-based Access Control (RBAC)\n# --------------------------------\n#\n# This example defines an RBAC model for a Pet St...
          │    │                    │      │                 └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    │                    │      └ 'Service1/rbac.rego'
          │    │                    └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    └ <function OpaClient.set_policy at 0x7f834a5356c0>
          └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 86, in async_wrapped
    return await fn(*args, **kwargs)
                 │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                 │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                 └ <function OpaClient.set_policy at 0x7f834a5355a0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 48, in __call__
    do = self.iter(retry_state=retry_state)
         │    │                └ <RetryCallState 140201861965488: attempt #2; slept for 2.0; last result: failed (ValueError OPA Client: unexpected status cod...
         │    └ <function BaseRetrying.iter at 0x7f834a797f40>
         └ <AsyncRetrying object at 0x7f834a55ccd0 (stop=<tenacity.stop.stop_after_attempt object at 0x7f834a55ce80>, wait=<tenacity.wai...
  File "/usr/local/lib/python3.10/site-packages/tenacity/__init__.py", line 363, in iter
    raise retry_exc from fut.exception()
          │              │   └ <function Future.exception at 0x7f834c8c36d0>
          │              └ <Future at 0x7f834a2dceb0 state=finished raised ValueError>
          └ RetryError(<Future at 0x7f834a2dceb0 state=finished raised ValueError>)

←[31m←[1mtenacity.RetryError←[0m:←[1m RetryError[<Future at 0x7f834a2dceb0 state=finished raised ValueError>]←[0m
←[32m2023-01-11T06:31:29.955776+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:31:29.955983+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '8d1d81496583b13a5a0d810142ed61feb6a8317f', 'new_policy_hash': 'be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848', 'changed_directories': ['.', 'Service1', 'Service2']}←[0m
←[32m2023-01-11T06:31:29.956056+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '8d1d81496583b13a5a0d810142ed61feb6a8317f'←[0m
←[32m2023-01-11T06:31:29.956217+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:31:29.969887+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 6dde8b623fb3f81342c68262a5a1f5b5abe2f88f←[0m
←[32m2023-01-11T06:31:29.970061+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Got policy bundle with 2 rego files, 1 data files, commit hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:31:29.970903+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/policies←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.972568+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/policies -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.973198+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.973579+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.974500+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/utils.rego←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.974763+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/utils.rego -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.975777+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:31:29.976204+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/rbac.rego -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:31:37.837593+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:31:37.838147+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:31:45.038906+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:31:45.039426+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:03.960980+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:03.961508+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:05.280597+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:05.281305+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:06.825896+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:06.826307+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:25.228522+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:25.228846+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:26.403174+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:26.403861+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:36.280967+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:36.281377+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:38.689898+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:38.690636+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:39.904938+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:39.905365+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:41.046761+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:41.047106+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:42.145051+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:42.145518+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:32:43.273402+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:32:43.273660+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:33:08.511372+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | OPA is out of date.  ←[38;2;191;191;191m{"current_version": "0.45.0", "download_opa": "https://openpolicyagent.org/downloads/v0.48.0/opa_linux_amd64", "latest_version": "0.48.0", "release_notes": "https://github.com/open-policy-agent/opa/releases/tag/v0.48.0", "time": "2023-01-11T06:33:08Z"}←[0m←[1m←[0m
←[32m2023-01-11T06:33:08.804140+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:33:08.804569+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:33:10.414572+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:33:10.414931+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:36:43.406749+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:36:43.407016+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848', 'new_policy_hash': '5c10680e7a0eeee3fc5e792879313360f30e3b8d', 'changed_directories': ['.', 'Service1']}←[0m
←[32m2023-01-11T06:36:43.407113+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:36:43.407410+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:36:43.420361+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 5c10680e7a0eeee3fc5e792879313360f30e3b8d←[0m
←[32m2023-01-11T06:36:43.420729+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> '5c10680e7a0eeee3fc5e792879313360f30e3b8d'←[0m
←[32m2023-01-11T06:36:43.422017+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service2←[0m←[1m←[0m
←[32m2023-01-11T06:36:43.422484+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service2 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:36:43.423400+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service1←[0m←[1m←[0m
←[32m2023-01-11T06:36:43.423798+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service1 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:36:43.424686+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service1←[0m←[1m←[0m
←[32m2023-01-11T06:36:43.425062+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service1 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:36:43.425974+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:36:43.427333+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:36:44.332019+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:36:44.332590+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.429291+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.430651+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.431174+0000←[0m | 7 | ←[34mopal_client...base_policy_store_client  ←[0m|←[31m←[1mERROR  | OPA transaction failed, transaction id=5c10680e7a0eeee3fc5e792879313360f30e3b8d, actions=['set_policies'], error=RetryError(<Future at 0x7f834a2dfbb0 state=finished raised ValueError>)←[0m
←[32m2023-01-11T06:36:45.431335+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[31m←[1mERROR  | Failed to trigger a pub/sub callback←[0m
←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 51, in __call__
    result = await fn(*args, **kwargs)
                   │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                   │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                   └ <function OpaClient.set_policy at 0x7f834a535510>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 257, in set_policy
    return await proxy_response_unless_invalid(
                 └ <function proxy_response_unless_invalid at 0x7f834a5348b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 60, in proxy_response_unless_invalid
    raise ValueError(

←[31m←[1mValueError←[0m:←[1m OPA Client: unexpected status code: 400, error: {'code': 'invalid_parameter', 'message': 'error(s) occurred while compiling module(s)', 'errors': [{'code': 'rego_type_error', 'message': 'multiple default rules named allow found', 'location': {'file': 'Service1/rbac.rego', 'row': 25, 'col': 1}}]}←[0m


←[1mThe above exception was the direct cause of the following exception:←[0m


←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/bin/gunicorn", line 33, in <module>
    sys.exit(load_entry_point('gunicorn==20.1.0', 'console_scripts', 'gunicorn')())
    │   │    └ <function importlib_load_entry_point at 0x7f834d86ecb0>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 67, in run
    WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
    └ <class 'gunicorn.app.wsgiapp.WSGIApplication'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 231, in run
    super().run()
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 72, in run
    Arbiter(self).run()
    │       └ <gunicorn.app.wsgiapp.WSGIApplication object at 0x7f834d84fee0>
    └ <class 'gunicorn.arbiter.Arbiter'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 202, in run
    self.manage_workers()
    │    └ <function Arbiter.manage_workers at 0x7f834cd12d40>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 551, in manage_workers
    self.spawn_workers()
    │    └ <function Arbiter.spawn_workers at 0x7f834cd12e60>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers
    self.spawn_worker()
    │    └ <function Arbiter.spawn_worker at 0x7f834cd12dd0>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
    worker.init_process()
    │      └ <function UvicornWorker.init_process at 0x7f834b31c0d0>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 66, in init_process
    super(UvicornWorker, self).init_process()
          │              └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
          └ <class 'uvicorn.workers.UvicornWorker'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/workers/base.py", line 142, in init_process
    self.run()
    │    └ <function UvicornWorker.run at 0x7f834b31c280>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 83, in run
    return asyncio.run(self._serve())
           │       │   │    └ <function UvicornWorker._serve at 0x7f834b31c1f0>
           │       │   └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
           │       └ <function run at 0x7f834c8c1870>
           └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
           │    │                  └ <coroutine object UvicornWorker._serve at 0x7f834a218900>
           │    └ <method 'run_until_complete' of 'uvloop.loop.Loop' objects>
           └ <uvloop.Loop running=True closed=False debug=False>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/websocket_rpc_client.py", line 200, in reader
    await self.channel.on_message(raw_message)
          │    │       │          └ {'request': {'method': 'notify', 'arguments': {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8...
          │    │       └ <function RpcChannel.on_message at 0x7f834a700430>
          │    └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
          └ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f834a520f70>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 223, in on_message
    await self.on_request(message.request)
          │    │          │       └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
          │    │          └ RpcMessage(request=RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscri...
          │    └ <function RpcChannel.on_request at 0x7f834a700940>
          └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 314, in on_request
    result = await method(**message.arguments)
                   │        │       └ {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'po...
                   │        └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
                   └ <bound method RpcEventClientMethods.notify of <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7...
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/rpc_event_methods.py", line 89, in notify
    await self.client.trigger_topic(topic=subscription["topic"], data=data)
          │    │      │                   │                           └ {'old_policy_hash': 'be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848', 'new_policy_hash': '5c10680e7a0eeee3fc5e792879313360f30e3b8d'...
          │    │      │                   └ {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'policy:.', 'notifie...
          │    │      └ <function PubSubClient.trigger_topic at 0x7f834a659750>
          │    └ <fastapi_websocket_pubsub.pub_sub_client.PubSubClient object at 0x7f834a287190>
          └ <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7f834a21cc10>
> File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/pub_sub_client.py", line 325, in trigger_topic
    await asyncio.gather(*futures)
          │       │       └ [<coroutine object PolicyUpdater._update_policy_callback at 0x7f8348103a70>]
          │       └ <function gather at 0x7f834c91f2e0>
          └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 145, in _update_policy_callback
    await self.update_policy(directories)
          │    │             └ ['.']
          │    └ <function PolicyUpdater.update_policy at 0x7f834a54a9e0>
          └ <opal_client.policy.updater.PolicyUpdater object at 0x7f834a55c070>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 311, in update_policy
    await store_transaction.set_policies(bundle)
          │                 │            └ PolicyBundle(manifest=['Service2/data.json', 'Service1/data.json', 'Service1/rbac.rego', 'Service1/utils.rego', 'Service1/dat...
          │                 └ <function AbstractPolicyStore.set_policies at 0x7f834a65a320>
          └ <opal_client.policy_store.base_policy_store_client.PolicyStoreTransactionContextManager object at 0x7f834a2de140>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 346, in set_policies
    return await self._set_policies_from_delta_bundle(bundle)
                 │    │                               └ PolicyBundle(manifest=['Service2/data.json', 'Service1/data.json', 'Service1/rbac.rego', 'Service1/utils.rego', 'Service1/dat...
                 │    └ <function OpaClient._set_policies_from_delta_bundle at 0x7f834a536050>
                 └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 386, in _set_policies_from_delta_bundle
    await self.set_policy(policy_id=module.path, policy_code=module.rego)
          │    │                    │      │                 │      └ '# Role-based Access Control (RBAC)\n# --------------------------------\n#\n# This example defines an RBAC model for a Pet St...
          │    │                    │      │                 └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    │                    │      └ 'Service1/rbac.rego'
          │    │                    └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    └ <function OpaClient.set_policy at 0x7f834a5356c0>
          └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 86, in async_wrapped
    return await fn(*args, **kwargs)
                 │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                 │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                 └ <function OpaClient.set_policy at 0x7f834a5355a0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 48, in __call__
    do = self.iter(retry_state=retry_state)
         │    │                └ <RetryCallState 140201861969856: attempt #2; slept for 2.0; last result: failed (ValueError OPA Client: unexpected status cod...
         │    └ <function BaseRetrying.iter at 0x7f834a797f40>
         └ <AsyncRetrying object at 0x7f834a55ccd0 (stop=<tenacity.stop.stop_after_attempt object at 0x7f834a55ce80>, wait=<tenacity.wai...
  File "/usr/local/lib/python3.10/site-packages/tenacity/__init__.py", line 363, in iter
    raise retry_exc from fut.exception()
          │              │   └ <function Future.exception at 0x7f834c8c36d0>
          │              └ <Future at 0x7f834a2dfbb0 state=finished raised ValueError>
          └ RetryError(<Future at 0x7f834a2dfbb0 state=finished raised ValueError>)

←[31m←[1mtenacity.RetryError←[0m:←[1m RetryError[<Future at 0x7f834a2dfbb0 state=finished raised ValueError>]←[0m
←[32m2023-01-11T06:36:45.434803+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:36:45.435003+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848', 'new_policy_hash': '5c10680e7a0eeee3fc5e792879313360f30e3b8d', 'changed_directories': ['.', 'Service1']}←[0m
←[32m2023-01-11T06:36:45.435082+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:36:45.435240+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:36:45.449837+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 5c10680e7a0eeee3fc5e792879313360f30e3b8d←[0m
←[32m2023-01-11T06:36:45.450220+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> '5c10680e7a0eeee3fc5e792879313360f30e3b8d'←[0m
←[32m2023-01-11T06:36:45.451427+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service2←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.451916+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service2 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.452843+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service1←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.453223+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service1 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.454140+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service1←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.454518+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service1 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.455473+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:36:45.456967+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:36:46.385830+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:36:46.386704+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:36:47.458240+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:36:47.461322+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:36:47.462052+0000←[0m | 7 | ←[34mopal_client...base_policy_store_client  ←[0m|←[31m←[1mERROR  | OPA transaction failed, transaction id=5c10680e7a0eeee3fc5e792879313360f30e3b8d, actions=['set_policies'], error=RetryError(<Future at 0x7f834a2de200 state=finished raised ValueError>)←[0m
←[32m2023-01-11T06:36:47.462251+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[31m←[1mERROR  | Failed to trigger a pub/sub callback←[0m
←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 51, in __call__
    result = await fn(*args, **kwargs)
                   │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                   │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                   └ <function OpaClient.set_policy at 0x7f834a535510>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 257, in set_policy
    return await proxy_response_unless_invalid(
                 └ <function proxy_response_unless_invalid at 0x7f834a5348b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 60, in proxy_response_unless_invalid
    raise ValueError(

←[31m←[1mValueError←[0m:←[1m OPA Client: unexpected status code: 400, error: {'code': 'invalid_parameter', 'message': 'error(s) occurred while compiling module(s)', 'errors': [{'code': 'rego_type_error', 'message': 'multiple default rules named allow found', 'location': {'file': 'Service1/rbac.rego', 'row': 25, 'col': 1}}]}←[0m


←[1mThe above exception was the direct cause of the following exception:←[0m


←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/bin/gunicorn", line 33, in <module>
    sys.exit(load_entry_point('gunicorn==20.1.0', 'console_scripts', 'gunicorn')())
    │   │    └ <function importlib_load_entry_point at 0x7f834d86ecb0>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 67, in run
    WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
    └ <class 'gunicorn.app.wsgiapp.WSGIApplication'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 231, in run
    super().run()
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 72, in run
    Arbiter(self).run()
    │       └ <gunicorn.app.wsgiapp.WSGIApplication object at 0x7f834d84fee0>
    └ <class 'gunicorn.arbiter.Arbiter'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 202, in run
    self.manage_workers()
    │    └ <function Arbiter.manage_workers at 0x7f834cd12d40>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 551, in manage_workers
    self.spawn_workers()
    │    └ <function Arbiter.spawn_workers at 0x7f834cd12e60>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers
    self.spawn_worker()
    │    └ <function Arbiter.spawn_worker at 0x7f834cd12dd0>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
    worker.init_process()
    │      └ <function UvicornWorker.init_process at 0x7f834b31c0d0>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 66, in init_process
    super(UvicornWorker, self).init_process()
          │              └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
          └ <class 'uvicorn.workers.UvicornWorker'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/workers/base.py", line 142, in init_process
    self.run()
    │    └ <function UvicornWorker.run at 0x7f834b31c280>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 83, in run
    return asyncio.run(self._serve())
           │       │   │    └ <function UvicornWorker._serve at 0x7f834b31c1f0>
           │       │   └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
           │       └ <function run at 0x7f834c8c1870>
           └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
           │    │                  └ <coroutine object UvicornWorker._serve at 0x7f834a218900>
           │    └ <method 'run_until_complete' of 'uvloop.loop.Loop' objects>
           └ <uvloop.Loop running=True closed=False debug=False>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/websocket_rpc_client.py", line 200, in reader
    await self.channel.on_message(raw_message)
          │    │       │          └ {'request': {'method': 'notify', 'arguments': {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8...
          │    │       └ <function RpcChannel.on_message at 0x7f834a700430>
          │    └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
          └ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f834a520f70>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 223, in on_message
    await self.on_request(message.request)
          │    │          │       └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
          │    │          └ RpcMessage(request=RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscri...
          │    └ <function RpcChannel.on_request at 0x7f834a700940>
          └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 314, in on_request
    result = await method(**message.arguments)
                   │        │       └ {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'po...
                   │        └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
                   └ <bound method RpcEventClientMethods.notify of <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7...
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/rpc_event_methods.py", line 89, in notify
    await self.client.trigger_topic(topic=subscription["topic"], data=data)
          │    │      │                   │                           └ {'old_policy_hash': 'be7a94d2f28ad1b7a5ebdaf11b3d84dd0b4af848', 'new_policy_hash': '5c10680e7a0eeee3fc5e792879313360f30e3b8d'...
          │    │      │                   └ {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'policy:.', 'notifie...
          │    │      └ <function PubSubClient.trigger_topic at 0x7f834a659750>
          │    └ <fastapi_websocket_pubsub.pub_sub_client.PubSubClient object at 0x7f834a287190>
          └ <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7f834a21cc10>
> File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/pub_sub_client.py", line 325, in trigger_topic
    await asyncio.gather(*futures)
          │       │       └ [<coroutine object PolicyUpdater._update_policy_callback at 0x7f8348103ed0>]
          │       └ <function gather at 0x7f834c91f2e0>
          └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 145, in _update_policy_callback
    await self.update_policy(directories)
          │    │             └ ['.']
          │    └ <function PolicyUpdater.update_policy at 0x7f834a54a9e0>
          └ <opal_client.policy.updater.PolicyUpdater object at 0x7f834a55c070>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 311, in update_policy
    await store_transaction.set_policies(bundle)
          │                 │            └ PolicyBundle(manifest=['Service2/data.json', 'Service1/data.json', 'Service1/rbac.rego', 'Service1/utils.rego', 'Service1/dat...
          │                 └ <function AbstractPolicyStore.set_policies at 0x7f834a65a320>
          └ <opal_client.policy_store.base_policy_store_client.PolicyStoreTransactionContextManager object at 0x7f834a2dc670>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 346, in set_policies
    return await self._set_policies_from_delta_bundle(bundle)
                 │    │                               └ PolicyBundle(manifest=['Service2/data.json', 'Service1/data.json', 'Service1/rbac.rego', 'Service1/utils.rego', 'Service1/dat...
                 │    └ <function OpaClient._set_policies_from_delta_bundle at 0x7f834a536050>
                 └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 386, in _set_policies_from_delta_bundle
    await self.set_policy(policy_id=module.path, policy_code=module.rego)
          │    │                    │      │                 │      └ '# Role-based Access Control (RBAC)\n# --------------------------------\n#\n# This example defines an RBAC model for a Pet St...
          │    │                    │      │                 └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    │                    │      └ 'Service1/rbac.rego'
          │    │                    └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    └ <function OpaClient.set_policy at 0x7f834a5356c0>
          └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 86, in async_wrapped
    return await fn(*args, **kwargs)
                 │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                 │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                 └ <function OpaClient.set_policy at 0x7f834a5355a0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 48, in __call__
    do = self.iter(retry_state=retry_state)
         │    │                └ <RetryCallState 140201861962176: attempt #2; slept for 2.0; last result: failed (ValueError OPA Client: unexpected status cod...
         │    └ <function BaseRetrying.iter at 0x7f834a797f40>
         └ <AsyncRetrying object at 0x7f834a55ccd0 (stop=<tenacity.stop.stop_after_attempt object at 0x7f834a55ce80>, wait=<tenacity.wai...
  File "/usr/local/lib/python3.10/site-packages/tenacity/__init__.py", line 363, in iter
    raise retry_exc from fut.exception()
          │              │   └ <function Future.exception at 0x7f834c8c36d0>
          │              └ <Future at 0x7f834a2de200 state=finished raised ValueError>
          └ RetryError(<Future at 0x7f834a2de200 state=finished raised ValueError>)

←[31m←[1mtenacity.RetryError←[0m:←[1m RetryError[<Future at 0x7f834a2de200 state=finished raised ValueError>]←[0m
←[32m2023-01-11T06:36:47.523861+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:36:47.524384+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:45:18.950192+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:45:18.950813+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.010559+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:46:07.010790+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '5c10680e7a0eeee3fc5e792879313360f30e3b8d', 'new_policy_hash': 'f0ca6db4bc8568a98ff9c90e6ee533df7146963f', 'changed_directories': ['.', 'Service1']}←[0m
←[32m2023-01-11T06:46:07.010890+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:46:07.011141+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:46:07.025402+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 6dde8b623fb3f81342c68262a5a1f5b5abe2f88f←[0m
←[32m2023-01-11T06:46:07.025635+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:46:07.026286+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:46:07.026461+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '5c10680e7a0eeee3fc5e792879313360f30e3b8d', 'new_policy_hash': 'f0ca6db4bc8568a98ff9c90e6ee533df7146963f', 'changed_directories': ['.', 'Service1']}←[0m
←[32m2023-01-11T06:46:07.026535+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:46:07.026681+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:46:07.039831+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: f0ca6db4bc8568a98ff9c90e6ee533df7146963f←[0m
←[32m2023-01-11T06:46:07.040153+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> 'f0ca6db4bc8568a98ff9c90e6ee533df7146963f'←[0m
←[32m2023-01-11T06:46:07.041359+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service1←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.041798+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service1 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.042691+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data/Service2←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.043056+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data/Service2 -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.043979+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.044351+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.045257+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.047705+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/rbac.rego -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.048764+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/utils.rego←[0m←[1m←[0m
←[32m2023-01-11T06:46:07.052157+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/utils.rego -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:46:15.193707+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:46:15.194519+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:46:58.985451+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:46:58.985789+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'f0ca6db4bc8568a98ff9c90e6ee533df7146963f', 'new_policy_hash': 'caf2bfd1308063bcb3020699cac5f62acc7b3eef', 'changed_directories': ['.']}←[0m
←[32m2023-01-11T06:46:58.985911+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: 'f0ca6db4bc8568a98ff9c90e6ee533df7146963f'←[0m
←[32m2023-01-11T06:46:58.986127+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:46:58.997082+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: caf2bfd1308063bcb3020699cac5f62acc7b3eef←[0m
←[32m2023-01-11T06:46:58.997373+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): 'f0ca6db4bc8568a98ff9c90e6ee533df7146963f' -> 'caf2bfd1308063bcb3020699cac5f62acc7b3eef'←[0m
←[32m2023-01-11T06:46:58.998567+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:46:58.999010+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:46:58.999757+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:46:58.999944+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'f0ca6db4bc8568a98ff9c90e6ee533df7146963f', 'new_policy_hash': 'caf2bfd1308063bcb3020699cac5f62acc7b3eef', 'changed_directories': ['.']}←[0m
←[32m2023-01-11T06:46:59.000048+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: 'caf2bfd1308063bcb3020699cac5f62acc7b3eef'←[0m
←[32m2023-01-11T06:46:59.000196+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:46:59.009857+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: caf2bfd1308063bcb3020699cac5f62acc7b3eef←[0m
←[32m2023-01-11T06:46:59.010157+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): 'caf2bfd1308063bcb3020699cac5f62acc7b3eef' -> 'caf2bfd1308063bcb3020699cac5f62acc7b3eef'←[0m
←[32m2023-01-11T06:47:00.808611+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:47:00.809057+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:47:20.117919+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:47:20.118482+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:47:39.378362+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:47:39.378802+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:48:20.032935+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:48:20.033180+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'caf2bfd1308063bcb3020699cac5f62acc7b3eef', 'new_policy_hash': '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83', 'changed_directories': ['.']}←[0m
←[32m2023-01-11T06:48:20.033256+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: 'caf2bfd1308063bcb3020699cac5f62acc7b3eef'←[0m
←[32m2023-01-11T06:48:20.033436+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:48:20.048140+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83←[0m
←[32m2023-01-11T06:48:20.048341+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): 'caf2bfd1308063bcb3020699cac5f62acc7b3eef' -> '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83'←[0m
←[32m2023-01-11T06:48:20.049383+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:48:20.051974+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/rbac.rego -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:48:20.052805+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:48:20.052969+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': 'caf2bfd1308063bcb3020699cac5f62acc7b3eef', 'new_policy_hash': '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83', 'changed_directories': ['.']}←[0m
←[32m2023-01-11T06:48:20.053038+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83'←[0m
←[32m2023-01-11T06:48:20.053156+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:48:20.063729+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83←[0m
←[32m2023-01-11T06:48:20.063897+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83' -> '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83'←[0m
←[32m2023-01-11T06:48:23.269381+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:48:23.269997+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:48:24.598567+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:48:24.598965+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:48:25.665632+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:48:25.666042+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:48:38.991843+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:48:38.992261+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:49:07.419046+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:49:07.419467+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:49:10.293960+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:49:10.294565+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:49:11.540730+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:49:11.541135+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:50:10.989573+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:50:10.989942+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83', 'new_policy_hash': '54868ac36ed99fe738a7d08e0fbc07e55c248397', 'changed_directories': ['.', 'Service1']}←[0m
←[32m2023-01-11T06:50:10.990070+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83'←[0m
←[32m2023-01-11T06:50:10.990412+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:50:11.003235+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 54868ac36ed99fe738a7d08e0fbc07e55c248397←[0m
←[32m2023-01-11T06:50:11.003538+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83' -> '54868ac36ed99fe738a7d08e0fbc07e55c248397'←[0m
←[32m2023-01-11T06:50:11.004617+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:50:11.006336+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:50:13.010131+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:50:13.011475+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:50:13.012041+0000←[0m | 7 | ←[34mopal_client...base_policy_store_client  ←[0m|←[31m←[1mERROR  | OPA transaction failed, transaction id=54868ac36ed99fe738a7d08e0fbc07e55c248397, actions=['set_policies'], error=RetryError(<Future at 0x7f834a2def20 state=finished raised ValueError>)←[0m
←[32m2023-01-11T06:50:13.012201+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[31m←[1mERROR  | Failed to trigger a pub/sub callback←[0m
←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 51, in __call__
    result = await fn(*args, **kwargs)
                   │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                   │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                   └ <function OpaClient.set_policy at 0x7f834a535510>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 257, in set_policy
    return await proxy_response_unless_invalid(
                 └ <function proxy_response_unless_invalid at 0x7f834a5348b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 60, in proxy_response_unless_invalid
    raise ValueError(

←[31m←[1mValueError←[0m:←[1m OPA Client: unexpected status code: 400, error: {'code': 'invalid_parameter', 'message': 'error(s) occurred while compiling module(s)', 'errors': [{'code': 'rego_type_error', 'message': 'multiple default rules named allow found', 'location': {'file': 'Service1/rbac.rego', 'row': 25, 'col': 1}}]}←[0m


←[1mThe above exception was the direct cause of the following exception:←[0m


←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/bin/gunicorn", line 33, in <module>
    sys.exit(load_entry_point('gunicorn==20.1.0', 'console_scripts', 'gunicorn')())
    │   │    └ <function importlib_load_entry_point at 0x7f834d86ecb0>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 67, in run
    WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
    └ <class 'gunicorn.app.wsgiapp.WSGIApplication'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 231, in run
    super().run()
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 72, in run
    Arbiter(self).run()
    │       └ <gunicorn.app.wsgiapp.WSGIApplication object at 0x7f834d84fee0>
    └ <class 'gunicorn.arbiter.Arbiter'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 202, in run
    self.manage_workers()
    │    └ <function Arbiter.manage_workers at 0x7f834cd12d40>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 551, in manage_workers
    self.spawn_workers()
    │    └ <function Arbiter.spawn_workers at 0x7f834cd12e60>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers
    self.spawn_worker()
    │    └ <function Arbiter.spawn_worker at 0x7f834cd12dd0>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
    worker.init_process()
    │      └ <function UvicornWorker.init_process at 0x7f834b31c0d0>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 66, in init_process
    super(UvicornWorker, self).init_process()
          │              └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
          └ <class 'uvicorn.workers.UvicornWorker'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/workers/base.py", line 142, in init_process
    self.run()
    │    └ <function UvicornWorker.run at 0x7f834b31c280>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 83, in run
    return asyncio.run(self._serve())
           │       │   │    └ <function UvicornWorker._serve at 0x7f834b31c1f0>
           │       │   └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
           │       └ <function run at 0x7f834c8c1870>
           └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
           │    │                  └ <coroutine object UvicornWorker._serve at 0x7f834a218900>
           │    └ <method 'run_until_complete' of 'uvloop.loop.Loop' objects>
           └ <uvloop.Loop running=True closed=False debug=False>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/websocket_rpc_client.py", line 200, in reader
    await self.channel.on_message(raw_message)
          │    │       │          └ {'request': {'method': 'notify', 'arguments': {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8...
          │    │       └ <function RpcChannel.on_message at 0x7f834a700430>
          │    └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
          └ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f834a520f70>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 223, in on_message
    await self.on_request(message.request)
          │    │          │       └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
          │    │          └ RpcMessage(request=RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscri...
          │    └ <function RpcChannel.on_request at 0x7f834a700940>
          └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 314, in on_request
    result = await method(**message.arguments)
                   │        │       └ {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'po...
                   │        └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
                   └ <bound method RpcEventClientMethods.notify of <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7...
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/rpc_event_methods.py", line 89, in notify
    await self.client.trigger_topic(topic=subscription["topic"], data=data)
          │    │      │                   │                           └ {'old_policy_hash': '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83', 'new_policy_hash': '54868ac36ed99fe738a7d08e0fbc07e55c248397'...
          │    │      │                   └ {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'policy:.', 'notifie...
          │    │      └ <function PubSubClient.trigger_topic at 0x7f834a659750>
          │    └ <fastapi_websocket_pubsub.pub_sub_client.PubSubClient object at 0x7f834a287190>
          └ <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7f834a21cc10>
> File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/pub_sub_client.py", line 325, in trigger_topic
    await asyncio.gather(*futures)
          │       │       └ [<coroutine object PolicyUpdater._update_policy_callback at 0x7f8348103a00>]
          │       └ <function gather at 0x7f834c91f2e0>
          └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 145, in _update_policy_callback
    await self.update_policy(directories)
          │    │             └ ['.']
          │    └ <function PolicyUpdater.update_policy at 0x7f834a54a9e0>
          └ <opal_client.policy.updater.PolicyUpdater object at 0x7f834a55c070>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 311, in update_policy
    await store_transaction.set_policies(bundle)
          │                 │            └ PolicyBundle(manifest=['Service1/rbac.rego'], hash='54868ac36ed99fe738a7d08e0fbc07e55c248397', old_hash='1fb8e9a52f59ef198acd...
          │                 └ <function AbstractPolicyStore.set_policies at 0x7f834a65a320>
          └ <opal_client.policy_store.base_policy_store_client.PolicyStoreTransactionContextManager object at 0x7f834a2dde40>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 346, in set_policies
    return await self._set_policies_from_delta_bundle(bundle)
                 │    │                               └ PolicyBundle(manifest=['Service1/rbac.rego'], hash='54868ac36ed99fe738a7d08e0fbc07e55c248397', old_hash='1fb8e9a52f59ef198acd...
                 │    └ <function OpaClient._set_policies_from_delta_bundle at 0x7f834a536050>
                 └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 386, in _set_policies_from_delta_bundle
    await self.set_policy(policy_id=module.path, policy_code=module.rego)
          │    │                    │      │                 │      └ '# Role-based Access Control (RBAC)\n# --------------------------------\n#\n# This example defines an RBAC model for a Pet St...
          │    │                    │      │                 └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    │                    │      └ 'Service1/rbac.rego'
          │    │                    └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    └ <function OpaClient.set_policy at 0x7f834a5356c0>
          └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 86, in async_wrapped
    return await fn(*args, **kwargs)
                 │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                 │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                 └ <function OpaClient.set_policy at 0x7f834a5355a0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 48, in __call__
    do = self.iter(retry_state=retry_state)
         │    │                └ <RetryCallState 140201861960064: attempt #2; slept for 2.0; last result: failed (ValueError OPA Client: unexpected status cod...
         │    └ <function BaseRetrying.iter at 0x7f834a797f40>
         └ <AsyncRetrying object at 0x7f834a55ccd0 (stop=<tenacity.stop.stop_after_attempt object at 0x7f834a55ce80>, wait=<tenacity.wai...
  File "/usr/local/lib/python3.10/site-packages/tenacity/__init__.py", line 363, in iter
    raise retry_exc from fut.exception()
          │              │   └ <function Future.exception at 0x7f834c8c36d0>
          │              └ <Future at 0x7f834a2def20 state=finished raised ValueError>
          └ RetryError(<Future at 0x7f834a2def20 state=finished raised ValueError>)

←[31m←[1mtenacity.RetryError←[0m:←[1m RetryError[<Future at 0x7f834a2def20 state=finished raised ValueError>]←[0m
←[32m2023-01-11T06:50:13.015585+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:50:13.015817+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83', 'new_policy_hash': '54868ac36ed99fe738a7d08e0fbc07e55c248397', 'changed_directories': ['.', 'Service1']}←[0m
←[32m2023-01-11T06:50:13.015891+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83'←[0m
←[32m2023-01-11T06:50:13.016047+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:50:13.028050+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 54868ac36ed99fe738a7d08e0fbc07e55c248397←[0m
←[32m2023-01-11T06:50:13.028258+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83' -> '54868ac36ed99fe738a7d08e0fbc07e55c248397'←[0m
←[32m2023-01-11T06:50:13.029174+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:50:13.030374+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:50:15.032852+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:50:15.034175+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/Service1/rbac.rego -> 400←[0m←[1m←[0m
←[32m2023-01-11T06:50:15.034702+0000←[0m | 7 | ←[34mopal_client...base_policy_store_client  ←[0m|←[31m←[1mERROR  | OPA transaction failed, transaction id=54868ac36ed99fe738a7d08e0fbc07e55c248397, actions=['set_policies'], error=RetryError(<Future at 0x7f834a2ded40 state=finished raised ValueError>)←[0m
←[32m2023-01-11T06:50:15.034865+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.pub_sub_client ←[0m|←[31m←[1mERROR  | Failed to trigger a pub/sub callback←[0m
←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 51, in __call__
    result = await fn(*args, **kwargs)
                   │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                   │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                   └ <function OpaClient.set_policy at 0x7f834a535510>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 257, in set_policy
    return await proxy_response_unless_invalid(
                 └ <function proxy_response_unless_invalid at 0x7f834a5348b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 60, in proxy_response_unless_invalid
    raise ValueError(

←[31m←[1mValueError←[0m:←[1m OPA Client: unexpected status code: 400, error: {'code': 'invalid_parameter', 'message': 'error(s) occurred while compiling module(s)', 'errors': [{'code': 'rego_type_error', 'message': 'multiple default rules named allow found', 'location': {'file': 'Service1/rbac.rego', 'row': 25, 'col': 1}}]}←[0m


←[1mThe above exception was the direct cause of the following exception:←[0m


←[33m←[1mTraceback (most recent call last):←[0m

  File "/usr/local/bin/gunicorn", line 33, in <module>
    sys.exit(load_entry_point('gunicorn==20.1.0', 'console_scripts', 'gunicorn')())
    │   │    └ <function importlib_load_entry_point at 0x7f834d86ecb0>
    │   └ <built-in function exit>
    └ <module 'sys' (built-in)>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/wsgiapp.py", line 67, in run
    WSGIApplication("%(prog)s [OPTIONS] [APP_MODULE]").run()
    └ <class 'gunicorn.app.wsgiapp.WSGIApplication'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 231, in run
    super().run()
  File "/usr/local/lib/python3.10/site-packages/gunicorn/app/base.py", line 72, in run
    Arbiter(self).run()
    │       └ <gunicorn.app.wsgiapp.WSGIApplication object at 0x7f834d84fee0>
    └ <class 'gunicorn.arbiter.Arbiter'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 202, in run
    self.manage_workers()
    │    └ <function Arbiter.manage_workers at 0x7f834cd12d40>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 551, in manage_workers
    self.spawn_workers()
    │    └ <function Arbiter.spawn_workers at 0x7f834cd12e60>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 622, in spawn_workers
    self.spawn_worker()
    │    └ <function Arbiter.spawn_worker at 0x7f834cd12dd0>
    └ <gunicorn.arbiter.Arbiter object at 0x7f834c84b850>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/arbiter.py", line 589, in spawn_worker
    worker.init_process()
    │      └ <function UvicornWorker.init_process at 0x7f834b31c0d0>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 66, in init_process
    super(UvicornWorker, self).init_process()
          │              └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
          └ <class 'uvicorn.workers.UvicornWorker'>
  File "/usr/local/lib/python3.10/site-packages/gunicorn/workers/base.py", line 142, in init_process
    self.run()
    │    └ <function UvicornWorker.run at 0x7f834b31c280>
    └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
  File "/usr/local/lib/python3.10/site-packages/uvicorn/workers.py", line 83, in run
    return asyncio.run(self._serve())
           │       │   │    └ <function UvicornWorker._serve at 0x7f834b31c1f0>
           │       │   └ <uvicorn.workers.UvicornWorker object at 0x7f834b6687c0>
           │       └ <function run at 0x7f834c8c1870>
           └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
           │    │                  └ <coroutine object UvicornWorker._serve at 0x7f834a218900>
           │    └ <method 'run_until_complete' of 'uvloop.loop.Loop' objects>
           └ <uvloop.Loop running=True closed=False debug=False>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/websocket_rpc_client.py", line 200, in reader
    await self.channel.on_message(raw_message)
          │    │       │          └ {'request': {'method': 'notify', 'arguments': {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8...
          │    │       └ <function RpcChannel.on_message at 0x7f834a700430>
          │    └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
          └ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f834a520f70>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 223, in on_message
    await self.on_request(message.request)
          │    │          │       └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
          │    │          └ RpcMessage(request=RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscri...
          │    └ <function RpcChannel.on_request at 0x7f834a700940>
          └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f834a21caf0>
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 314, in on_request
    result = await method(**message.arguments)
                   │        │       └ {'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'po...
                   │        └ RpcRequest(method='notify', arguments={'subscription': {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7...
                   └ <bound method RpcEventClientMethods.notify of <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7...
  File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/rpc_event_methods.py", line 89, in notify
    await self.client.trigger_topic(topic=subscription["topic"], data=data)
          │    │      │                   │                           └ {'old_policy_hash': '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83', 'new_policy_hash': '54868ac36ed99fe738a7d08e0fbc07e55c248397'...
          │    │      │                   └ {'id': '79838428f53644bdb5792ea4c783cde0', 'subscriber_id': '8054e63d7414422a8098fe4b41c55075', 'topic': 'policy:.', 'notifie...
          │    │      └ <function PubSubClient.trigger_topic at 0x7f834a659750>
          │    └ <fastapi_websocket_pubsub.pub_sub_client.PubSubClient object at 0x7f834a287190>
          └ <fastapi_websocket_pubsub.rpc_event_methods.RpcEventClientMethods object at 0x7f834a21cc10>
> File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/pub_sub_client.py", line 325, in trigger_topic
    await asyncio.gather(*futures)
          │       │       └ [<coroutine object PolicyUpdater._update_policy_callback at 0x7f8348103bc0>]
          │       └ <function gather at 0x7f834c91f2e0>
          └ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 145, in _update_policy_callback
    await self.update_policy(directories)
          │    │             └ ['.']
          │    └ <function PolicyUpdater.update_policy at 0x7f834a54a9e0>
          └ <opal_client.policy.updater.PolicyUpdater object at 0x7f834a55c070>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy/updater.py", line 311, in update_policy
    await store_transaction.set_policies(bundle)
          │                 │            └ PolicyBundle(manifest=['Service1/rbac.rego'], hash='54868ac36ed99fe738a7d08e0fbc07e55c248397', old_hash='1fb8e9a52f59ef198acd...
          │                 └ <function AbstractPolicyStore.set_policies at 0x7f834a65a320>
          └ <opal_client.policy_store.base_policy_store_client.PolicyStoreTransactionContextManager object at 0x7f834a2de530>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 346, in set_policies
    return await self._set_policies_from_delta_bundle(bundle)
                 │    │                               └ PolicyBundle(manifest=['Service1/rbac.rego'], hash='54868ac36ed99fe738a7d08e0fbc07e55c248397', old_hash='1fb8e9a52f59ef198acd...
                 │    └ <function OpaClient._set_policies_from_delta_bundle at 0x7f834a536050>
                 └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/opal_client-0.3.1-py3.10.egg/opal_client/policy_store/opa_client.py", line 386, in _set_policies_from_delta_bundle
    await self.set_policy(policy_id=module.path, policy_code=module.rego)
          │    │                    │      │                 │      └ '# Role-based Access Control (RBAC)\n# --------------------------------\n#\n# This example defines an RBAC model for a Pet St...
          │    │                    │      │                 └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    │                    │      └ 'Service1/rbac.rego'
          │    │                    └ RegoModule(path='Service1/rbac.rego', package_name='app.rbac', rego='# Role-based Access Control (RBAC)\n# ------------------...
          │    └ <function OpaClient.set_policy at 0x7f834a5356c0>
          └ <opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 86, in async_wrapped
    return await fn(*args, **kwargs)
                 │   │       └ {'policy_id': 'Service1/rbac.rego', 'policy_code': '# Role-based Access Control (RBAC)\n# --------------------------------\n#...
                 │   └ (<opal_client.policy_store.opa_client.OpaClient object at 0x7f834a55d7b0>,)
                 └ <function OpaClient.set_policy at 0x7f834a5355a0>
  File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 48, in __call__
    do = self.iter(retry_state=retry_state)
         │    │                └ <RetryCallState 140201861970816: attempt #2; slept for 2.0; last result: failed (ValueError OPA Client: unexpected status cod...
         │    └ <function BaseRetrying.iter at 0x7f834a797f40>
         └ <AsyncRetrying object at 0x7f834a55ccd0 (stop=<tenacity.stop.stop_after_attempt object at 0x7f834a55ce80>, wait=<tenacity.wai...
  File "/usr/local/lib/python3.10/site-packages/tenacity/__init__.py", line 363, in iter
    raise retry_exc from fut.exception()
          │              │   └ <function Future.exception at 0x7f834c8c36d0>
          │              └ <Future at 0x7f834a2ded40 state=finished raised ValueError>
          └ RetryError(<Future at 0x7f834a2ded40 state=finished raised ValueError>)

←[31m←[1mtenacity.RetryError←[0m:←[1m RetryError[<Future at 0x7f834a2ded40 state=finished raised ValueError>]←[0m
←[32m2023-01-11T06:50:41.251967+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:50:41.252290+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:51:17.009171+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:51:17.009558+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:51:18.694200+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:51:18.694700+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:51:23.408399+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:51:23.408870+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:51:24.599239+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:51:24.599865+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.854076+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:52:46.854276+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '54868ac36ed99fe738a7d08e0fbc07e55c248397', 'new_policy_hash': '02d22d1c2533dfdb9be6b297975a639ad947bc96', 'changed_directories': ['.']}←[0m
←[32m2023-01-11T06:52:46.854366+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '1fb8e9a52f59ef198acddaa3eb7a7e42f2222b83'←[0m
←[32m2023-01-11T06:52:46.854612+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:52:46.864365+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 6dde8b623fb3f81342c68262a5a1f5b5abe2f88f←[0m
←[32m2023-01-11T06:52:46.864561+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Got policy bundle with 2 rego files, 1 data files, commit hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:52:46.865514+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/policies←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.866996+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/policies -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.868024+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.868419+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/data -> 204←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.869326+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/utils.rego←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.869608+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/utils.rego -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.870626+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mPUT /v1/policies/rbac.rego←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.873269+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mPUT /v1/policies/rbac.rego -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.874292+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mDELETE /v1/policies/Service1/utils.rego←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.876715+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mDELETE /v1/policies/Service1/utils.rego -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:52:46.877639+0000←[0m | 7 | ←[34mfastapi_websocket_pubsub.rpc_event_me...←[0m|←[1m INFO  | Received notification of event←[0m
←[32m2023-01-11T06:52:46.877847+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Received policy update: topic=policy:., message={'old_policy_hash': '54868ac36ed99fe738a7d08e0fbc07e55c248397', 'new_policy_hash': '02d22d1c2533dfdb9be6b297975a639ad947bc96', 'changed_directories': ['.']}←[0m
←[32m2023-01-11T06:52:46.877947+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | Refetching policy code (delta bundle), base hash: '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:52:46.878128+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetching policy bundle from http://opal-server-loadbalancer:7002/policy←[0m
←[32m2023-01-11T06:52:46.888497+0000←[0m | 7 | ←[34mopal_client.policy.fetcher              ←[0m|←[1m INFO  | Fetched valid bundle, id: 6dde8b623fb3f81342c68262a5a1f5b5abe2f88f←[0m
←[32m2023-01-11T06:52:46.888666+0000←[0m | 7 | ←[34mopal_client.policy.updater              ←[0m|←[1m INFO  | got policy bundle (delta): '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f' -> '6dde8b623fb3f81342c68262a5a1f5b5abe2f88f'←[0m
←[32m2023-01-11T06:52:56.467945+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:52:56.468694+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T06:53:01.736075+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T06:53:01.736500+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T07:01:12.102271+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T07:01:12.102864+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m
←[32m2023-01-11T07:01:13.342324+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Received request.    ←[38;2;153;153;153mGET /v1/data←[0m←[1m←[0m
←[32m2023-01-11T07:01:13.343038+0000←[0m | 7 | ←[34mopal_client.opa.logger                  ←[0m|←[1m INFO  | Sent response.       ←[38;2;153;153;153mGET /v1/data -> 200←[0m←[1m←[0m