(sourcing) ➜ sourcing git:(SOURC-149--baseline-native-sla-flow) ✗ docker compose logs prefect-worker prefect-worker-1 | 22:54:03.416 | DEBUG | prefect.profiles - Using profile 'ephemeral' prefect-worker-1 | 22:54:03.516 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:54:03.547 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:54:03.556 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | Work pool 'default-agent-pool' does not exist and no worker type was provided. prefect-worker-1 | Starting a process worker... prefect-worker-1 | 22:54:03.674 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Entering worker context... prefect-worker-1 | 22:54:03.674 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Setting up worker... prefect-worker-1 | 22:54:03.678 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:54:03.694 | INFO | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Work pool 'default-agent-pool' created. prefect-worker-1 | 22:54:03.706 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:54:03.711 | DEBUG | prefect.runner - Starting runner... prefect-worker-1 | 22:54:03.716 | DEBUG | prefect.events.clients - Connecting to ws://prefect-api:4200/api/events/out prefect-worker-1 | 22:54:03.716 | DEBUG | prefect.events.clients - Reconnecting... prefect-worker-1 | 22:54:03.726 | DEBUG | prefect.events.clients - pinging... prefect-worker-1 | 22:54:03.726 | DEBUG | prefect.events.clients - authenticating... prefect-worker-1 | 22:54:03.726 | DEBUG | prefect.events.clients - auth result {'type': 'auth_success'} prefect-worker-1 | 22:54:03.726 | DEBUG | prefect.events.clients - filtering events since 2025-12-10 22:53:03.726958+00:00... prefect-worker-1 | 22:54:03.731 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:54:03.731 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:54:03.731 | DEBUG | prefect.events.clients - Reconnecting websocket connection. prefect-worker-1 | 22:54:03.731 | DEBUG | prefect.events.clients - Opening websocket connection. prefect-worker-1 | 22:54:03.733 | DEBUG | prefect.events.clients - Pinging to ensure websocket connected. prefect-worker-1 | 22:54:03.733 | DEBUG | prefect.events.clients - Pong received. Websocket connected. prefect-worker-1 | 22:54:03.733 | DEBUG | prefect.events.clients - Resending 0 unconfirmed events. prefect-worker-1 | 22:54:03.733 | DEBUG | prefect.events.clients - Finished resending unconfirmed events. prefect-worker-1 | 22:54:03.739 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | Worker 'ProcessWorker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9' started! prefect-worker-1 | 22:54:03.744 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:54:03.744 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:54:13.744468+00:00 prefect-worker-1 | 22:54:03.744 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:54:03.745 | DEBUG | prefect.events.clients - Reconnecting websocket connection. prefect-worker-1 | 22:54:03.746 | DEBUG | prefect.events.clients - Opening websocket connection. prefect-worker-1 | 22:54:03.748 | DEBUG | prefect.events.clients - Pinging to ensure websocket connected. prefect-worker-1 | 22:54:03.748 | DEBUG | prefect.events.clients - Pong received. Websocket connected. prefect-worker-1 | 22:54:03.749 | DEBUG | prefect.events.clients - Resending 0 unconfirmed events. prefect-worker-1 | 22:54:03.749 | DEBUG | prefect.events.clients - Finished resending unconfirmed events. prefect-worker-1 | 22:54:03.749 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:54:03.749 | WARNING | EventsWorker - Still processing items: 1 items remaining... prefect-worker-1 | 22:54:03.750 | DEBUG | prefect.events.clients - EventsClient(id=281473760033232): Emitting event id=019b0a78-bddd-73d0-82d2-f0f755b01703. prefect-worker-1 | 22:54:03.750 | DEBUG | prefect.events.clients - Added event id=019b0a78-bddd-73d0-82d2-f0f755b01703 to unconfirmed events list. There are now 1 unconfirmed events. prefect-worker-1 | 22:54:03.750 | DEBUG | prefect.events.clients - EventsClient(id=281473760033232): Emit reconnection attempt 0. prefect-worker-1 | 22:54:03.750 | DEBUG | prefect.events.clients - EventsClient(id=281473760033232): Sending event id=019b0a78-bddd-73d0-82d2-f0f755b01703. prefect-worker-1 | 22:54:03.750 | DEBUG | prefect.events.clients - EventsClient(id=281473760033232): Checkpointing event id=019b0a78-bddd-73d0-82d2-f0f755b01703. prefect-worker-1 | 22:54:03.764 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:54:03.770 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:54:11.927 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:54:11.930 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:54:21.930012+00:00 prefect-worker-1 | 22:54:11.955 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:54:20.406 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:54:20.407 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:54:30.407122+00:00 prefect-worker-1 | 22:54:20.422 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:54:30.043 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:54:30.045 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:54:40.045106+00:00 prefect-worker-1 | 22:54:30.076 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:54:33.708 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:54:33.732 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:54:42.674 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:54:42.675 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:54:52.675460+00:00 prefect-worker-1 | 22:54:42.693 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:54:55.286 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:54:55.290 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:55:05.290829+00:00 prefect-worker-1 | 22:54:55.316 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:55:00.175 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:55:00.204 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:55:05.116 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:55:05.117 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:55:15.117681+00:00 prefect-worker-1 | 22:55:05.138 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:55:16.390 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:55:16.392 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:55:26.392623+00:00 prefect-worker-1 | 22:55:16.416 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:55:27.975 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:55:27.977 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:55:37.977329+00:00 prefect-worker-1 | 22:55:27.996 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:55:31.397 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:55:31.405 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:55:36.406 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:55:36.408 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:55:46.407974+00:00 prefect-worker-1 | 22:55:36.434 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:55:47.898 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:55:47.899 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:55:57.899840+00:00 prefect-worker-1 | 22:55:47.923 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:55:58.246 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:55:58.257 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:55:59.363 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:55:59.365 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:56:09.365348+00:00 prefect-worker-1 | 22:55:59.386 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:56:09.429 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:56:09.431 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:56:19.431179+00:00 prefect-worker-1 | 22:56:09.455 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:56:22.053 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:56:22.057 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:56:32.057403+00:00 prefect-worker-1 | 22:56:22.104 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:56:29.804 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:56:29.824 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:56:31.054 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:56:31.055 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:56:41.055803+00:00 prefect-worker-1 | 22:56:31.080 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:56:38.815 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:56:38.817 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:56:48.816989+00:00 prefect-worker-1 | 22:56:38.845 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:56:51.176 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:56:51.178 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:57:01.178293+00:00 prefect-worker-1 | 22:56:51.200 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:57:03.809 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:57:03.810 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:57:13.810527+00:00 prefect-worker-1 | 22:57:03.830 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:57:03.845 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:57:03.857 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:57:15.583 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:57:15.585 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:57:25.585126+00:00 prefect-worker-1 | 22:57:15.627 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 1 scheduled_flow_runs prefect-worker-1 | 22:57:15.627 | INFO | prefect.flow_runs.worker - Worker 'ProcessWorker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9' submitting flow run '5a8cf754-bf30-41b2-9988-b10961ace75b' prefect-worker-1 | 22:57:15.641 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:57:15.655 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Ready to submit 5a8cf754-bf30-41b2-9988-b10961ace75b: True prefect-worker-1 | 22:57:15.677 | DEBUG | prefect.events.clients - Reconnecting websocket connection. prefect-worker-1 | 22:57:15.677 | DEBUG | prefect.events.clients - Opening websocket connection. prefect-worker-1 | 22:57:15.680 | DEBUG | prefect.events.clients - Pinging to ensure websocket connected. prefect-worker-1 | 22:57:15.681 | DEBUG | prefect.events.clients - Pong received. Websocket connected. prefect-worker-1 | 22:57:15.681 | DEBUG | prefect.events.clients - Resending 0 unconfirmed events. prefect-worker-1 | 22:57:15.681 | DEBUG | prefect.events.clients - Finished resending unconfirmed events. prefect-worker-1 | 22:57:15.681 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:57:15.681 | DEBUG | prefect.events.clients - EventsClient(id=281473766377104): Emitting event id=019b0a7b-ab98-70ed-b02b-40d9d5007417. prefect-worker-1 | 22:57:15.681 | DEBUG | prefect.events.clients - Added event id=019b0a7b-ab98-70ed-b02b-40d9d5007417 to unconfirmed events list. There are now 1 unconfirmed events. prefect-worker-1 | 22:57:15.681 | DEBUG | prefect.events.clients - EventsClient(id=281473766377104): Emit reconnection attempt 0. prefect-worker-1 | 22:57:15.682 | DEBUG | prefect.events.clients - EventsClient(id=281473766377104): Sending event id=019b0a7b-ab98-70ed-b02b-40d9d5007417. prefect-worker-1 | 22:57:15.682 | DEBUG | prefect.events.clients - EventsClient(id=281473766377104): Checkpointing event id=019b0a7b-ab98-70ed-b02b-40d9d5007417. prefect-worker-1 | 22:57:15.687 | INFO | prefect.flow_runs.runner - Opening process... prefect-worker-1 | 22:57:15.698 | DEBUG | prefect.FlowRunCancellingObserver - Adding in-flight flow run ID: 5a8cf754-bf30-41b2-9988-b10961ace75b prefect-worker-1 | 22:57:15.703 | INFO | prefect.flow_runs.worker - Completed submission of flow run '5a8cf754-bf30-41b2-9988-b10961ace75b' prefect-worker-1 | 22:57:16.141 | DEBUG | prefect.profiles - Using profile 'ephemeral' prefect-worker-1 | 22:57:16.168 | DEBUG | Flow run 'augmented-owl' - Running 1 deployment pull step(s) prefect-worker-1 | 22:57:16.174 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:57:16.175 | INFO | Flow run 'augmented-owl' - > Running set_working_directory step... prefect-worker-1 | 22:57:16.180 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:57:16.184 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:57:16.184 | DEBUG | prefect.events.clients - Reconnecting websocket connection. prefect-worker-1 | 22:57:16.185 | DEBUG | prefect.events.clients - Opening websocket connection. prefect-worker-1 | 22:57:16.186 | DEBUG | prefect.events.clients - Pinging to ensure websocket connected. prefect-worker-1 | 22:57:16.187 | DEBUG | prefect.events.clients - Pong received. Websocket connected. prefect-worker-1 | 22:57:16.187 | DEBUG | prefect.events.clients - Resending 0 unconfirmed events. prefect-worker-1 | 22:57:16.187 | DEBUG | prefect.events.clients - Finished resending unconfirmed events. prefect-worker-1 | 22:57:16.188 | DEBUG | prefect.events.clients - EventsClient(id=281473460987152): Emitting event id=019b0a7b-ad9c-729d-83d3-f5de98af4eec. prefect-worker-1 | 22:57:16.188 | DEBUG | prefect.events.clients - Added event id=019b0a7b-ad9c-729d-83d3-f5de98af4eec to unconfirmed events list. There are now 1 unconfirmed events. prefect-worker-1 | 22:57:16.189 | DEBUG | prefect.events.clients - EventsClient(id=281473460987152): Emit reconnection attempt 0. prefect-worker-1 | 22:57:16.189 | DEBUG | prefect.events.clients - EventsClient(id=281473460987152): Sending event id=019b0a7b-ad9c-729d-83d3-f5de98af4eec. prefect-worker-1 | 22:57:16.189 | DEBUG | prefect.events.clients - EventsClient(id=281473460987152): Checkpointing event id=019b0a7b-ad9c-729d-83d3-f5de98af4eec. prefect-worker-1 | 22:57:16.189 | DEBUG | prefect.events.clients - Pinging to checkpoint unconfirmed events. prefect-worker-1 | 22:57:16.190 | DEBUG | prefect.events.clients - EventsClient(id=281473460987152): Pong received. Events checkpointed. prefect-worker-1 | 22:57:16.190 | DEBUG | Flow run 'augmented-owl' - Changing working directory to '/app' prefect-worker-1 | 22:57:16.190 | DEBUG | Flow run 'augmented-owl' - Importing flow code from 'sourcing/sla/test_flow.py:test_task_visibility_flow' prefect-worker-1 | 22:57:16.207 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:57:16.226 | DEBUG | prefect.task_runner.threadpool - Starting task runner prefect-worker-1 | 22:57:16.227 | INFO | Flow run 'augmented-owl' - Beginning flow run 'augmented-owl' for flow 'test-task-visibility-flow' prefect-worker-1 | 22:57:16.227 | INFO | Flow run 'augmented-owl' - View at http://prefect-api:4200/runs/flow-run/5a8cf754-bf30-41b2-9988-b10961ace75b prefect-worker-1 | 22:57:16.227 | DEBUG | Flow run 'augmented-owl' - Executing flow 'test-task-visibility-flow' for flow run 'augmented-owl'... prefect-worker-1 | 22:57:16.228 | INFO | Flow run 'augmented-owl' - Flow starting with input: test prefect-worker-1 | 22:57:16.254 | DEBUG | Task run 'task_one-ce0' - Created task run 'task_one-ce0' for task 'task_one' prefect-worker-1 | 22:57:16.254 | DEBUG | Task run 'task_one-ce0' - Executing task 'task_one' for task run 'task_one-ce0'... prefect-worker-1 | 22:57:16.255 | INFO | Task run 'task_one-ce0' - Task one starting with value: test prefect-worker-1 | 22:57:16.259 | DEBUG | prefect.events.clients - Reconnecting websocket connection. prefect-worker-1 | 22:57:16.259 | DEBUG | prefect.events.clients - Opening websocket connection. prefect-worker-1 | 22:57:16.261 | DEBUG | prefect.events.clients - Pinging to ensure websocket connected. prefect-worker-1 | 22:57:16.261 | DEBUG | prefect.events.clients - Pong received. Websocket connected. prefect-worker-1 | 22:57:16.261 | DEBUG | prefect.events.clients - Resending 0 unconfirmed events. prefect-worker-1 | 22:57:16.261 | DEBUG | prefect.events.clients - Finished resending unconfirmed events. prefect-worker-1 | 22:57:16.262 | DEBUG | prefect.client - Connecting to API at http://prefect-api:4200/api/ prefect-worker-1 | 22:57:16.280 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-addb-7f50-b8aa-895ed165d514. prefect-worker-1 | 22:57:16.280 | DEBUG | prefect.events.clients - Added event id=019b0a7b-addb-7f50-b8aa-895ed165d514 to unconfirmed events list. There are now 1 unconfirmed events. prefect-worker-1 | 22:57:16.280 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:16.280 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-addb-7f50-b8aa-895ed165d514. prefect-worker-1 | 22:57:16.281 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-addb-7f50-b8aa-895ed165d514. prefect-worker-1 | 22:57:16.281 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-adde-7c43-a4d6-e3757522da64. prefect-worker-1 | 22:57:16.281 | DEBUG | prefect.events.clients - Added event id=019b0a7b-adde-7c43-a4d6-e3757522da64 to unconfirmed events list. There are now 2 unconfirmed events. prefect-worker-1 | 22:57:16.281 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:16.281 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-adde-7c43-a4d6-e3757522da64. prefect-worker-1 | 22:57:16.282 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-adde-7c43-a4d6-e3757522da64. prefect-worker-1 | 22:57:19.259 | INFO | Task run 'task_one-ce0' - Task one complete prefect-worker-1 | 22:57:19.260 | INFO | Task run 'task_one-ce0' - Finished in state Completed() prefect-worker-1 | 22:57:19.262 | DEBUG | Task run 'task_two-fe3' - Created task run 'task_two-fe3' for task 'task_two' prefect-worker-1 | 22:57:19.263 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-b99c-75b2-afbc-656c87d0bdb3. prefect-worker-1 | 22:57:19.263 | DEBUG | Task run 'task_two-fe3' - Executing task 'task_two' for task run 'task_two-fe3'... prefect-worker-1 | 22:57:19.264 | DEBUG | prefect.events.clients - Added event id=019b0a7b-b99c-75b2-afbc-656c87d0bdb3 to unconfirmed events list. There are now 3 unconfirmed events. prefect-worker-1 | 22:57:19.265 | INFO | Task run 'task_two-fe3' - Task two starting with value: test prefect-worker-1 | 22:57:19.266 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:19.266 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-b99c-75b2-afbc-656c87d0bdb3. prefect-worker-1 | 22:57:19.266 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-b99c-75b2-afbc-656c87d0bdb3. prefect-worker-1 | 22:57:19.267 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-b99d-7a54-ac26-b1eb5594649e. prefect-worker-1 | 22:57:19.267 | DEBUG | prefect.events.clients - Added event id=019b0a7b-b99d-7a54-ac26-b1eb5594649e to unconfirmed events list. There are now 4 unconfirmed events. prefect-worker-1 | 22:57:19.268 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:19.268 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-b99d-7a54-ac26-b1eb5594649e. prefect-worker-1 | 22:57:19.268 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-b99d-7a54-ac26-b1eb5594649e. prefect-worker-1 | 22:57:19.269 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-b99f-71ce-980f-35e61fdc8434. prefect-worker-1 | 22:57:19.270 | DEBUG | prefect.events.clients - Added event id=019b0a7b-b99f-71ce-980f-35e61fdc8434 to unconfirmed events list. There are now 5 unconfirmed events. prefect-worker-1 | 22:57:19.270 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:19.270 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-b99f-71ce-980f-35e61fdc8434. prefect-worker-1 | 22:57:19.270 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-b99f-71ce-980f-35e61fdc8434. prefect-worker-1 | 22:57:24.273 | INFO | Task run 'task_two-fe3' - Task two complete prefect-worker-1 | 22:57:24.281 | INFO | Task run 'task_two-fe3' - Finished in state Completed() prefect-worker-1 | 22:57:24.285 | DEBUG | Task run 'task_three-0cc' - Created task run 'task_three-0cc' for task 'task_three' prefect-worker-1 | 22:57:24.288 | DEBUG | Task run 'task_three-0cc' - Executing task 'task_three' for task run 'task_three-0cc'... prefect-worker-1 | 22:57:24.289 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-cd36-730a-9215-25a512291cdb. prefect-worker-1 | 22:57:24.290 | DEBUG | prefect.events.clients - Added event id=019b0a7b-cd36-730a-9215-25a512291cdb to unconfirmed events list. There are now 6 unconfirmed events. prefect-worker-1 | 22:57:24.290 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:24.291 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-cd36-730a-9215-25a512291cdb. prefect-worker-1 | 22:57:24.292 | INFO | Task run 'task_three-0cc' - Task three combining: one-test + two-test prefect-worker-1 | 22:57:24.294 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-cd36-730a-9215-25a512291cdb. prefect-worker-1 | 22:57:24.296 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-cd3d-7947-a469-96cd14b8d425. prefect-worker-1 | 22:57:24.296 | DEBUG | prefect.events.clients - Added event id=019b0a7b-cd3d-7947-a469-96cd14b8d425 to unconfirmed events list. There are now 7 unconfirmed events. prefect-worker-1 | 22:57:24.296 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:24.297 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-cd3d-7947-a469-96cd14b8d425. prefect-worker-1 | 22:57:24.297 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-cd3d-7947-a469-96cd14b8d425. prefect-worker-1 | 22:57:24.298 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-cd3f-769d-b435-c87afacfc027. prefect-worker-1 | 22:57:24.298 | DEBUG | prefect.events.clients - Added event id=019b0a7b-cd3f-769d-b435-c87afacfc027 to unconfirmed events list. There are now 8 unconfirmed events. prefect-worker-1 | 22:57:24.299 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:24.299 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-cd3f-769d-b435-c87afacfc027. prefect-worker-1 | 22:57:24.300 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-cd3f-769d-b435-c87afacfc027. prefect-worker-1 | 22:57:26.296 | INFO | Task run 'task_three-0cc' - Task three complete: one-test|two-test prefect-worker-1 | 22:57:26.297 | INFO | Task run 'task_three-0cc' - Finished in state Completed() prefect-worker-1 | 22:57:26.298 | INFO | Flow run 'augmented-owl' - Flow complete with result: one-test|two-test prefect-worker-1 | 22:57:26.299 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emitting event id=019b0a7b-d519-7891-8aff-adcb8ee19b36. prefect-worker-1 | 22:57:26.299 | DEBUG | prefect.events.clients - Added event id=019b0a7b-d519-7891-8aff-adcb8ee19b36 to unconfirmed events list. There are now 9 unconfirmed events. prefect-worker-1 | 22:57:26.300 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Emit reconnection attempt 0. prefect-worker-1 | 22:57:26.300 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Sending event id=019b0a7b-d519-7891-8aff-adcb8ee19b36. prefect-worker-1 | 22:57:26.301 | DEBUG | prefect.events.clients - EventsClient(id=281473444545232): Checkpointing event id=019b0a7b-d519-7891-8aff-adcb8ee19b36. prefect-worker-1 | 22:57:26.335 | DEBUG | prefect.task_runner.threadpool - Stopping task runner prefect-worker-1 | 22:57:26.336 | INFO | Flow run 'augmented-owl' - Finished in state Completed() prefect-worker-1 | 22:57:26.426 | INFO | prefect.flow_runs.runner - Process for flow run 'augmented-owl' exited cleanly. prefect-worker-1 | 22:57:26.428 | DEBUG | prefect.FlowRunCancellingObserver - Removing in-flight flow run ID: 5a8cf754-bf30-41b2-9988-b10961ace75b prefect-worker-1 | 22:57:26.531 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Limit slot released for flow run '5a8cf754-bf30-41b2-9988-b10961ace75b' prefect-worker-1 | 22:57:26.532 | DEBUG | prefect.events.clients - EventsClient(id=281473766377104): Emitting event id=019b0a7b-d604-7d57-bbad-935d3c8cebe3. prefect-worker-1 | 22:57:26.532 | DEBUG | prefect.events.clients - Added event id=019b0a7b-d604-7d57-bbad-935d3c8cebe3 to unconfirmed events list. There are now 2 unconfirmed events. prefect-worker-1 | 22:57:26.533 | DEBUG | prefect.events.clients - EventsClient(id=281473766377104): Emit reconnection attempt 0. prefect-worker-1 | 22:57:26.533 | DEBUG | prefect.events.clients - EventsClient(id=281473766377104): Sending event id=019b0a7b-d604-7d57-bbad-935d3c8cebe3. prefect-worker-1 | 22:57:26.533 | DEBUG | prefect.events.clients - EventsClient(id=281473766377104): Checkpointing event id=019b0a7b-d604-7d57-bbad-935d3c8cebe3. prefect-worker-1 | 22:57:27.468 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:57:27.497 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server. prefect-worker-1 | 22:57:27.743 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:57:27.744 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:57:37.744416+00:00 prefect-worker-1 | 22:57:27.769 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:57:39.898 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:57:39.900 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:57:49.900648+00:00 prefect-worker-1 | 22:57:39.937 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:57:50.560 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:57:50.562 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:58:00.562119+00:00 prefect-worker-1 | 22:57:50.586 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:57:58.748 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'get_and_submit_flow_runs' prefect-worker-1 | 22:57:58.750 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Querying for flow runs scheduled before 2025-12-10 22:58:08.750339+00:00 prefect-worker-1 | 22:57:58.774 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Discovered 0 scheduled_flow_runs prefect-worker-1 | 22:58:00.218 | DEBUG | prefect.utilities.services.critical_service_loop - Starting run of 'sync_with_backend' prefect-worker-1 | 22:58:00.231 | DEBUG | prefect.workers.process.processworker abf6f3c3-9a7c-4be6-b0ef-3d45f8d1bec9 - Worker synchronized with the Prefect API server.