bug(poller): not able to handle large payloads (regression) #494

New issue

Closed

opened 2026-03-28 04:25:04 +00:00 by mfreeman451 · 0 comments

mfreeman451 commented

2026-03-28 04:25:04 +00:00

Owner

Imported from GitHub.

Original GitHub issue: #1463
Original author: @mfreeman451
Original URL: https://github.com/carverauto/serviceradar/issues/1463
Original created: 2025-08-04T18:58:03Z

p":"2025-08-04T13:53:33-05:00","time":"2025-08-04T13:53:33-05:00","message":"Reporting statuses"}
Aug 04 13:53:53 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","time":"2025-08-04T13:53:53-05:00","message":"Starting polling cycle"}
Aug 04 13:54:03 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","agent":"local-agent","service_name":"sync","time":"2025-08-04T13:54:03-05:00","message":"Executing results poller"}
Aug 04 13:54:03 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","service_type":"grpc","serviceTypeSync":"sync","should_use_streaming":true,"type_equals_sync":false,"name_equals_sync":true,"name_contains_sync":true,"time":"2025-08-04T13:54:03-05:00","message":"Routing decision for service"}
Aug 04 13:54:03 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","service_type":"grpc","time":"2025-08-04T13:54:03-05:00","message":"Using streaming method for large dataset service"}
Aug 04 13:54:03 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","service_type":"grpc","time":"2025-08-04T13:54:03-05:00","message":"Starting StreamResults call"}
Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","total_chunks":14,"time":"2025-08-04T13:54:04-05:00","message":"Received final chunk"}
Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","total_chunks":14,"data_size_bytes":10594873,"time":"2025-08-04T13:54:04-05:00","message":"Successfully received all chunks from stream"}
Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","service_type":"grpc","time":"2025-08-04T13:54:04-05:00","message":"convertToServiceStatus called"}
Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","original_service_type":"grpc","converted_service_type":"sync","has_new_data":true,"sequence":"1754333532","data_length":10594873,"time":"2025-08-04T13:54:04-05:00","message":"Converting sync service results to ServiceStatus for core submission"}
Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","total_statuses":6,"time":"2025-08-04T13:54:04-05:00","message":"Polling cycle completed"}
Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","statusCount":6,"pollerID":"foobar","timestamp":"2025-08-04T13:54:04-05:00","time":"2025-08-04T13:54:04-05:00","message":"Reporting statuses"}
Aug 04 13:54:07 foobar.com serviceradar-poller[28589]: {"level":"error","component":"poller","error":"failed to report serviceStatus to core: all 3 retries failed: rpc error: code = ResourceExhausted desc = grpc: received message larger than max (10714912 vs. 4194304)","time":"2025-08-04T13:54:07-05:00","message":"Error during poll"}
Aug 04 13:54:23 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","time":"2025-08-04T13:54:23-05:00","message":"Starting polling cycle"}
Aug 04 13:54:33 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","total_statuses":5,"time":"2025-08-04T13:54:33-05:00","message":"Polling cycle completed"}
Aug 04 13:54:34 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","statusCount":5,"pollerID":"foobar","timestamp":"2025-08-04T13:54:33-05:00","time":"2025-08-04T13:54:33-05:00","message":"Reporting statuses"}

Imported from GitHub. Original GitHub issue: #1463 Original author: @mfreeman451 Original URL: https://github.com/carverauto/serviceradar/issues/1463 Original created: 2025-08-04T18:58:03Z --- ``` p":"2025-08-04T13:53:33-05:00","time":"2025-08-04T13:53:33-05:00","message":"Reporting statuses"} Aug 04 13:53:53 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","time":"2025-08-04T13:53:53-05:00","message":"Starting polling cycle"} Aug 04 13:54:03 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","agent":"local-agent","service_name":"sync","time":"2025-08-04T13:54:03-05:00","message":"Executing results poller"} Aug 04 13:54:03 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","service_type":"grpc","serviceTypeSync":"sync","should_use_streaming":true,"type_equals_sync":false,"name_equals_sync":true,"name_contains_sync":true,"time":"2025-08-04T13:54:03-05:00","message":"Routing decision for service"} Aug 04 13:54:03 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","service_type":"grpc","time":"2025-08-04T13:54:03-05:00","message":"Using streaming method for large dataset service"} Aug 04 13:54:03 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","service_type":"grpc","time":"2025-08-04T13:54:03-05:00","message":"Starting StreamResults call"} Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","total_chunks":14,"time":"2025-08-04T13:54:04-05:00","message":"Received final chunk"} Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","total_chunks":14,"data_size_bytes":10594873,"time":"2025-08-04T13:54:04-05:00","message":"Successfully received all chunks from stream"} Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","service_type":"grpc","time":"2025-08-04T13:54:04-05:00","message":"convertToServiceStatus called"} Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","service_name":"sync","original_service_type":"grpc","converted_service_type":"sync","has_new_data":true,"sequence":"1754333532","data_length":10594873,"time":"2025-08-04T13:54:04-05:00","message":"Converting sync service results to ServiceStatus for core submission"} Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","total_statuses":6,"time":"2025-08-04T13:54:04-05:00","message":"Polling cycle completed"} Aug 04 13:54:04 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","statusCount":6,"pollerID":"foobar","timestamp":"2025-08-04T13:54:04-05:00","time":"2025-08-04T13:54:04-05:00","message":"Reporting statuses"} Aug 04 13:54:07 foobar.com serviceradar-poller[28589]: {"level":"error","component":"poller","error":"failed to report serviceStatus to core: all 3 retries failed: rpc error: code = ResourceExhausted desc = grpc: received message larger than max (10714912 vs. 4194304)","time":"2025-08-04T13:54:07-05:00","message":"Error during poll"} Aug 04 13:54:23 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","time":"2025-08-04T13:54:23-05:00","message":"Starting polling cycle"} Aug 04 13:54:33 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","total_statuses":5,"time":"2025-08-04T13:54:33-05:00","message":"Polling cycle completed"} Aug 04 13:54:34 foobar.com serviceradar-poller[28589]: {"level":"info","component":"poller","statusCount":5,"pollerID":"foobar","timestamp":"2025-08-04T13:54:33-05:00","time":"2025-08-04T13:54:33-05:00","message":"Reporting statuses"} ```

Rows
Columns