Signage point storms?

Not sure if I understand how signage points are supposed to work. I thought they’d be coming roughly every 8-10 seconds. And ok, if the node has trouble keeping up with the network, then some signage points can be seen delayed or even missed. But today I’ve observed a new behaviour, where dozens of signage points come in within a few seconds, even when the previous signage points came in regularly (so they don’t seem to be a bunch of delayed ones). Below is a log from earlier today (times are UTC+1), you can see the points coming regularly, but then at 10:09:48 there are dozens coming in within ~20 seconds, and after that it normalizes again. There’ve been several such “storms” today, according to my logs.

Is anyone else seeing this? Is it something to worry about?

I’ve checked the associated “plots eligible” log lines, and the number of plots passing the filter differs between these bunched-up signage points, so they don’t seem to be multiple copies of the same signage point.

2021-05-10T10:07:00.214 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:07:07.874 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:07:19.071 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:07:30.515 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:07:38.350 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:07:47.965 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:07:55.684 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:08:04.278 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:08:13.728 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:08:21.375 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:08:29.540 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:08:46.008 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:08:54.048 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:03.349 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:11.692 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:21.382 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:29.577 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:38.238 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.149 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.312 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.351 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.454 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.540 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.576 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.760 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.792 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:48.932 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.046 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.078 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.198 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.230 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.230 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.230 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.482 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.584 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.949 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.983 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:49.983 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:50.189 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:50.987 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:51.241 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:51.271 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:51.397 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:51.431 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:51.432 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:52.025 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:52.392 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:52.423 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:52.932 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:53.269 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:53.302 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:53.551 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:53.937 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:57.428 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:57.477 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:57.692 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:59.193 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:59.454 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:59.727 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:09:59.976 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:00.512 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:00.718 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:01.099 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:01.344 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:01.716 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:01.749 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:02.102 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:03.146 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:05.996 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:08.538 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:08.959 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:08.990 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:09.177 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:09.533 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:09.742 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:10.075 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:10.457 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:10.488 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:16.470 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:26.789 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:38.929 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:46.992 harvester harvester_server : INFO <- new_signage_point_harvester from peer
2021-05-10T10:10:55.180 harvester harvester_server : INFO <- new_signage_point_harvester from peer

(These logs are from a remote harvester, the full node has similar logs with “new_signage_point from peer”.)

There was a big network disruption yesterday. Not sure if this is some fallout from that.

1 Like

Yes, it could be related to yesterday’s disruption. Perhaps the network has some catching up to do? Though I wouldn’t expect that to happen in such a “bursty” fashion.

To make it more clear what I’m seeing, I’ve analysed the current log file (starting 04:35 UTC) and plotted how many SPs there are per minute:

1 Like