Is anyone else seeing a lot of skipped signage points today? I have two relatively independent full nodes and both got super flaky about 10h ago. Before today I might have seen a warning about skipped signage points once every few days. Today I think I’m approaching about 100 warnings per node.
It’s like I’m connected to super low quality peers or something. Is anyone else having problems today?
Transactions launched today which really stressed all full nodes. If you weren’t running the full node on moderate hardware then this issue happened. Gene recommended to turn down the allowable peers in the config of the full node in order to keep up. It looks like it has settle back down though.
I started running chiadog today and these are being highlighted constantly …
2021-05-11 21:06:53] [ INFO] --- Probably out of order signage point IDs 30 and 6 with timestamps 2021-05-11 21:06:50.169000 and 2021-05-11 21:06:53.423000 (calculate_skipped_signage_points.py:22)
[2021-05-11 21:06:53] [ INFO] --- Probably out of order signage point IDs 7 and 5 with timestamps 2021-05-11 21:06:53.502000 and 2021-05-11 21:06:53.741000 (calculate_skipped_signage_points.py:22)
[2021-05-11 21:06:53] [ INFO] --- Probably out of order signage point IDs 7 and 5 with timestamps 2021-05-11 21:06:53.502000 and 2021-05-11 21:06:53.741000 (calculate_skipped_signage_points.py:22)
[2021-05-11 21:06:54] [ INFO] --- Probably out of order signage point IDs 5 and 2 with timestamps 2021-05-11 21:06:53.741000 and 2021-05-11 21:06:54.205000 (calculate_skipped_signage_points.py:22)
I have “passable” challenge times considering the plots are spread across samba and come from a mix of Linux and Windows plotters:
21:06:46.123 1 plots were eligible Found 0 : 2.67107 s. Total 908 plots
21:06:46.124 3 plots were eligible Found 0 : 3.59179 s. Total 908 plots
21:06:46.124 4 plots were eligible Found 0 : 1.54575 s. Total 908 plots
I run a single node, farmer and access al plots over a mix of local storage and Samba
What does it mean and is it a problem ?
FYI I’ve formatted your logs. Do have a look out for the </> button in the toolbar to help make things readable. 
I don’t think I get many out of order signage points like that, but I regularly get skipped signage points. I’ve been ignoring it. It’s usually less than 1% per day which still sounds high to me, but I don’t think there’s much can be done about it. I’m assuming it’s an issue with the Chia network. I’d be happy to be proven wrong if someone has a better explanation.
This is NOT my project - every now and again I get “blips” when checking plots drops out for maybe 10 seconds. I assumed this was network issues but it was odd because no other machines exhibited problems.
About an hour ago my main farmer crashed and my main boot/root looks to have failed !!!
Luckily i had a backup from a few days ago so i just had to latest software , plot directories and am waiting for it to finish syncing …
Bottom line is that was POSSIBLY the regularish blip i was seeing and looks like the signage was correlated with 20 second check timeouts a handful of times a day
Lets hope it was just the disk failing …
On Chiadog I see a lot of errors during last days:
<
hi,
I am using chiadog, and I see that I am loosing a lot of “signage points” almost every hour.
Does that mean that I am loosing the opportunity to farm a block?
[2021-05-12 09:12:07] [ INFO] — Probably out of order signage point IDs 8 and 1 with timestamps 2021-05-12 09:12:07.301000 and 2021-05-12 09:12:07.319000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:07] [ INFO] — Probably out of order signage point IDs 8 and 1 with timestamps 2021-05-12 09:12:07.301000 and 2021-05-12 09:12:07.319000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:07] [ INFO] — Probably out of order signage point IDs 1 and 3 with timestamps 2021-05-12 09:12:07.319000 and 2021-05-12 09:12:07.335000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:07] [ INFO] — Probably out of order signage point IDs 1 and 3 with timestamps 2021-05-12 09:12:07.319000 and 2021-05-12 09:12:07.335000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:07] [ INFO] — Probably out of order signage point IDs 3 and 2 with timestamps 2021-05-12 09:12:07.335000 and 2021-05-12 09:12:07.339000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:07] [ INFO] — Probably out of order signage point IDs 3 and 2 with timestamps 2021-05-12 09:12:07.335000 and 2021-05-12 09:12:07.339000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:07] [ INFO] — Probably out of order signage point IDs 2 and 12 with timestamps 2021-05-12 09:12:07.339000 and 2021-05-12 09:12:07.435000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:07] [ INFO] — Probably out of order signage point IDs 2 and 12 with timestamps 2021-05-12 09:12:07.339000 and 2021-05-12 09:12:07.435000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:13] [ INFO] — Probably out of order signage point IDs 12 and 14 with timestamps 2021-05-12 09:12:07.435000 and 2021-05-12 09:12:13.860000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:13] [ INFO] — Probably out of order signage point IDs 12 and 14 with timestamps 2021-05-12 09:12:07.435000 and 2021-05-12 09:12:13.860000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:15] [ INFO] — Probably out of order signage point IDs 14 and 13 with timestamps 2021-05-12 09:12:13.860000 and 2021-05-12 09:12:15.851000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:15] [ INFO] — Probably out of order signage point IDs 14 and 13 with timestamps 2021-05-12 09:12:13.860000 and 2021-05-12 09:12:15.851000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:21] [ INFO] — Probably out of order signage point IDs 13 and 15 with timestamps 2021-05-12 09:12:15.851000 and 2021-05-12 09:12:21.897000 (calculate_skipped_signage_points.py:22)
[2021-05-12 09:12:21] [ INFO] — Probably out of order signage point IDs 13 and 15 with timestamps 2021-05-12 09:12:15.851000 and 2021-05-12 09:12:21.897000 (calculate_skipped_signage_points.py:22)
What does errors mean?
Am I loosing my opportunity to farm a block?