Full_node and wallet failed to start after upgrade to 1.2.11 (b74a3f3)

Env: Ubuntu 20.04 , running on git working copy.

Today I upgrade my chia box from 1.1.7 (b075e5bb8) to 1.2.11 (b74a3f3).
But failed to start full_node and wallet after upgrading.

(venv) xiaogang@xiaogang-chia1:~/chia-blockchain$ chia start node
chia_full_node: started
(venv) xiaogang@xiaogang-chia1:~/chia-blockchain$ ps axu | grep chia
avahi       1072  0.0  0.0   8680  2356 ?        Ss   6月09   1:25 avahi-daemon: running [xiaogang-chia1.local]
xiaogang 3272496  0.1  0.1 456884 65000 ?        Sl   15:54   0:06 chia_daemon
xiaogang 3277270 21.7  0.0      0     0 ?        Z    16:59   0:00 [chia_full_node] <defunct>
xiaogang 3277273  0.0  0.0  17676  2700 pts/0    S+   16:59   0:00 grep --color=auto chia

It is weird that no log output in $HOME/.chia/mainnet/log/debug.log
I guess something unexpected happened before ‘logger’ got inited.

Then I found that, if I start chia daemon in systemd service (the way I used to start chia),
I can see some system journal related to this issue.
My systemd service warpper likes:

. ~/chia-blockchain/activate
chia start farmer

and in 【journalctl -u chia.service】, I got:

16:59:15 [3277270]: Traceback (most recent call last):
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/bin/chia_full_node", line 33, in <module>
16:59:15 [3277270]:     sys.exit(load_entry_point('chia-blockchain', 'console_scripts', 'chia_full_node')())
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/bin/chia_full_node", line 25, in importlib_load_entry_point
16:59:15 [3277270]:     return next(matches).load()
16:59:15 [3277270]:   File "/usr/lib/python3.8/importlib/metadata.py", line 77, in load
16:59:15 [3277270]:     module = import_module(match.group('module'))
16:59:15 [3277270]:   File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module
16:59:15 [3277270]:     return _bootstrap._gcd_import(name[level:], package, level)
16:59:15 [3277270]:   File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
16:59:15 [3277270]:   File "<frozen importlib._bootstrap>", line 991, in _find_and_load
16:59:15 [3277270]:   File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
16:59:15 [3277270]:   File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
16:59:15 [3277270]:   File "<frozen importlib._bootstrap_external>", line 848, in exec_module
16:59:15 [3277270]:   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/chia/server/start_full_node.py", line 8, in <module>
16:59:15 [3277270]:     from chia.full_node.full_node import FullNode
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/chia/full_node/full_node.py", line 14, in <module>
16:59:15 [3277270]:     from chia.consensus.block_creation import unfinished_block_to_full_block
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/chia/consensus/block_creation.py", line 16, in <module>
16:59:15 [3277270]:     from chia.full_node.mempool_check_conditions import get_name_puzzle_conditions
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/chia/full_node/mempool_check_conditions.py", line 7, in <module>
16:59:15 [3277270]:     from chia.full_node.generator import create_generator_args, setup_generator_args
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/chia/full_node/generator.py", line 7, in <module>
16:59:15 [3277270]:     from chia.wallet.puzzles.rom_bootstrap_generator import get_generator
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/chia/wallet/puzzles/rom_bootstrap_generator.py", line 5, in <module>
16:59:15 [3277270]:     MOD = SerializedProgram.from_bytes(load_clvm("rom_bootstrap_generator.clvm").as_bin())
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/chia/wallet/puzzles/load_clvm.py", line 82, in load_clvm
16:59:15 [3277270]:     return Program.from_bytes(bytes(load_serialized_clvm(clvm_filename, package_or_requirement=package_or_requirement)))
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/chia/wallet/puzzles/load_clvm.py", line 70, in load_serialized_clvm
16:59:15 [3277270]:     compile_clvm(full_path, output, search_paths=[full_path.parent])
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/clvm_tools/clvmc.py", line 29, in compile_clvm
16:59:15 [3277270]:     result = compile_clvm_text(text, search_paths)
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/clvm_tools/clvmc.py", line 20, in compile_clvm_text
16:59:15 [3277270]:     cost, result = run_program(stage_2.run, input_sexp)
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/stages/stage_2/operators.py", line 52, in run_program
16:59:15 [3277270]:     return run_program_0(
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/stages/stage_0.py", line 23, in run_program
16:59:15 [3277270]:     return default_run_program(
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/clvm/run_program.py", line 182, in run_program
16:59:15 [3277270]:     cost += f(op_stack, value_stack)
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/clvm/run_program.py", line 172, in apply_op
16:59:15 [3277270]:     additional_cost, r = operator_lookup(op, operand_list)
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/clvm/operators.py", line 195, in __call__
16:59:15 [3277270]:     return f(arguments)
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/stages/stage_2/compile.py", line 178, in do_com
16:59:15 [3277270]:     return 1, do_com_prog(prog, macro_lookup, symbol_table, run_program)
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/stages/stage_2/compile.py", line 137, in do_com_prog
16:59:15 [3277270]:     post_prog = f(prog.rest(), macro_lookup, symbol_table, run_program)
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/stages/stage_2/mod.py", line 246, in compile_mod
16:59:15 [3277270]:     build_symbol_dump(all_constants_lookup, run_program, "main.sym")
16:59:15 [3277270]:   File "/home/xiaogang/chia-blockchain/venv/lib/python3.8/site-packages/clvm_tools/debug.py", line 111, in build_symbol_dump
16:59:15 [3277270]:     with open(path, "w") as f:
16:59:15 [3277270]: PermissionError: [Errno 13] Permission denied: 'main.sym'

I have no idea about ‘main.sym’, I ‘find’ it in ‘venv’ dir, but found no one.

Now I stucked :frowning:
Any hint will help, thanks in advance.

I would reboot to get rid of the Zombie process and then go with
. ./activate
chia start farmer
In the chia blockchain folder.

If that doesn’t work then try installing again

1 Like

I figured out the cause.
‘main.sym’ will be created while ‘chia init’ creates $HOME/.chia/mainnet.

If I upgrade chia, $HOME/.chia/mainnet remains, and ‘chia init’ saids that ‘no need to create mainnet …’
so I didn’t get ‘main.sym’.

I just moved $HOME/.chia/mainnet away, and ‘chia init’ again, and then everything became normal. :slight_smile:

1 Like

And this is why you have flexfarmer in reserve so you can start it up like a spare tire and keep farming while you diagnose your node problems :smiley: