Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Synchronization is taking too much time #2951

Open
nmnenkov opened this issue Nov 13, 2024 · 9 comments
Open

Synchronization is taking too much time #2951

nmnenkov opened this issue Nov 13, 2024 · 9 comments

Comments

@nmnenkov
Copy link

Hello All,

I'm trying to sync conflux client version 2.4.0 (full node). The process for chunks download is very slow. Some time for 1 hour the client is downloading less than 100 chunks.

I see that the number of the peers is changed very fast. Most of the time it is going from 50 to 0 in less than 20 minutes.

I have a perfect internet connection with high bandwidth.

I have created some graphs in order to monitor the sync process.
Stats

I'm attaching hydra.toml configuration also. hydra_toml.txt

I tried different configurations for max_download_state_peers, max_handshakes, max_incoming_peers, max_outgoing_peers and max_allowed_timeout_in_observing_period. All with the same result....

Here is part of the log:
log.txt

Please advise how I can speed-up the chucks download process.

@iosh
Copy link
Collaborator

iosh commented Nov 14, 2024

@nmnenkov Hi, you can use the snapshot tool to download and import snapshots to save time required for synchronization.
see: https://www.confluxdocs.com/docs/general/run-a-node/snapshot-tool

@nmnenkov
Copy link
Author

Hi Iosh, Thanks for your answer. Yes, I know this approach. The issue is that even with the snapshot tool the client cannot sync enough fast. Now the checkpoint = FullSync height is 109240000 and each day the client cannot compensate the new epochs. This is the reason that I'm looking from some configuration optimization.

@Pana
Copy link
Member

Pana commented Nov 14, 2024

Where are your node located, are your node always in catch-up mode, is the un-synced epoch decreasing?

@nmnenkov
Copy link
Author

nmnenkov commented Nov 14, 2024

Location is St. Louis, MO, USA.
The node is always in catch-up mode => Catch-up mode: true, latest epoch: 109282135 missing_bodies: 0
If your question is about the FullSync height - Yes, it is increasing. Last reported in the log is:
2024-11-13T19:32:08.774039537-06:00 INFO Socket IO Worker #3 cfxcore::syn - Snapshot manifest received, checkpoint = FullSync { height: 109240000...
before that it was :
2024-11-13T16:41:57.522080056-06:00 INFO Socket IO Worker #3 cfxcore::syn - Snapshot manifest received, checkpoint = FullSync { height: 109200000...

@Pana
Copy link
Member

Pana commented Nov 15, 2024

You can try to delete blockchain_data/net_config and restart your node to re-discover the peer node

@nmnenkov
Copy link
Author

Hi Pana, OK. I did it (keeping the key file the same). Will see the result in the next few hours.

@nmnenkov
Copy link
Author

Hello Pana, All,
Deleting of the blockchain_data/net_config didn't give any result. The status is the same. Even the internet provider was changed and there was no difference. Most of the time the node is downloading the chunks very slowly. Is there something that can be changed in the configuration? Are the other nodes working like this? Is it possible someone to share the log of some node that is syncing(Just to compare the behavior).

@Pana
Copy link
Member

Pana commented Nov 26, 2024

Our node works normal, @peilun-conflux can you help check this

@peilun-conflux
Copy link
Contributor

According to the monitor graph, it looks like the chunks are only downloaded normally when the number of connected peers remain stable. You can try to change the log level to debug and check why the peers are disconnected?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants