Commit Graph

87 Commits

Author SHA1 Message Date
Cassandra Heart
b53d27d48e
don't prepend network to bitmask for list 2025-02-13 12:24:51 -06:00
petricadaipegsp
b728d8d76f
Centralize configuration defaults and upgrade message limits (#410)
* Apply config defaults early

* Apply engine config defaults early

* Apply P2P config defaults early

* Remove default duplicates

* Fix casing

* Add sync message size configuration
2024-12-10 19:10:49 -06:00
petricadaipegsp
667b2aa2bc
Increase gossip history and length (#401)
* Increase gossip history and length

* Increase peer outbound queue size
2024-12-03 05:00:48 -06:00
petricadaipegsp
63394edc9d
Increase subscription buffer size (#400) 2024-12-03 04:26:19 -06:00
petricadaipegsp
1b78d758f5
Prefer connected peers for sync (#395)
* Add externally reachable data peer flag

* Announce node reachability

* Go through candidates based on reachability
2024-12-01 15:07:08 -06:00
petricadaipegsp
4be1888496
Separate dialing from retrieval (#398) 2024-12-01 15:02:07 -06:00
Cassandra Heart
4753178026
deadlock 2024-11-27 00:43:07 -06:00
Cassandra Heart
9b95541be6
resolve race condition 2024-11-27 00:37:07 -06:00
Cassandra Heart
ebc7474946
use absolute 2024-11-27 00:29:55 -06:00
Cassandra Heart
ab2484206d
have to actually run the decay 2024-11-26 23:55:45 -06:00
Cassandra Heart
0242eafa3e
add decay, make validation check a little smarter 2024-11-26 23:45:20 -06:00
petricadaipegsp
f07d855970
blossomsub: Reintroduce GossipFactor (#383) 2024-11-24 17:04:33 -06:00
petricadaipegsp
a543a607be
IDONTWANT Support (#376)
* blossomsub: Remove unused mutex

* blossomsub: Add RPC queue

* blossomsub: Use RPC queue

* blossomsub: Add IDONTWANT control message to protos

* blossomsub: Add IDONTWANT tracing support

* blossomsub: Add pre-validation

* blossomsub: Add IDONTWANT feature flag

* blossomsub: Add IDONTWANT parameters

* blossomsub: Add IDONTWANT observability

* blossomsub: Send IDONTWANT control messages

* blossomsub: Handle IDONTWANT control messages

* blossomsub: Clear maps efficiently

* blossomsub: Increase IDONTWANT parameter defaults

* blossomsub: Do not send IDONTWANT to original sender

* blossomsub: Add IDONTWANT unit tests
2024-11-23 17:15:41 -06:00
petricadaipegsp
b798de5871
Trigger sync on ahead peer (#366) 2024-11-20 17:12:57 -06:00
petricadaipegsp
883f0605ae
Enable AutoNATv1 and NATPortMap (#372) 2024-11-20 17:08:19 -06:00
petricadaipegsp
803cf4b7b3
Close direct channels if the connection is fresh (#371) 2024-11-20 17:07:28 -06:00
petricadaipegsp
bc05a4d7b9
Adaptive reserved cores (#363)
* Add adaptive data worker count

* Use runtime worker count for validation workers

* Reserve cores for networking during transition application

* Automatically set GOGC and GOMEMLIMIT
2024-11-19 16:51:14 -06:00
petricadaipegsp
d6234aa328
Avoid BlossomSubRouter race condition (#364) 2024-11-19 04:42:29 -06:00
petricadaipegsp
49566c2280
Add additional P2P configuration (#352)
* Add peer discovery configuration

* Add peer monitor configuration

* Add message validation configuration

---------

Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:54:34 -06:00
petricadaipegsp
80c7ec2889
Add initial Prometheus support (#353)
* Add Prometheus server

* Add Prometheus gRPC metrics

* Add BlossomSub metrics

---------

Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:53:19 -06:00
petricadaipegsp
7819548b6f
Do not engage in PubSub with the bootstrappers (#355) 2024-11-16 17:51:31 -06:00
petricadaipegsp
2780b643d8
Fix BlossomSub router tracing (#343) 2024-11-13 11:36:21 -06:00
petricadaipegsp
db28f1b81e
Remove vendored gostream (#347)
* Remove vendored go-libp2p-gostream

* Remove error wrapping
2024-11-11 15:05:45 -06:00
petricadaipegsp
3dbe0723bd
Add message validators (#346) 2024-11-11 14:10:00 -06:00
Cassandra Heart
4238b3ff5a
initial testnet v2.0.3-p2 2024-11-11 03:34:28 -06:00
Cassandra Heart
67d454acb9
add light prover support 2024-11-09 14:46:53 -06:00
Cassandra Heart
7ac7fc2b67
v2.0.3-b4 2024-11-07 18:03:50 -06:00
Cassandra Heart
1361eeda8c
no parallelism for peer scan 2024-11-07 02:30:16 -06:00
Cassandra Heart
7ca0c9bd37
handle testnet 2024-11-07 01:55:03 -06:00
petricadaipegsp
30a821da09
Fix ping period (#331)
* Fix ping period

* Add missing wait group wait
2024-11-04 23:49:01 -06:00
Cassandra Heart
f50dda6848
everyone's a server on testnet 2024-11-04 21:55:19 -06:00
Cassandra Heart
ee8b344dde
more adjustments 2024-11-04 21:10:21 -06:00
petricadaipegsp
e23ad7869c
Trigger automatic peer discovery on frame stall (#328) 2024-11-04 19:25:30 -06:00
petricadaipegsp
7889f76a7e
Lookup peers via DHT (#329) 2024-11-04 19:24:27 -06:00
petricadaipegsp
8ee28eb2a7
On demand bootstrap reconnection (#327)
* Aggressive bootstrap reconnection

* Reconnect bootstraps on demand
2024-11-03 22:02:30 -06:00
petricadaipegsp
f848088c0c
Fix merge conflict (#323) 2024-11-01 15:34:19 -05:00
Cassandra Heart
4b61a00095
restore prover rings 2024-10-31 23:44:23 -05:00
Cassandra Heart
9201ccbcd9
merge conflict? 2024-10-31 19:20:57 -05:00
Cassandra Heart
ad55d280f8
a little more logic around connection management 2024-10-31 19:11:39 -05:00
Cassandra Heart
3dd9a0c5f3
get develop caught up (#322)
* Update qcommander.sh bootrap (#304)

* v2.0.1 (#308)

* roll up v2.0.1-b2 to develop

* b2-fixed

* adjust return data of fast sync so it doesn't return the earliest frame

* -b3

* fix: announce peer based on leading frame, not initial frame; fix: looping bug

* fix: last batch fails due to underflow; qol: make logging chattier

* -b4

* resolve frame cache issue

* fix: mint loop + re-migrate

* fix: register execution panic

* fix: mint loop, other side

* fix: handle unexpected return of nil status

* final -b4

* handle subtle change to migration

* qol: add heuristic to handle corruption scenario

* bump genesis

* qol: use separate channel for worker

* final parameterization, parallelize streams

* deprecate signers 10, 11, 14, 17

* adjust signatory check size to match rotated out signers

* V2.0.2.3 (#321)

* roll up v2.0.1-b2 to develop

* b2-fixed

* adjust return data of fast sync so it doesn't return the earliest frame

* -b3

* fix: announce peer based on leading frame, not initial frame; fix: looping bug

* fix: last batch fails due to underflow; qol: make logging chattier

* -b4

* resolve frame cache issue

* fix: mint loop + re-migrate

* fix: register execution panic

* fix: mint loop, other side

* fix: handle unexpected return of nil status

* final -b4

* handle subtle change to migration

* qol: add heuristic to handle corruption scenario

* bump genesis

* qol: use separate channel for worker

* final parameterization, parallelize streams

* Add direct peers to blossomsub (#309)

Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>

* chore(docker): add ca-certificates to fix x509 error. (#307)

* Update qcommander.sh bootrap (#304)

* chore(docker): add ca-certificates to fix x509 error.

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>

* deprecate signers 10, 11, 14, 17

* adjust signatory check size to match rotated out signers

* qol: sync by rebroadcast

* upgrade version

* more small adjustments

* wait a little longer

* fix: don't use iterator for frame directly until iterator is fixed

* change iterator, genesis for testnet

* adjust to previous sync handling

* adjust: don't grab the very latest while it's already being broadcasted

* ok, ready for testnet

* handle rebroadcast quirks

* more adjustments from testing

* faster

* temporarily bulk process on frame candidates

* resolve separate frames

* don't loop

* make worker reset resume to check where it should continue

* move window

* reduce signature count now that supermajority signed last

* resolve bottlenecks

* remove GOMAXPROCS limit for now

* revisions for v2.0.2.1

* bump version

* bulk import

* reintroduce sync

* small adustments to make life better

* check bitmask for peers and keep alive

* adjust reconnect

* ensure peer doesn't fall off address list

* adjust blossomsub to background discovery

* bump version

* remove dev check

* remove debug log line

* further adjustments

* a little more logic around connection management

* v2.0.2.3

* Fix peer discovery (#319)

* Fix peer discovery

* Make peer discovery connections parallel

* Monitor peers via pings (#317)

* Support QUILIBRIUM_SIGNATURE_CHECK in client (#314)

* Ensure direct peers are not pruned by resource limits (#315)

* Support pprof profiling via HTTP (#313)

* Fix CPU profiling

* Add pprof server support

* Additional peering connection improvements (#320)

* Lookup peers if not enough external peers are available

* Make bootstrap peer discovery sensitive to a lack of bootstrappers

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
Co-authored-by: linquanisaac <33619994+linquanisaac@users.noreply.github.com>
Co-authored-by: petricadaipegsp <155911522+petricadaipegsp@users.noreply.github.com>

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
Co-authored-by: linquanisaac <33619994+linquanisaac@users.noreply.github.com>
Co-authored-by: petricadaipegsp <155911522+petricadaipegsp@users.noreply.github.com>
2024-10-31 16:46:58 -05:00
Cassandra Heart
262cf5271d
adjust reconnect 2024-10-27 00:55:31 -05:00
Cassandra Heart
b8973df266
check bitmask for peers and keep alive 2024-10-27 00:51:35 -05:00
Cassandra Heart
c0396f57a9
revisions for v2.0.2.1 2024-10-26 03:32:35 -05:00
Cassandra Heart
d57757730d
upgrade version 2024-10-24 21:54:51 -05:00
Tyler Sturos
470d7f6ee4
Add direct peers to blossomsub (#309)
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
2024-10-24 16:59:34 -05:00
Cassandra Heart
7944cb6ca5
roll up v2.0.1-b2 to develop 2024-10-20 20:00:36 -05:00
Cassandra Heart
1bd670e773
v2.0.0-p8 2024-10-18 01:55:51 -05:00
Cassandra Heart
5230ceb413
v2.0.0-p5 (#303) 2024-10-16 23:51:27 -05:00
Cassandra Heart
b4051ccbc9
detangling merge of main node for v2 (#293) 2024-10-12 11:55:17 -07:00
Cassandra Heart
d526ec63d0
v1.4.21 (#255)
* v1.4.21

* bump name
2024-07-05 04:40:00 -05:00