Commit Graph

22 Commits

Author SHA1 Message Date
Cassandra Heart
4696d5292c
restore verenc into hypergraph loop, thread hypergraph through token application for backcompat 2025-02-06 06:34:22 -06:00
Cassandra Heart
4f742abd77
support state tree 2024-12-09 05:44:43 -06:00
petricadaipegsp
d1e65c1c92
Support frame fragmentation and dissemination (#396)
* Add clock frame fragment message

* Add clock frame fragment validation

* Add clock frame fragmentation utilities

* Add clock frame fragmentation message handling

* Report publication errors

* Publish info list after frame

* Add frame publish configuration

* Publish clock frame fragments

* Update BlossomSub dashboard

* Publish clock frame fragments in parallel
2024-12-02 16:25:10 -06:00
petricadaipegsp
1b78d758f5
Prefer connected peers for sync (#395)
* Add externally reachable data peer flag

* Announce node reachability

* Go through candidates based on reachability
2024-12-01 15:07:08 -06:00
petricadaipegsp
4be1888496
Separate dialing from retrieval (#398) 2024-12-01 15:02:07 -06:00
petricadaipegsp
b798de5871
Trigger sync on ahead peer (#366) 2024-11-20 17:12:57 -06:00
Cassandra Heart
29a129d543
allow choice of indexed or non-indexed batches 2024-11-17 07:58:15 -06:00
Cassandra Heart
6e2c7f4028
Revert "Use buffered channels in the engines (#357)"
This reverts commit d32d79f58d.
2024-11-16 23:11:25 -06:00
petricadaipegsp
d32d79f58d
Use buffered channels in the engines (#357)
* Make time data reel sending consistent

* Use buffered channels to avoid drops
2024-11-16 17:58:32 -06:00
petricadaipegsp
49566c2280
Add additional P2P configuration (#352)
* Add peer discovery configuration

* Add peer monitor configuration

* Add message validation configuration

---------

Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:54:34 -06:00
petricadaipegsp
db28f1b81e
Remove vendored gostream (#347)
* Remove vendored go-libp2p-gostream

* Remove error wrapping
2024-11-11 15:05:45 -06:00
petricadaipegsp
3dbe0723bd
Add message validators (#346) 2024-11-11 14:10:00 -06:00
Cassandra Heart
26cbb2092e
rate limiter logic 2024-11-11 13:30:04 -06:00
Cassandra Heart
7ac7fc2b67
v2.0.3-b4 2024-11-07 18:03:50 -06:00
petricadaipegsp
e23ad7869c
Trigger automatic peer discovery on frame stall (#328) 2024-11-04 19:25:30 -06:00
Cassandra Heart
a9225b2508
2.0.3-b1 2024-11-04 18:09:35 -06:00
Cassandra Heart
3dd9a0c5f3
get develop caught up (#322)
* Update qcommander.sh bootrap (#304)

* v2.0.1 (#308)

* roll up v2.0.1-b2 to develop

* b2-fixed

* adjust return data of fast sync so it doesn't return the earliest frame

* -b3

* fix: announce peer based on leading frame, not initial frame; fix: looping bug

* fix: last batch fails due to underflow; qol: make logging chattier

* -b4

* resolve frame cache issue

* fix: mint loop + re-migrate

* fix: register execution panic

* fix: mint loop, other side

* fix: handle unexpected return of nil status

* final -b4

* handle subtle change to migration

* qol: add heuristic to handle corruption scenario

* bump genesis

* qol: use separate channel for worker

* final parameterization, parallelize streams

* deprecate signers 10, 11, 14, 17

* adjust signatory check size to match rotated out signers

* V2.0.2.3 (#321)

* roll up v2.0.1-b2 to develop

* b2-fixed

* adjust return data of fast sync so it doesn't return the earliest frame

* -b3

* fix: announce peer based on leading frame, not initial frame; fix: looping bug

* fix: last batch fails due to underflow; qol: make logging chattier

* -b4

* resolve frame cache issue

* fix: mint loop + re-migrate

* fix: register execution panic

* fix: mint loop, other side

* fix: handle unexpected return of nil status

* final -b4

* handle subtle change to migration

* qol: add heuristic to handle corruption scenario

* bump genesis

* qol: use separate channel for worker

* final parameterization, parallelize streams

* Add direct peers to blossomsub (#309)

Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>

* chore(docker): add ca-certificates to fix x509 error. (#307)

* Update qcommander.sh bootrap (#304)

* chore(docker): add ca-certificates to fix x509 error.

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>

* deprecate signers 10, 11, 14, 17

* adjust signatory check size to match rotated out signers

* qol: sync by rebroadcast

* upgrade version

* more small adjustments

* wait a little longer

* fix: don't use iterator for frame directly until iterator is fixed

* change iterator, genesis for testnet

* adjust to previous sync handling

* adjust: don't grab the very latest while it's already being broadcasted

* ok, ready for testnet

* handle rebroadcast quirks

* more adjustments from testing

* faster

* temporarily bulk process on frame candidates

* resolve separate frames

* don't loop

* make worker reset resume to check where it should continue

* move window

* reduce signature count now that supermajority signed last

* resolve bottlenecks

* remove GOMAXPROCS limit for now

* revisions for v2.0.2.1

* bump version

* bulk import

* reintroduce sync

* small adustments to make life better

* check bitmask for peers and keep alive

* adjust reconnect

* ensure peer doesn't fall off address list

* adjust blossomsub to background discovery

* bump version

* remove dev check

* remove debug log line

* further adjustments

* a little more logic around connection management

* v2.0.2.3

* Fix peer discovery (#319)

* Fix peer discovery

* Make peer discovery connections parallel

* Monitor peers via pings (#317)

* Support QUILIBRIUM_SIGNATURE_CHECK in client (#314)

* Ensure direct peers are not pruned by resource limits (#315)

* Support pprof profiling via HTTP (#313)

* Fix CPU profiling

* Add pprof server support

* Additional peering connection improvements (#320)

* Lookup peers if not enough external peers are available

* Make bootstrap peer discovery sensitive to a lack of bootstrappers

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
Co-authored-by: linquanisaac <33619994+linquanisaac@users.noreply.github.com>
Co-authored-by: petricadaipegsp <155911522+petricadaipegsp@users.noreply.github.com>

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
Co-authored-by: linquanisaac <33619994+linquanisaac@users.noreply.github.com>
Co-authored-by: petricadaipegsp <155911522+petricadaipegsp@users.noreply.github.com>
2024-10-31 16:46:58 -05:00
Cassandra Heart
5e5c421ce9
bulk import 2024-10-26 23:22:28 -05:00
Cassandra Heart
c0396f57a9
revisions for v2.0.2.1 2024-10-26 03:32:35 -05:00
Cassandra Heart
3a04a9c263
resolve bottlenecks 2024-10-25 23:56:41 -05:00
Cassandra Heart
058885951a
final -b4 2024-10-22 18:46:05 -05:00
Cassandra Heart
9a099009e1
-b4 2024-10-21 22:32:08 -05:00