Commit Graph

57 Commits

Author SHA1 Message Date
Cassandra Heart
f511149b36
frame pruning 2024-11-17 04:37:55 -06:00
Cassandra Heart
6e2c7f4028
Revert "Use buffered channels in the engines (#357)"
This reverts commit d32d79f58d.
2024-11-16 23:11:25 -06:00
Cassandra Heart
d97a093c18
remove logging in validators due to locking, allow 2.0.3 minversion 2024-11-16 23:11:19 -06:00
Cassandra Heart
d63f587d40
reduce bandwidth on workers 2024-11-16 17:58:57 -06:00
petricadaipegsp
d32d79f58d
Use buffered channels in the engines (#357)
* Make time data reel sending consistent

* Use buffered channels to avoid drops
2024-11-16 17:58:32 -06:00
petricadaipegsp
49566c2280
Add additional P2P configuration (#352)
* Add peer discovery configuration

* Add peer monitor configuration

* Add message validation configuration

---------

Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:54:34 -06:00
petricadaipegsp
80c7ec2889
Add initial Prometheus support (#353)
* Add Prometheus server

* Add Prometheus gRPC metrics

* Add BlossomSub metrics

---------

Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:53:19 -06:00
petricadaipegsp
d57d76e627
Add transaction timestamps (#354) 2024-11-16 17:52:27 -06:00
petricadaipegsp
da5b7a6126
Add sync timeout and make it async (#356)
* Add sync timeout

* Make sync async
2024-11-16 17:50:25 -06:00
petricadaipegsp
37761ebd83
Log frame age (#351) 2024-11-13 11:36:49 -06:00
petricadaipegsp
f06d2c0ff2
Ensure latest frame monotonicity (#350) 2024-11-13 10:41:23 -06:00
Cassandra Heart
e58280b7e4
small adjustments 2024-11-13 10:00:37 -06:00
Cassandra Heart
c2b9b1d460
resolve:
- critbit trie bug
- proof messages performing incorrect repeat
2024-11-13 00:10:22 -06:00
petricadaipegsp
3dbe0723bd
Add message validators (#346) 2024-11-11 14:10:00 -06:00
Cassandra Heart
26cbb2092e
rate limiter logic 2024-11-11 13:30:04 -06:00
Cassandra Heart
b9694ddc99
fix rate limit 2024-11-11 11:32:11 -06:00
petricadaipegsp
de87f3f81b
Change frame delivery filter (#345) 2024-11-11 11:11:28 -06:00
Cassandra Heart
2ce7eb26d4
change order of operations, don't commit an empty tree? 2024-11-11 04:39:52 -06:00
Cassandra Heart
4238b3ff5a
initial testnet v2.0.3-p2 2024-11-11 03:34:28 -06:00
Cassandra Heart
77c036b94b
v2.0.3-p0 2024-11-11 03:33:35 -06:00
petricadaipegsp
05f1bf94fe
Remove additional signatures from data peer list announcements (#335)
* Do not verify data peer announcement signatures

* Do not sign data peer announcements explicitly

* Implement single peer data peer list announcement
2024-11-10 06:03:38 -06:00
Cassandra Heart
042848e7cb
minor nice-to-haves 2024-11-09 16:04:12 -06:00
Cassandra Heart
1c0d707f7d
add bounds check for proofs 2024-11-09 15:54:49 -06:00
Cassandra Heart
812939a97a
v2.0.3-b7 2024-11-08 20:29:30 -06:00
Cassandra Heart
bc851de1bb
add testnet variant of seniority and penalties 2024-11-08 03:54:32 -06:00
Cassandra Heart
3a84cc65c8
ctrl-c = stop, damn it 2024-11-08 00:48:26 -06:00
Cassandra Heart
7ac7fc2b67
v2.0.3-b4 2024-11-07 18:03:50 -06:00
Cassandra Heart
9bc8a84f1a
fix dangling mutex lock 2024-11-07 03:05:37 -06:00
Cassandra Heart
80be91d067
v2.0.3-b3 2024-11-06 21:43:55 -06:00
Cassandra Heart
5851db6433
move this back 2024-11-06 18:04:54 -06:00
Cassandra Heart
cb0918212e
make proving check the prior landed 2024-11-06 16:35:50 -06:00
Cassandra Heart
5679b19fdb
use up to date info 2024-11-06 14:46:04 -06:00
Cassandra Heart
f3e502a2d1
v2.0.3-b2 2024-11-06 03:51:30 -06:00
Cassandra Heart
e469fad46a
don't spin workers 2024-11-05 22:00:40 -06:00
Cassandra Heart
d2c5b42cdf
fix iterator bug 2024-11-05 21:24:27 -06:00
Cassandra Heart
3279666948
final adjustments 2024-11-05 17:37:17 -06:00
petricadaipegsp
ceb53b39c9
Use peer address while checking if date time proofs should be created (#333)
* Check PubSub key in trie, not proving key

* Use gRPC errors
2024-11-05 17:04:14 -06:00
Cassandra Heart
cdc1618964
get tries in sequence of events 2024-11-05 02:31:14 -06:00
Cassandra Heart
8f955523d3
use correct signature path 2024-11-04 20:05:07 -06:00
petricadaipegsp
e23ad7869c
Trigger automatic peer discovery on frame stall (#328) 2024-11-04 19:25:30 -06:00
Cassandra Heart
d7501a142e
don't announce unless we're up to head 2024-11-04 18:24:12 -06:00
Cassandra Heart
a9225b2508
2.0.3-b1 2024-11-04 18:09:35 -06:00
Cassandra Heart
4b61a00095
restore prover rings 2024-10-31 23:44:23 -05:00
Cassandra Heart
3dd9a0c5f3
get develop caught up (#322)
* Update qcommander.sh bootrap (#304)

* v2.0.1 (#308)

* roll up v2.0.1-b2 to develop

* b2-fixed

* adjust return data of fast sync so it doesn't return the earliest frame

* -b3

* fix: announce peer based on leading frame, not initial frame; fix: looping bug

* fix: last batch fails due to underflow; qol: make logging chattier

* -b4

* resolve frame cache issue

* fix: mint loop + re-migrate

* fix: register execution panic

* fix: mint loop, other side

* fix: handle unexpected return of nil status

* final -b4

* handle subtle change to migration

* qol: add heuristic to handle corruption scenario

* bump genesis

* qol: use separate channel for worker

* final parameterization, parallelize streams

* deprecate signers 10, 11, 14, 17

* adjust signatory check size to match rotated out signers

* V2.0.2.3 (#321)

* roll up v2.0.1-b2 to develop

* b2-fixed

* adjust return data of fast sync so it doesn't return the earliest frame

* -b3

* fix: announce peer based on leading frame, not initial frame; fix: looping bug

* fix: last batch fails due to underflow; qol: make logging chattier

* -b4

* resolve frame cache issue

* fix: mint loop + re-migrate

* fix: register execution panic

* fix: mint loop, other side

* fix: handle unexpected return of nil status

* final -b4

* handle subtle change to migration

* qol: add heuristic to handle corruption scenario

* bump genesis

* qol: use separate channel for worker

* final parameterization, parallelize streams

* Add direct peers to blossomsub (#309)

Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>

* chore(docker): add ca-certificates to fix x509 error. (#307)

* Update qcommander.sh bootrap (#304)

* chore(docker): add ca-certificates to fix x509 error.

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>

* deprecate signers 10, 11, 14, 17

* adjust signatory check size to match rotated out signers

* qol: sync by rebroadcast

* upgrade version

* more small adjustments

* wait a little longer

* fix: don't use iterator for frame directly until iterator is fixed

* change iterator, genesis for testnet

* adjust to previous sync handling

* adjust: don't grab the very latest while it's already being broadcasted

* ok, ready for testnet

* handle rebroadcast quirks

* more adjustments from testing

* faster

* temporarily bulk process on frame candidates

* resolve separate frames

* don't loop

* make worker reset resume to check where it should continue

* move window

* reduce signature count now that supermajority signed last

* resolve bottlenecks

* remove GOMAXPROCS limit for now

* revisions for v2.0.2.1

* bump version

* bulk import

* reintroduce sync

* small adustments to make life better

* check bitmask for peers and keep alive

* adjust reconnect

* ensure peer doesn't fall off address list

* adjust blossomsub to background discovery

* bump version

* remove dev check

* remove debug log line

* further adjustments

* a little more logic around connection management

* v2.0.2.3

* Fix peer discovery (#319)

* Fix peer discovery

* Make peer discovery connections parallel

* Monitor peers via pings (#317)

* Support QUILIBRIUM_SIGNATURE_CHECK in client (#314)

* Ensure direct peers are not pruned by resource limits (#315)

* Support pprof profiling via HTTP (#313)

* Fix CPU profiling

* Add pprof server support

* Additional peering connection improvements (#320)

* Lookup peers if not enough external peers are available

* Make bootstrap peer discovery sensitive to a lack of bootstrappers

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
Co-authored-by: linquanisaac <33619994+linquanisaac@users.noreply.github.com>
Co-authored-by: petricadaipegsp <155911522+petricadaipegsp@users.noreply.github.com>

---------

Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
Co-authored-by: linquanisaac <33619994+linquanisaac@users.noreply.github.com>
Co-authored-by: petricadaipegsp <155911522+petricadaipegsp@users.noreply.github.com>
2024-10-31 16:46:58 -05:00
Cassandra Heart
730e0b9f68
reintroduce sync 2024-10-26 23:54:23 -05:00
Cassandra Heart
5e5c421ce9
bulk import 2024-10-26 23:22:28 -05:00
Cassandra Heart
c0396f57a9
revisions for v2.0.2.1 2024-10-26 03:32:35 -05:00
Cassandra Heart
1e590ad159
qol: sync by rebroadcast 2024-10-24 21:54:51 -05:00
Cassandra Heart
b7d2e17c63
final parameterization, parallelize streams 2024-10-23 14:26:01 -05:00
Cassandra Heart
b3b3afad4b
qol: use separate channel for worker 2024-10-23 01:34:39 -05:00