Commit Graph

482 Commits

Author SHA1 Message Date
Cassandra Heart
f6f87ce80b
bump version 2024-12-02 17:08:12 -06:00
petricadaipegsp
d1e65c1c92
Support frame fragmentation and dissemination (#396)
* Add clock frame fragment message

* Add clock frame fragment validation

* Add clock frame fragmentation utilities

* Add clock frame fragmentation message handling

* Report publication errors

* Publish info list after frame

* Add frame publish configuration

* Publish clock frame fragments

* Update BlossomSub dashboard

* Publish clock frame fragments in parallel
2024-12-02 16:25:10 -06:00
petricadaipegsp
f5f7eb243b
Change message size limits (#394)
* Increase message size limits

* Lower soft max message size to 1MiB
2024-12-02 15:00:43 -06:00
petricadaipegsp
e0993a94ea
Avoid further copies of the tries (#393)
* Revert logging change

* Avoid further copies of tries

* Avoid sync on beacon

* Avoid recreating the address for each transaction
2024-12-01 15:24:38 -06:00
petricadaipegsp
1b78d758f5
Prefer connected peers for sync (#395)
* Add externally reachable data peer flag

* Announce node reachability

* Go through candidates based on reachability
2024-12-01 15:07:08 -06:00
petricadaipegsp
1e441e280d
Memory management adjustments (#397)
* Do not vendor go-buffer-pool

* Do not change GOGC

* Use local buffer
2024-12-01 15:04:01 -06:00
petricadaipegsp
4be1888496
Separate dialing from retrieval (#398) 2024-12-01 15:02:07 -06:00
petricadaipegsp
dd030560bc
Do not clone full tries (#392) 2024-11-28 06:21:04 -06:00
petricadaipegsp
46e88bfc95
Deprecate zero timestamp transactions (#391) 2024-11-28 05:04:18 -06:00
Cassandra Heart
b120f1cffb
add new signers 2024-11-27 20:47:14 -06:00
Cassandra Heart
796f42e834
Merge branch 'develop' into v2.0.4-p2 2024-11-27 20:40:13 -06:00
petricadaipegsp
8b61918d43
Add transaction request validation (#390) 2024-11-27 18:13:57 -06:00
Cassandra Heart
87f4d7014c
only ignore, and use peer id of sender, not hop 2024-11-27 00:52:55 -06:00
Cassandra Heart
4753178026
deadlock 2024-11-27 00:43:07 -06:00
Cassandra Heart
9b95541be6
resolve race condition 2024-11-27 00:37:07 -06:00
Cassandra Heart
ebc7474946
use absolute 2024-11-27 00:29:55 -06:00
Cassandra Heart
ab2484206d
have to actually run the decay 2024-11-26 23:55:45 -06:00
Cassandra Heart
0242eafa3e
add decay, make validation check a little smarter 2024-11-26 23:45:20 -06:00
Cassandra Heart
28e8331ca1
refined to work across the board 2024-11-26 23:24:05 -06:00
Cassandra Heart
8a26318e1a
remove minversion check, no need 2024-11-26 23:06:44 -06:00
Cassandra Heart
70b30ddde1
don't set within validator 2024-11-26 22:52:22 -06:00
Cassandra Heart
7b2de084fd
no, really, get out 2024-11-26 21:05:01 -06:00
Cassandra Heart
6fba1a3cd9
apply to set early 2024-11-26 21:02:08 -06:00
Cassandra Heart
75716be4fa
さよなら 2024-11-26 18:50:25 -06:00
petricadaipegsp
e836b00852
Vendor go-buffer-pool (#389)
* Vendor go-buffer-pool

* Do not use pointer pool
2024-11-26 05:22:46 -06:00
Cassandra Heart
3d58907e1c
bump patch version, support filtering on patch version 2024-11-24 18:44:14 -06:00
petricadaipegsp
7fd4d32521
Always start sync from head (#386)
* Always start sync from head

* Allow skips during sync using data time reel head
2024-11-24 18:09:17 -06:00
petricadaipegsp
ec37cb34d7
Add structured stop procedure (#379) 2024-11-24 17:07:15 -06:00
petricadaipegsp
d8321bf812
Deduplicate mint requests by public key (#381) 2024-11-24 17:06:16 -06:00
petricadaipegsp
f07d855970
blossomsub: Reintroduce GossipFactor (#383) 2024-11-24 17:04:33 -06:00
Cassandra Heart
2bd61786d6
Merge branch 'develop' into v2.0.4-p1 2024-11-23 22:20:37 -06:00
Cassandra Heart
269422b2f1
v2.0.4-p1 2024-11-23 22:20:29 -06:00
petricadaipegsp
a543a607be
IDONTWANT Support (#376)
* blossomsub: Remove unused mutex

* blossomsub: Add RPC queue

* blossomsub: Use RPC queue

* blossomsub: Add IDONTWANT control message to protos

* blossomsub: Add IDONTWANT tracing support

* blossomsub: Add pre-validation

* blossomsub: Add IDONTWANT feature flag

* blossomsub: Add IDONTWANT parameters

* blossomsub: Add IDONTWANT observability

* blossomsub: Send IDONTWANT control messages

* blossomsub: Handle IDONTWANT control messages

* blossomsub: Clear maps efficiently

* blossomsub: Increase IDONTWANT parameter defaults

* blossomsub: Do not send IDONTWANT to original sender

* blossomsub: Add IDONTWANT unit tests
2024-11-23 17:15:41 -06:00
Cassandra Heart
35d4b7a728
Merge branch 'develop' into v2.0.4-p1 2024-11-22 19:58:04 -06:00
petricadaipegsp
eaf565c15a
Fix gossip (#378)
* Observe control messages message count

* Fix copyRPC

* Fix message cache
2024-11-22 10:30:33 -06:00
Black Swan
849feddf84
enhance testnet frame pruning (#377)
* reduce testnet frame pruning delay to 1 minute

* set seniority repair cutoff frame for testnet to 25745

* add log message to confirm frame pruning is enabled
2024-11-22 10:29:48 -06:00
Cassandra Heart
292383be75
don't prune what is already pruned 2024-11-22 01:59:04 -06:00
Cassandra Heart
f2a3bd2d8e
don't try to make workers run if they aren't in ready state 2024-11-22 01:52:36 -06:00
Cassandra Heart
ca5d0579ea
bump version 2024-11-21 19:38:21 -06:00
petricadaipegsp
44ccd14871
Use buffered channels when applicable (#373)
* Use buffered channels when applicable

* Do not start additional goroutines for processing

* Use context to stop ongoing loops
2024-11-21 19:32:04 -06:00
petricadaipegsp
db66b3f118
Optimise token request duplicate handling (#375)
* Optimise token request duplicate handling

* Do not hold lock while applying transitions
2024-11-21 18:00:29 -06:00
Cassandra Heart
5e135d36de
Merge branch 'develop' into v2.0.4-p1 2024-11-20 20:31:57 -06:00
Cassandra Heart
df77d408dc
make it wait until one after 2024-11-20 20:31:46 -06:00
petricadaipegsp
b798de5871
Trigger sync on ahead peer (#366) 2024-11-20 17:12:57 -06:00
petricadaipegsp
883f0605ae
Enable AutoNATv1 and NATPortMap (#372) 2024-11-20 17:08:19 -06:00
petricadaipegsp
803cf4b7b3
Close direct channels if the connection is fresh (#371) 2024-11-20 17:07:28 -06:00
petricadaipegsp
cbc405a3a0
Refactor peer pinging to target individual connections (#370) 2024-11-20 17:05:10 -06:00
petricadaipegsp
4d3ac60e2b
Increase default sync timeout to 4 seconds (#369) 2024-11-20 16:59:24 -06:00
petricadaipegsp
8ce9aeee4e
Disallow excessive GOMAXPROCS (#368) 2024-11-20 16:59:09 -06:00
Cassandra Heart
5c94f5bc5e
Merge branch 'develop' into v2.0.4-p1 2024-11-19 16:55:57 -06:00
Cassandra Heart
9e28693581
make it wait until one after 2024-11-19 16:55:41 -06:00
petricadaipegsp
bc05a4d7b9
Adaptive reserved cores (#363)
* Add adaptive data worker count

* Use runtime worker count for validation workers

* Reserve cores for networking during transition application

* Automatically set GOGC and GOMEMLIMIT
2024-11-19 16:51:14 -06:00
Cassandra Heart
92d09a9c7c
Merge branch 'develop' into v2.0.4 2024-11-19 16:13:42 -06:00
Cassandra Heart
c8a77703ba
make it wait until one after 2024-11-19 04:43:36 -06:00
petricadaipegsp
d6234aa328
Avoid BlossomSubRouter race condition (#364) 2024-11-19 04:42:29 -06:00
Cassandra Heart
0b54808fe8
Merge branch 'develop' into v2.0.4 2024-11-19 00:06:01 -06:00
Cassandra Heart
a1e10b2d38
make it wait until one after 2024-11-19 00:04:43 -06:00
Cassandra Heart
91e8a16124
don't apply pruning until after seniority cutoff 2024-11-18 02:17:42 -06:00
Cassandra Heart
61179c13a0
node info should show worker counts 2024-11-18 02:03:37 -06:00
Cassandra Heart
c9be69ba28
seniority map repair 2024-11-18 01:45:50 -06:00
Cassandra Heart
4b69a40e56
more adjustment to validators 2024-11-17 16:22:32 -06:00
Cassandra Heart
5d1b572035
switch validators to sync 2024-11-17 16:00:51 -06:00
Cassandra Heart
063102eab2
adjust validators 2024-11-17 15:58:26 -06:00
Cassandra Heart
29a129d543
allow choice of indexed or non-indexed batches 2024-11-17 07:58:15 -06:00
Cassandra Heart
f511149b36
frame pruning 2024-11-17 04:37:55 -06:00
petricadaipegsp
14f7e3c40d
Throttle mint applications (#360) 2024-11-17 03:06:18 -06:00
petricadaipegsp
0b499c649c
Move time triggered synchronization to dedicated goroutine (#359) 2024-11-17 02:18:55 -06:00
Cassandra Heart
889fcac721
add timestamps and frame numbers to qclient token coins 2024-11-17 00:37:49 -06:00
Cassandra Heart
a798347ccf
re-add #358 2024-11-16 23:20:09 -06:00
Cassandra Heart
6e2c7f4028
Revert "Use buffered channels in the engines (#357)"
This reverts commit d32d79f58d.
2024-11-16 23:11:25 -06:00
Cassandra Heart
d97a093c18
remove logging in validators due to locking, allow 2.0.3 minversion 2024-11-16 23:11:19 -06:00
Cassandra Heart
fe34032b0d
unwind these 2024-11-16 18:40:43 -06:00
Cassandra Heart
706ec2997d
adjust runonce 2024-11-16 18:29:41 -06:00
Cassandra Heart
08e7dad8c9
parallelism of mints + don't overwrite map until commit time 2024-11-16 18:09:52 -06:00
Cassandra Heart
ddb67eb85b
and here 2024-11-16 17:58:57 -06:00
Cassandra Heart
36f581a16b
and here 2024-11-16 17:58:57 -06:00
Cassandra Heart
d63f587d40
reduce bandwidth on workers 2024-11-16 17:58:57 -06:00
Cassandra Heart
eda3729752
revert this 2024-11-16 17:58:56 -06:00
petricadaipegsp
d32d79f58d
Use buffered channels in the engines (#357)
* Make time data reel sending consistent

* Use buffered channels to avoid drops
2024-11-16 17:58:32 -06:00
petricadaipegsp
49566c2280
Add additional P2P configuration (#352)
* Add peer discovery configuration

* Add peer monitor configuration

* Add message validation configuration

---------

Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:54:34 -06:00
petricadaipegsp
80c7ec2889
Add initial Prometheus support (#353)
* Add Prometheus server

* Add Prometheus gRPC metrics

* Add BlossomSub metrics

---------

Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:53:19 -06:00
petricadaipegsp
d57d76e627
Add transaction timestamps (#354) 2024-11-16 17:52:27 -06:00
petricadaipegsp
7819548b6f
Do not engage in PubSub with the bootstrappers (#355) 2024-11-16 17:51:31 -06:00
petricadaipegsp
da5b7a6126
Add sync timeout and make it async (#356)
* Add sync timeout

* Make sync async
2024-11-16 17:50:25 -06:00
Cassandra Heart
4a8e02e0b2
Merge branch 'develop' into v2.0.3-p4 2024-11-13 14:51:54 -06:00
Cassandra Heart
8b18568bae
the mystery of 6% 2024-11-13 14:51:41 -06:00
Cassandra Heart
4aa0a84a8b
Merge branch 'develop' into v2.0.3-p4 2024-11-13 11:59:17 -06:00
petricadaipegsp
37761ebd83
Log frame age (#351) 2024-11-13 11:36:49 -06:00
petricadaipegsp
2780b643d8
Fix BlossomSub router tracing (#343) 2024-11-13 11:36:21 -06:00
Cassandra Heart
38d92f45f8
revert this 2024-11-13 10:45:52 -06:00
Cassandra Heart
07a27d7dc6
set it under either case 2024-11-13 10:43:57 -06:00
petricadaipegsp
5333b4a8cc
Sample peers which are ahead during sync (#337) 2024-11-13 10:43:28 -06:00
petricadaipegsp
f06d2c0ff2
Ensure latest frame monotonicity (#350) 2024-11-13 10:41:23 -06:00
petricadaipegsp
5b05ed03d5
Fix engine option names (#349) 2024-11-13 10:40:24 -06:00
Cassandra Heart
fa93f01300
Merge branch 'v2.0.3-p4' into develop 2024-11-13 10:00:54 -06:00
Cassandra Heart
e58280b7e4
small adjustments 2024-11-13 10:00:37 -06:00
Cassandra Heart
79d6d1679a
Merge branch 'v2.0.3-p4' into develop 2024-11-13 06:36:14 -06:00
Cassandra Heart
22c0b55ab8
nil check 2024-11-13 06:36:08 -06:00
Cassandra Heart
c71649c662
Merge branch 'v2.0.3-p4' into develop 2024-11-13 06:16:37 -06:00
Cassandra Heart
5b3b0046f7
explicitly set key 2024-11-13 06:16:21 -06:00