petricadaipegsp
d1e65c1c92
Support frame fragmentation and dissemination ( #396 )
...
* Add clock frame fragment message
* Add clock frame fragment validation
* Add clock frame fragmentation utilities
* Add clock frame fragmentation message handling
* Report publication errors
* Publish info list after frame
* Add frame publish configuration
* Publish clock frame fragments
* Update BlossomSub dashboard
* Publish clock frame fragments in parallel
2024-12-02 16:25:10 -06:00
petricadaipegsp
f5f7eb243b
Change message size limits ( #394 )
...
* Increase message size limits
* Lower soft max message size to 1MiB
2024-12-02 15:00:43 -06:00
petricadaipegsp
e0993a94ea
Avoid further copies of the tries ( #393 )
...
* Revert logging change
* Avoid further copies of tries
* Avoid sync on beacon
* Avoid recreating the address for each transaction
2024-12-01 15:24:38 -06:00
petricadaipegsp
1b78d758f5
Prefer connected peers for sync ( #395 )
...
* Add externally reachable data peer flag
* Announce node reachability
* Go through candidates based on reachability
2024-12-01 15:07:08 -06:00
petricadaipegsp
1e441e280d
Memory management adjustments ( #397 )
...
* Do not vendor go-buffer-pool
* Do not change GOGC
* Use local buffer
2024-12-01 15:04:01 -06:00
petricadaipegsp
4be1888496
Separate dialing from retrieval ( #398 )
2024-12-01 15:02:07 -06:00
petricadaipegsp
dd030560bc
Do not clone full tries ( #392 )
2024-11-28 06:21:04 -06:00
petricadaipegsp
46e88bfc95
Deprecate zero timestamp transactions ( #391 )
2024-11-28 05:04:18 -06:00
Cassandra Heart
b120f1cffb
add new signers
2024-11-27 20:47:14 -06:00
Cassandra Heart
796f42e834
Merge branch 'develop' into v2.0.4-p2
2024-11-27 20:40:13 -06:00
petricadaipegsp
8b61918d43
Add transaction request validation ( #390 )
2024-11-27 18:13:57 -06:00
Cassandra Heart
87f4d7014c
only ignore, and use peer id of sender, not hop
2024-11-27 00:52:55 -06:00
Cassandra Heart
4753178026
deadlock
2024-11-27 00:43:07 -06:00
Cassandra Heart
9b95541be6
resolve race condition
2024-11-27 00:37:07 -06:00
Cassandra Heart
ebc7474946
use absolute
2024-11-27 00:29:55 -06:00
Cassandra Heart
ab2484206d
have to actually run the decay
2024-11-26 23:55:45 -06:00
Cassandra Heart
0242eafa3e
add decay, make validation check a little smarter
2024-11-26 23:45:20 -06:00
Cassandra Heart
28e8331ca1
refined to work across the board
2024-11-26 23:24:05 -06:00
Cassandra Heart
8a26318e1a
remove minversion check, no need
2024-11-26 23:06:44 -06:00
Cassandra Heart
70b30ddde1
don't set within validator
2024-11-26 22:52:22 -06:00
Cassandra Heart
7b2de084fd
no, really, get out
2024-11-26 21:05:01 -06:00
Cassandra Heart
6fba1a3cd9
apply to set early
2024-11-26 21:02:08 -06:00
Cassandra Heart
75716be4fa
さよなら
2024-11-26 18:50:25 -06:00
petricadaipegsp
e836b00852
Vendor go-buffer-pool ( #389 )
...
* Vendor go-buffer-pool
* Do not use pointer pool
2024-11-26 05:22:46 -06:00
Cassandra Heart
3d58907e1c
bump patch version, support filtering on patch version
2024-11-24 18:44:14 -06:00
petricadaipegsp
7fd4d32521
Always start sync from head ( #386 )
...
* Always start sync from head
* Allow skips during sync using data time reel head
2024-11-24 18:09:17 -06:00
petricadaipegsp
ec37cb34d7
Add structured stop procedure ( #379 )
2024-11-24 17:07:15 -06:00
petricadaipegsp
d8321bf812
Deduplicate mint requests by public key ( #381 )
2024-11-24 17:06:16 -06:00
petricadaipegsp
f07d855970
blossomsub: Reintroduce GossipFactor ( #383 )
2024-11-24 17:04:33 -06:00
Cassandra Heart
2bd61786d6
Merge branch 'develop' into v2.0.4-p1
2024-11-23 22:20:37 -06:00
Cassandra Heart
269422b2f1
v2.0.4-p1
2024-11-23 22:20:29 -06:00
petricadaipegsp
a543a607be
IDONTWANT Support ( #376 )
...
* blossomsub: Remove unused mutex
* blossomsub: Add RPC queue
* blossomsub: Use RPC queue
* blossomsub: Add IDONTWANT control message to protos
* blossomsub: Add IDONTWANT tracing support
* blossomsub: Add pre-validation
* blossomsub: Add IDONTWANT feature flag
* blossomsub: Add IDONTWANT parameters
* blossomsub: Add IDONTWANT observability
* blossomsub: Send IDONTWANT control messages
* blossomsub: Handle IDONTWANT control messages
* blossomsub: Clear maps efficiently
* blossomsub: Increase IDONTWANT parameter defaults
* blossomsub: Do not send IDONTWANT to original sender
* blossomsub: Add IDONTWANT unit tests
2024-11-23 17:15:41 -06:00
Cassandra Heart
35d4b7a728
Merge branch 'develop' into v2.0.4-p1
2024-11-22 19:58:04 -06:00
petricadaipegsp
eaf565c15a
Fix gossip ( #378 )
...
* Observe control messages message count
* Fix copyRPC
* Fix message cache
2024-11-22 10:30:33 -06:00
Black Swan
849feddf84
enhance testnet frame pruning ( #377 )
...
* reduce testnet frame pruning delay to 1 minute
* set seniority repair cutoff frame for testnet to 25745
* add log message to confirm frame pruning is enabled
2024-11-22 10:29:48 -06:00
Cassandra Heart
292383be75
don't prune what is already pruned
2024-11-22 01:59:04 -06:00
Cassandra Heart
f2a3bd2d8e
don't try to make workers run if they aren't in ready state
2024-11-22 01:52:36 -06:00
Cassandra Heart
ca5d0579ea
bump version
2024-11-21 19:38:21 -06:00
petricadaipegsp
44ccd14871
Use buffered channels when applicable ( #373 )
...
* Use buffered channels when applicable
* Do not start additional goroutines for processing
* Use context to stop ongoing loops
2024-11-21 19:32:04 -06:00
petricadaipegsp
db66b3f118
Optimise token request duplicate handling ( #375 )
...
* Optimise token request duplicate handling
* Do not hold lock while applying transitions
2024-11-21 18:00:29 -06:00
Cassandra Heart
5e135d36de
Merge branch 'develop' into v2.0.4-p1
2024-11-20 20:31:57 -06:00
Cassandra Heart
df77d408dc
make it wait until one after
2024-11-20 20:31:46 -06:00
petricadaipegsp
b798de5871
Trigger sync on ahead peer ( #366 )
2024-11-20 17:12:57 -06:00
petricadaipegsp
883f0605ae
Enable AutoNATv1 and NATPortMap ( #372 )
2024-11-20 17:08:19 -06:00
petricadaipegsp
803cf4b7b3
Close direct channels if the connection is fresh ( #371 )
2024-11-20 17:07:28 -06:00
petricadaipegsp
cbc405a3a0
Refactor peer pinging to target individual connections ( #370 )
2024-11-20 17:05:10 -06:00
petricadaipegsp
4d3ac60e2b
Increase default sync timeout to 4 seconds ( #369 )
2024-11-20 16:59:24 -06:00
petricadaipegsp
8ce9aeee4e
Disallow excessive GOMAXPROCS ( #368 )
2024-11-20 16:59:09 -06:00
Cassandra Heart
5c94f5bc5e
Merge branch 'develop' into v2.0.4-p1
2024-11-19 16:55:57 -06:00
Cassandra Heart
9e28693581
make it wait until one after
2024-11-19 16:55:41 -06:00
petricadaipegsp
bc05a4d7b9
Adaptive reserved cores ( #363 )
...
* Add adaptive data worker count
* Use runtime worker count for validation workers
* Reserve cores for networking during transition application
* Automatically set GOGC and GOMEMLIMIT
2024-11-19 16:51:14 -06:00
Cassandra Heart
92d09a9c7c
Merge branch 'develop' into v2.0.4
2024-11-19 16:13:42 -06:00
Cassandra Heart
c8a77703ba
make it wait until one after
2024-11-19 04:43:36 -06:00
petricadaipegsp
d6234aa328
Avoid BlossomSubRouter race condition ( #364 )
2024-11-19 04:42:29 -06:00
Cassandra Heart
0b54808fe8
Merge branch 'develop' into v2.0.4
2024-11-19 00:06:01 -06:00
Cassandra Heart
a1e10b2d38
make it wait until one after
2024-11-19 00:04:43 -06:00
Cassandra Heart
91e8a16124
don't apply pruning until after seniority cutoff
2024-11-18 02:17:42 -06:00
Cassandra Heart
61179c13a0
node info should show worker counts
2024-11-18 02:03:37 -06:00
Cassandra Heart
c9be69ba28
seniority map repair
2024-11-18 01:45:50 -06:00
Cassandra Heart
4b69a40e56
more adjustment to validators
2024-11-17 16:22:32 -06:00
Cassandra Heart
5d1b572035
switch validators to sync
2024-11-17 16:00:51 -06:00
Cassandra Heart
063102eab2
adjust validators
2024-11-17 15:58:26 -06:00
Cassandra Heart
29a129d543
allow choice of indexed or non-indexed batches
2024-11-17 07:58:15 -06:00
Cassandra Heart
f511149b36
frame pruning
2024-11-17 04:37:55 -06:00
petricadaipegsp
14f7e3c40d
Throttle mint applications ( #360 )
2024-11-17 03:06:18 -06:00
petricadaipegsp
0b499c649c
Move time triggered synchronization to dedicated goroutine ( #359 )
2024-11-17 02:18:55 -06:00
Cassandra Heart
889fcac721
add timestamps and frame numbers to qclient token coins
2024-11-17 00:37:49 -06:00
Cassandra Heart
a798347ccf
re-add #358
2024-11-16 23:20:09 -06:00
Cassandra Heart
6e2c7f4028
Revert "Use buffered channels in the engines ( #357 )"
...
This reverts commit d32d79f58d .
2024-11-16 23:11:25 -06:00
Cassandra Heart
d97a093c18
remove logging in validators due to locking, allow 2.0.3 minversion
2024-11-16 23:11:19 -06:00
Cassandra Heart
fe34032b0d
unwind these
2024-11-16 18:40:43 -06:00
Cassandra Heart
706ec2997d
adjust runonce
2024-11-16 18:29:41 -06:00
Cassandra Heart
08e7dad8c9
parallelism of mints + don't overwrite map until commit time
2024-11-16 18:09:52 -06:00
Cassandra Heart
ddb67eb85b
and here
2024-11-16 17:58:57 -06:00
Cassandra Heart
36f581a16b
and here
2024-11-16 17:58:57 -06:00
Cassandra Heart
d63f587d40
reduce bandwidth on workers
2024-11-16 17:58:57 -06:00
Cassandra Heart
eda3729752
revert this
2024-11-16 17:58:56 -06:00
petricadaipegsp
d32d79f58d
Use buffered channels in the engines ( #357 )
...
* Make time data reel sending consistent
* Use buffered channels to avoid drops
2024-11-16 17:58:32 -06:00
petricadaipegsp
49566c2280
Add additional P2P configuration ( #352 )
...
* Add peer discovery configuration
* Add peer monitor configuration
* Add message validation configuration
---------
Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:54:34 -06:00
petricadaipegsp
80c7ec2889
Add initial Prometheus support ( #353 )
...
* Add Prometheus server
* Add Prometheus gRPC metrics
* Add BlossomSub metrics
---------
Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
2024-11-16 17:53:19 -06:00
petricadaipegsp
d57d76e627
Add transaction timestamps ( #354 )
2024-11-16 17:52:27 -06:00
petricadaipegsp
7819548b6f
Do not engage in PubSub with the bootstrappers ( #355 )
2024-11-16 17:51:31 -06:00
petricadaipegsp
da5b7a6126
Add sync timeout and make it async ( #356 )
...
* Add sync timeout
* Make sync async
2024-11-16 17:50:25 -06:00
Cassandra Heart
4a8e02e0b2
Merge branch 'develop' into v2.0.3-p4
2024-11-13 14:51:54 -06:00
Cassandra Heart
8b18568bae
the mystery of 6%
2024-11-13 14:51:41 -06:00
Cassandra Heart
4aa0a84a8b
Merge branch 'develop' into v2.0.3-p4
2024-11-13 11:59:17 -06:00
petricadaipegsp
37761ebd83
Log frame age ( #351 )
2024-11-13 11:36:49 -06:00
petricadaipegsp
2780b643d8
Fix BlossomSub router tracing ( #343 )
2024-11-13 11:36:21 -06:00
Cassandra Heart
38d92f45f8
revert this
2024-11-13 10:45:52 -06:00
Cassandra Heart
07a27d7dc6
set it under either case
2024-11-13 10:43:57 -06:00
petricadaipegsp
5333b4a8cc
Sample peers which are ahead during sync ( #337 )
2024-11-13 10:43:28 -06:00
petricadaipegsp
f06d2c0ff2
Ensure latest frame monotonicity ( #350 )
2024-11-13 10:41:23 -06:00
petricadaipegsp
5b05ed03d5
Fix engine option names ( #349 )
2024-11-13 10:40:24 -06:00
Cassandra Heart
fa93f01300
Merge branch 'v2.0.3-p4' into develop
2024-11-13 10:00:54 -06:00
Cassandra Heart
e58280b7e4
small adjustments
2024-11-13 10:00:37 -06:00
Cassandra Heart
79d6d1679a
Merge branch 'v2.0.3-p4' into develop
2024-11-13 06:36:14 -06:00
Cassandra Heart
22c0b55ab8
nil check
2024-11-13 06:36:08 -06:00
Cassandra Heart
c71649c662
Merge branch 'v2.0.3-p4' into develop
2024-11-13 06:16:37 -06:00
Cassandra Heart
5b3b0046f7
explicitly set key
2024-11-13 06:16:21 -06:00
Cassandra Heart
d5f971354c
Merge branch 'v2.0.3-p4' into develop
2024-11-13 06:08:17 -06:00
Cassandra Heart
f7a99053f4
version bump
2024-11-13 06:08:10 -06:00
Cassandra Heart
ea1ea1be90
set back for testnet
2024-11-13 06:06:01 -06:00
Cassandra Heart
b0a87b2fe4
wrapping up
2024-11-13 06:03:14 -06:00
Cassandra Heart
c2b9b1d460
resolve:
...
- critbit trie bug
- proof messages performing incorrect repeat
2024-11-13 00:10:22 -06:00
Cassandra Heart
71b13c5490
v2.0.3-p3
2024-11-12 03:33:20 -06:00
Cassandra Heart
d4a5e30ba2
v2.0.3-p3
2024-11-12 01:45:18 -06:00
Cassandra Heart
179446bb67
override frames
2024-11-12 01:23:02 -06:00
Cassandra Heart
9d7db3c85e
add repair
2024-11-12 01:14:52 -06:00
Cassandra Heart
a03590c5aa
handle verification conditions correctly
2024-11-12 00:36:36 -06:00
Cassandra Heart
c0f4b1b177
1, not 2
2024-11-11 15:53:28 -06:00
Cassandra Heart
7a1ba529b0
Merge branch 'develop' into v2.0.3-p2
2024-11-11 15:48:50 -06:00
petricadaipegsp
db28f1b81e
Remove vendored gostream ( #347 )
...
* Remove vendored go-libp2p-gostream
* Remove error wrapping
2024-11-11 15:05:45 -06:00
petricadaipegsp
3dbe0723bd
Add message validators ( #346 )
2024-11-11 14:10:00 -06:00
Cassandra Heart
26cbb2092e
rate limiter logic
2024-11-11 13:30:04 -06:00
Cassandra Heart
d5ebd54be6
reset 2
2024-11-11 11:52:23 -06:00
Cassandra Heart
ea5ed70aeb
don't penalize for tree mismatch
2024-11-11 11:47:26 -06:00
Cassandra Heart
b9694ddc99
fix rate limit
2024-11-11 11:32:11 -06:00
petricadaipegsp
de87f3f81b
Change frame delivery filter ( #345 )
2024-11-11 11:11:28 -06:00
petricadaipegsp
4e108bff07
Safe peer ID lookup from gostream ( #344 )
2024-11-11 11:10:53 -06:00
Cassandra Heart
2ce7eb26d4
change order of operations, don't commit an empty tree?
2024-11-11 04:39:52 -06:00
Cassandra Heart
1d262794cb
nil check
2024-11-11 03:50:13 -06:00
Cassandra Heart
4238b3ff5a
initial testnet v2.0.3-p2
2024-11-11 03:34:28 -06:00
Cassandra Heart
2b9c5afd54
fix nil deref
2024-11-11 03:33:35 -06:00
Cassandra Heart
77c036b94b
v2.0.3-p0
2024-11-11 03:33:35 -06:00
Cassandra Heart
e178153593
initial testnet v2.0.3-p2
2024-11-11 03:32:14 -06:00
Cassandra Heart
dcd5d80a27
fix nil deref
2024-11-10 21:20:22 -06:00
petricadaipegsp
05f1bf94fe
Remove additional signatures from data peer list announcements ( #335 )
...
* Do not verify data peer announcement signatures
* Do not sign data peer announcements explicitly
* Implement single peer data peer list announcement
2024-11-10 06:03:38 -06:00
Cassandra Heart
cf89b1c4ee
v2.0.3-p0
2024-11-10 01:15:15 -06:00
Cassandra Heart
df0262769b
switch default behavior and config value
2024-11-09 17:03:12 -06:00
Cassandra Heart
042848e7cb
minor nice-to-haves
2024-11-09 16:04:12 -06:00
Cassandra Heart
1c0d707f7d
add bounds check for proofs
2024-11-09 15:54:49 -06:00
Cassandra Heart
67d454acb9
add light prover support
2024-11-09 14:46:53 -06:00
Cassandra Heart
812939a97a
v2.0.3-b7
2024-11-08 20:29:30 -06:00
Cassandra Heart
71a3e70129
log to error
2024-11-08 04:47:58 -06:00
Cassandra Heart
b77fd36e2c
no fork, just new
2024-11-08 04:46:51 -06:00
Cassandra Heart
b7d57270bb
let's make it lower
2024-11-08 03:59:30 -06:00
Cassandra Heart
bc851de1bb
add testnet variant of seniority and penalties
2024-11-08 03:54:32 -06:00
Cassandra Heart
3a84cc65c8
ctrl-c = stop, damn it
2024-11-08 00:48:26 -06:00
Cassandra Heart
5f9ea8262f
don't do mainnet param on testnet
2024-11-07 20:17:26 -06:00
Cassandra Heart
9a6a8a7a8e
v2.0.3-b5
2024-11-07 20:06:59 -06:00
Cassandra Heart
7ac7fc2b67
v2.0.3-b4
2024-11-07 18:03:50 -06:00
Cassandra Heart
5c924eab68
add simple reapplication logic
2024-11-07 13:14:12 -06:00
Cassandra Heart
9bc8a84f1a
fix dangling mutex lock
2024-11-07 03:05:37 -06:00
Cassandra Heart
1361eeda8c
no parallelism for peer scan
2024-11-07 02:30:16 -06:00
Cassandra Heart
7ca0c9bd37
handle testnet
2024-11-07 01:55:03 -06:00
Cassandra Heart
32ed742489
fix rpc bug
2024-11-06 23:04:40 -06:00
Cassandra Heart
80be91d067
v2.0.3-b3
2024-11-06 21:43:55 -06:00
Cassandra Heart
84279f2b5c
handle mints with more failure proofing
2024-11-06 20:34:08 -06:00
Cassandra Heart
5851db6433
move this back
2024-11-06 18:04:54 -06:00
Cassandra Heart
cb0918212e
make proving check the prior landed
2024-11-06 16:35:50 -06:00