* wip: conversion of hotstuff from flow into Q-oriented model
* bulk of tests
* remaining non-integration tests
* add integration test, adjust log interface, small tweaks
* further adjustments, restore full pacemaker shape
* add component lifecycle management+supervisor
* further refinements
* resolve timeout hanging
* mostly finalized state for consensus
* bulk of engine swap out
* lifecycle-ify most types
* wiring nearly complete, missing needed hooks for proposals
* plugged in, vetting message validation paths
* global consensus, plugged in and verified
* app shard now wired in too
* do not decode empty keys.yml (#456)
* remove obsolete engine.maxFrames config parameter (#454)
* default to Info log level unless debug is enabled (#453)
* respect config's "logging" section params, remove obsolete single-file logging (#452)
* Trivial code cleanup aiming to reduce Go compiler warnings (#451)
* simplify range traversal
* simplify channel read for single select case
* delete rand.Seed() deprecated in Go 1.20 and no-op as of Go 1.24
* simplify range traversal
* simplify channel read for single select case
* remove redundant type from array
* simplify range traversal
* simplify channel read for single select case
* RC slate
* finalize 2.1.0.5
* Update comments in StrictMonotonicCounter
Fix comment formatting and clarify description.
---------
Co-authored-by: Black Swan <3999712+blacks1ne@users.noreply.github.com>
* v2.1.0.2
* restore tweaks to simlibp2p
* fix: nil ref on size calc
* fix: panic should induce shutdown from event_distributor
* fix: friendlier initialization that requires less manual kickstarting for test/devnets
* fix: fewer available shards than provers should choose shard length
* fix: update stored worker registry, improve logging for debug mode
* fix: shut the fuck up, peer log
* qol: log value should be snake cased
* fix:non-archive snap sync issues
* fix: separate X448/Decaf448 signed keys, add onion key to registry
* fix: overflow arithmetic on frame number comparison
* fix: worker registration should be idempotent if inputs are same, otherwise permit updated records
* fix: remove global prover state from size calculation
* fix: divide by zero case
* fix: eager prover
* fix: broadcast listener default
* qol: diagnostic data for peer authenticator
* fix: master/worker connectivity issue in sparse networks
tight coupling of peer and workers can sometimes interfere if mesh is sparse, so give workers a pseudoidentity but publish messages with the proper peer key
* fix: reorder steps of join creation
* fix: join verify frame source + ensure domain is properly padded (unnecessary but good for consistency)
* fix: add delegate to protobuf <-> reified join conversion
* fix: preempt prover from planning with no workers
* fix: use the unallocated workers to generate a proof
* qol: underflow causes join fail in first ten frames on test/devnets
* qol: small logging tweaks for easier log correlation in debug mode
* qol: use fisher-yates shuffle to ensure prover allocations are evenly distributed when scores are equal
* qol: separate decisional logic on post-enrollment confirmation into consensus engine, proposer, and worker manager where relevant, refactor out scoring
* reuse shard descriptors for both join planning and confirm/reject decisions
* fix: add missing interface method and amend test blossomsub to use new peer id basis
* fix: only check allocations if they exist
* fix: pomw mint proof data needs to be hierarchically under global intrinsic domain
* staging temporary state under diagnostics
* fix: first phase of distributed lock refactoring
* fix: compute intrinsic locking
* fix: hypergraph intrinsic locking
* fix: token intrinsic locking
* fix: update execution engines to support new locking model
* fix: adjust tests with new execution shape
* fix: weave in lock/unlock semantics to liveness provider
* fix lock fallthrough, add missing allocation update
* qol: additional logging for diagnostics, also testnet/devnet handling for confirmations
* fix: establish grace period on halt scenario to permit recovery
* fix: support test/devnet defaults for coverage scenarios
* fix: nil ref on consensus halts for non-archive nodes
* fix: remove unnecessary prefix from prover ref
* add test coverage for fork choice behaviors and replay – once passing, blocker (2) is resolved
* fix: no fork replay on repeat for non-archive nodes, snap now behaves correctly
* rollup of pre-liveness check lock interactions
* ahead of tests, get the protobuf/metrics-related changes out so teams can prepare
* add test coverage for distributed lock behaviors – once passing, blocker (3) is resolved
* fix: blocker (3)
* Dev docs improvements (#445)
* Make install deps script more robust
* Improve testing instructions
* Worker node should stop upon OS SIGINT/SIGTERM signal (#447)
* move pebble close to Stop()
* move deferred Stop() to Start()
* add core id to worker stop log message
* create done os signal channel and stop worker upon message to it
---------
Co-authored-by: Cassandra Heart <7929478+CassOnMars@users.noreply.github.com>
---------
Co-authored-by: Daz <daz_the_corgi@proton.me>
Co-authored-by: Black Swan <3999712+blacks1ne@users.noreply.github.com>
* Add adaptive data worker count
* Use runtime worker count for validation workers
* Reserve cores for networking during transition application
* Automatically set GOGC and GOMEMLIMIT
* Update qcommander.sh bootrap (#304)
* v2.0.1 (#308)
* roll up v2.0.1-b2 to develop
* b2-fixed
* adjust return data of fast sync so it doesn't return the earliest frame
* -b3
* fix: announce peer based on leading frame, not initial frame; fix: looping bug
* fix: last batch fails due to underflow; qol: make logging chattier
* -b4
* resolve frame cache issue
* fix: mint loop + re-migrate
* fix: register execution panic
* fix: mint loop, other side
* fix: handle unexpected return of nil status
* final -b4
* handle subtle change to migration
* qol: add heuristic to handle corruption scenario
* bump genesis
* qol: use separate channel for worker
* final parameterization, parallelize streams
* deprecate signers 10, 11, 14, 17
* adjust signatory check size to match rotated out signers
* V2.0.2.3 (#321)
* roll up v2.0.1-b2 to develop
* b2-fixed
* adjust return data of fast sync so it doesn't return the earliest frame
* -b3
* fix: announce peer based on leading frame, not initial frame; fix: looping bug
* fix: last batch fails due to underflow; qol: make logging chattier
* -b4
* resolve frame cache issue
* fix: mint loop + re-migrate
* fix: register execution panic
* fix: mint loop, other side
* fix: handle unexpected return of nil status
* final -b4
* handle subtle change to migration
* qol: add heuristic to handle corruption scenario
* bump genesis
* qol: use separate channel for worker
* final parameterization, parallelize streams
* Add direct peers to blossomsub (#309)
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
* chore(docker): add ca-certificates to fix x509 error. (#307)
* Update qcommander.sh bootrap (#304)
* chore(docker): add ca-certificates to fix x509 error.
---------
Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
* deprecate signers 10, 11, 14, 17
* adjust signatory check size to match rotated out signers
* qol: sync by rebroadcast
* upgrade version
* more small adjustments
* wait a little longer
* fix: don't use iterator for frame directly until iterator is fixed
* change iterator, genesis for testnet
* adjust to previous sync handling
* adjust: don't grab the very latest while it's already being broadcasted
* ok, ready for testnet
* handle rebroadcast quirks
* more adjustments from testing
* faster
* temporarily bulk process on frame candidates
* resolve separate frames
* don't loop
* make worker reset resume to check where it should continue
* move window
* reduce signature count now that supermajority signed last
* resolve bottlenecks
* remove GOMAXPROCS limit for now
* revisions for v2.0.2.1
* bump version
* bulk import
* reintroduce sync
* small adustments to make life better
* check bitmask for peers and keep alive
* adjust reconnect
* ensure peer doesn't fall off address list
* adjust blossomsub to background discovery
* bump version
* remove dev check
* remove debug log line
* further adjustments
* a little more logic around connection management
* v2.0.2.3
* Fix peer discovery (#319)
* Fix peer discovery
* Make peer discovery connections parallel
* Monitor peers via pings (#317)
* Support QUILIBRIUM_SIGNATURE_CHECK in client (#314)
* Ensure direct peers are not pruned by resource limits (#315)
* Support pprof profiling via HTTP (#313)
* Fix CPU profiling
* Add pprof server support
* Additional peering connection improvements (#320)
* Lookup peers if not enough external peers are available
* Make bootstrap peer discovery sensitive to a lack of bootstrappers
---------
Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
Co-authored-by: linquanisaac <33619994+linquanisaac@users.noreply.github.com>
Co-authored-by: petricadaipegsp <155911522+petricadaipegsp@users.noreply.github.com>
---------
Co-authored-by: Tyler Sturos <55340199+tjsturos@users.noreply.github.com>
Co-authored-by: Tyler Sturos <tyler.john@qcommander.sh>
Co-authored-by: linquanisaac <33619994+linquanisaac@users.noreply.github.com>
Co-authored-by: petricadaipegsp <155911522+petricadaipegsp@users.noreply.github.com>
