258 Commits

Author	SHA1	Message	Date
Marcin Rataj	ca4b6121ef	feat: ipfs-webui v4.6 (#10756) ... https://github.com/ipfs/ipfs-webui/releases/tag/v4.6.0 (cherry picked from commit b2efaa992f)	2025-03-14 18:21:50 +01:00
Andrew Gillis	441c0f590f	Upgrade to Boxo v0.29.1 (#10755) ... * Upgrade to Boxo v0.29.1 (cherry picked from commit 183dc7d40a)	2025-03-14 18:21:16 +01:00
Guillaume Michel	8af7f131e7	Update docs/changelogs/v0.34.md ... (cherry picked from commit 9de938479c)	2025-03-14 18:20:14 +01:00
Hector Sanjuan	c953abb431	provider: buffer pin providers. ... Fixes #10596. The reproviding process can take long. Currently, each CID to be provided is obtained by making a query to the pinner and reading one by one as the CIDs get provided. While this query is ongoing, the pinner holds a Read mutex on the pinset. If a pin-add-request arrives, a goroutine will start waiting for a Write mutex on the pinset. From that point, no new Read mutexes can be taken until the writer can proceed and finishes. However, no one can proceed because the read mutex is still held while the reproviding is ongoing. The fix is mostly in Boxo, where we add a "buffered" provider which reads the cids onto memory so that they can be provided at its own pace without making everyone wait. The consequence is we will need more RAM memory. Rule of thumb is 1GiB extra per 20M cids to be reprovided. (cherry picked from commit ba22102a64)	2025-03-14 18:20:00 +01:00
Abhinav Prakash	e221e941c7	fix(mfs): basic UnixFS sanity checks in files cp (#10701) ... Signed-off-by: Abhinav Prakash <abhinav.prakash319@gmail.com> Co-authored-by: Marcin Rataj <lidel@lidel.org> Co-authored-by: Andrew Gillis <11790789+gammazero@users.noreply.github.com>	2025-03-05 20:40:33 +01:00
Andrew Gillis	86aee74167	Upgrade to Boxo v0.29.0 (#10742) ... * Upgrade to Boxo v0.29.0 * update changelog	2025-03-04 22:15:53 -08:00
Marco Munizaga	baa94fcb2f	chore: update go-libp2p to v0.41.0 (#10733) ... https://github.com/libp2p/go-libp2p/releases/tag/v0.41.0 Co-authored-by: Marcin Rataj <lidel@lidel.org>	2025-02-25 23:50:45 +01:00
Marcin Rataj	652d94b2b1	feat: ipfs-webui v4.5.0 (#10735) ... https://github.com/ipfs/ipfs-webui/releases/tag/v4.5.0	2025-02-25 23:31:10 +01:00
Marcin Rataj	d6a5bc0b68	feat(AutoTLS): enabled by default with 1h RegistrationDelay (#10724) ... Enables AutoTLS by default, but delays registration by 1h if user did not explicitly set `AutoTLS.Enabled` to `true`	2025-02-25 22:25:58 +01:00
Andrew Gillis	eb53bbfa6c	Update go-ds-badger to v0.3.1 (#10722) ... * Update go-ds-badger to v0.3.1 * update changelog * update changelog	2025-02-18 16:50:35 +01:00
Andrew Gillis	e41dc120f7	Update pebble db to latest format by default (#10720) ... * Update pebble db to latest format by default If the pebble database format is not explicitly set in the config, then set it to the latest format version by default. This will ensure that the database format is sufficiently up-to-date to be compatible with a major version upgrade of pebble.	2025-02-17 15:32:53 -08:00
Russell Dempsey	40a7a388a4	fix: switch away from IPFS_LOG_LEVEL (#10694)	2025-02-14 18:25:31 +00:00
Marcin Rataj	b61dd6bf80	Merge remote-tracking branch 'origin/master' into merge-release-v0.33.2	2025-02-14 01:30:03 +01:00
Marcin Rataj	ba31701b5d	docs: v0.33.2	2025-02-13 23:42:47 +01:00
Marcin Rataj	8942a17b92	fix: v0.33.2 with go-libp2p v0.38.3 ... https://github.com/libp2p/go-libp2p/releases/tag/v0.38.3	2025-02-13 21:58:59 +01:00
Marcin Rataj	e77a484aa8	fix(rpc): restore and reprecate bitswap reprovide (#10699) ... https://github.com/ipfs/kubo/pull/10677 removed command without properly deprecating it first, this restores it and marks as deprecated we can remove it after at least 1 release with deprecation being announced	2025-02-10 16:12:53 +01:00
Marcin Rataj	aa72a12199	Merge branch 'master' into merge-release-v0.33.1	2025-02-04 22:55:57 +01:00
Marcin Rataj	30d5f8e9b9	docs(changelog): v0.33.1	2025-02-04 20:29:28 +01:00
Andrew Gillis	bddd4c60da	fix: boxo v0.27.4 (#10692) ... https://github.com/ipfs/boxo/releases/tag/v0.27.4 Co-authored-by: Marcin Rataj <lidel@lidel.org> (cherry picked from commit e727f097ca)	2025-02-04 18:51:21 +01:00
Andrew Gillis	e727f097ca	fix: boxo v0.27.4 (#10692) ... https://github.com/ipfs/boxo/releases/tag/v0.27.4 Co-authored-by: Marcin Rataj <lidel@lidel.org>	2025-02-04 18:47:43 +01:00
Daniel Norman	70a8de4d1b	docs: add webrtc-direct fixes to 0.33 release changelog (#10688) ... (cherry picked from commit e08c7cb31d)	2025-02-04 18:08:56 +01:00
Sergey Gorbunov	032ceaf5d1	fix: Issue #9364 JSON config validation (#10679) ... * Fix JSON config validation * updated ReflectToMap --------- Co-authored-by: galargh <piotr.galar@gmail.com> Co-authored-by: Guillaume Michel <guillaumemichel@users.noreply.github.com> Co-authored-by: guillaumemichel <guillaume@michel.id>	2025-02-04 17:26:36 +01:00
Sergey Gorbunov	b35555978d	feat: Better self-service commands for DHT providing (#10677) ... * Add lastRun, NextRun, move reprovide cmd to routing. * acceleratedDHT logic * changelog * depend on latest boxo --------- Co-authored-by: guillaumemichel <guillaume@michel.id> Co-authored-by: Guillaume Michel <guillaumemichel@users.noreply.github.com>	2025-01-31 16:33:11 +01:00
Daniel Norman	e08c7cb31d	docs: add webrtc-direct fixes to 0.33 release changelog (#10688)	2025-01-31 16:20:50 +01:00
youyyytrok	9adab295e0	feat: Add CI for Spell Checking (#10637) ... * Create spellcheck.yml * Create .codespell-ignore --------- Co-authored-by: Marcin Rataj <lidel@lidel.org> Co-authored-by: Guillaume Michel <guillaumemichel@users.noreply.github.com>	2025-01-30 17:50:51 +01:00
Marcin Rataj	8d199128a1	chore: changelog for 0.34	2025-01-29 23:38:02 +01:00
Marcin Rataj	b4b5d78f26	docs: 0.33.0	2025-01-29 21:42:45 +01:00
Marcin Rataj	033de22e3b	fix: quic-go v0.49.0 (#10673) ... https://github.com/quic-go/quic-go/releases/tag/v0.49.0 (cherry picked from commit 82945a9392)	2025-01-23 19:11:59 +01:00
Andrew Gillis	62ff2e6d37	Upgrade to Boxo v0.27.2 (#10672) ... * Upgrade to Boxo v0.27.2 (cherry picked from commit a26aee1a11)	2025-01-23 16:49:36 +01:00
Marcin Rataj	6426e191bc	chore: 0.33.0-rc2	2025-01-22 22:43:44 +01:00
Andrew Gillis	5fdd87c850	Upgrade to Boxo v0.27.1 (#10671) ... * Upgrade to Boxo v0.27.1 * update changelog * use tagged release of boxo (cherry picked from commit fcfdbfb32e)	2025-01-22 22:32:22 +01:00
Marcin Rataj	00cb38865f	fix(autotls): renewal and AutoTLS.ShortAddrs (#10669) ... * fix(autotls): renewal and AutoTLS.ShortAddrs updates to p2p-forge/client with fix from https://github.com/ipshipyard/p2p-forge/pull/42 we also add AutoTLS.ShortAddrs flag and enable it by default to benefit from shorter addrs discusses in https://github.com/ipshipyard/p2p-forge/pull/40 * test: fix flaky NewRandPort reducing chance of bind: address already in use (cherry picked from commit 256a739e3b)	2025-01-22 17:41:03 +01:00
Andrew Gillis	c51d7cd684	update changelog for boxo and go-libp2p (#10668) ... (cherry picked from commit d0bc598e05)	2025-01-22 17:40:45 +01:00
Marcin Rataj	6aa7d99fe4	fix(dns): update default DNSLink resolvers (#10655) ... * fix(dns): update default DNSLink resolvers Depends on - https://github.com/ipfs/boxo/pull/781 - https://github.com/ipfs/boxo/pull/782 * chore: latest boxo main and go-doh-resolver v0.5.0 makes error message better, informing which URL failled * chore: p2p-forge v0.2.1+ this removes acmez/v2 and fixes go vet * chore: latest boxo with DoH fixes commit from main branch that includes: https://github.com/ipfs/boxo/pull/645 https://github.com/ipfs/boxo/pull/782 https://github.com/ipfs/boxo/pull/781 (cherry picked from commit b021a00bf6)	2025-01-14 22:24:04 +01:00
Marcin Rataj	89c6e7eb89	chore: p2p-forge v0.2.2 + go-libp2p-kad-dht v0.28.2 (#10663) ... * chore: p2p-forge v0.2.2 https://github.com/ipshipyard/p2p-forge/releases/tag/v0.2.2 * chore: go-libp2p-kad-dht v0.28.2 https://github.com/libp2p/go-libp2p-kad-dht/releases/tag/v0.28.2 (cherry picked from commit 5f8dd91c3c)	2025-01-14 01:57:03 +01:00
Marcin Rataj	9386fdcdfb	fix(cli): support HTTPS in ipfs --api (#10659) ... * fix(cli): support HTTPS in ipfs --api Closes #10539 * chore: go-ipfs-cmds v0.14.1 https://github.com/ipfs/go-ipfs-cmds/releases/tag/v0.14.1 * docs: ipfs --api example * test(cli): https rpc support makes sure we dont have regression where HTTPS endpoint starts getting cleartext requests (cherry picked from commit 3b098b969a)	2025-01-13 18:58:03 +01:00
Andrew Gillis	5e1bacc2a8	fix/gateway: escape directory redirect url (#10649) ... * fix/gateway: escape directory redirect URLs When a director gets redirected to a URL with a treailing slash, special chars in the directory name must be escaped in the redirect URL. This upgrades to a version of box that has that fix. Closes #10536 * Fix sharness test for new redirect URLs * Update to latest boxo * Use latest gateway-conformance (cherry picked from commit b7cc47aef5)	2025-01-13 18:56:20 +01:00
Andrew Gillis	53792003bd	collection of typo fixes (#10647) ... (cherry picked from commit 9425421114)	2025-01-13 18:55:10 +01:00
Marcin Rataj	9282f08188	fix: ipfs-webui v4.4.2 (#10635) ... https://github.com/ipfs/ipfs-webui/releases/tag/v4.4.2	2024-12-20 19:24:21 +01:00
Adin Schmahmann	397c346ae0	feat(libp2p): shared TCP listeners and AutoTLS.AutoWSS (#10565) ... * feat(libp2p): enable shared TCP listeners * docs: switch mentions of /ws to /tcp/4001 * feat: AutoTLS.AutoWSS This adds AutoTLS.AutoWSS flag that is set to true by default. It will check if Addresses.Swarm contain explicit /ws listener, and if not found, it will append one per every /tcp listener This way existing TCP ports are reused without any extra configuration, but we don't break user's who have custom / explicit /ws listener already. I also moved logger around, to include Addresses.Swarm inspection results in `autotls` logger. * chore: go-libp2p v0.38.1 https://github.com/libp2p/go-libp2p/releases/tag/v0.38.0 https://github.com/libp2p/go-libp2p/releases/tag/v0.38.1 * docs: AutoTLS.AutoWSS and go-libp2p v0.38.x * chore: p2p-forge/client v0.2.0 https://github.com/ipshipyard/p2p-forge/releases/tag/v0.2.0 * fix: disable libp2p.ShareTCPListener() in PNET * chore(ci): timeout sharness after 15m average successful run is <9 minutes, no need to wait for 20 https://github.com/ipfs/kubo/actions/workflows/sharness.yml?query=is%3Asuccess --------- Co-authored-by: Andrew Gillis <11790789+gammazero@users.noreply.github.com> Co-authored-by: Marcin Rataj <lidel@lidel.org>	2024-12-20 18:41:25 +01:00
Marcin Rataj	f2c190535c	feat(flatfs): default to sync=false (#10632)	2024-12-19 16:14:45 -08:00
Hector Sanjuan	519ae27dce	feat: expose BlockKeyCacheSize and enable WriteThrough datastore options (#10614) ... * feat: expose BlockKeyCacheSize and enable WriteThrough when bloom filter disabled * import/config: add BatchMaxSize and BatchMaxNodes * config: make BlockKeyCacheSize an OptionalInteger * config: add and wire datastore.WriteThrough option * config: omitempty on BlockKeyCacheSize * changelog: rewrite entry about new options for the datastore * config: add docs for BatchMaxNodes and BatchMaxSize * config: make WriteThrough an optional Flag * changelog: improve description of new datastore/import options * refactor: DefaultWriteThrough as bool * chore: boxo v0.26.0 * docs: config and changelog fixes	2024-12-19 23:12:05 +00:00
Hector Sanjuan	ecb25581c6	cmd/files: flush parent folders (#10630) ... * cmd/files: flush parent folders This is a mitigation to increased MFS memory usage in the course of many writes operations. The underlying issue is the unbounded growth of the mfs directory cache in boxo. In the latest boxo version, this cache can be cleared by calling Flush() on the folder. In order to trigger that, we call Flush() on the parent folder of the file/folder where the write-operations are happening. To flushing the parent folder allows it to grow unbounded. Then, any read operation to that folder or parents (i.e. stat), will trigger a sync-operation to match the cache to the underlying unixfs structure (and obtain the correct node-cid). This sync operation must visit every item in the cache. When the cache has grown too much, and the underlying unixfs-folder has switched into a HAMT, the operation can take minutes. Thus, we should clear the cache often and the Flush flag is a good indicator that we can let it go. Users can always run with --flush=false and flush at regular intervals during their MFS writes if they want to extract some performance. Fixes #8694, #10588. * cmd/files: docs and changelog for --flush changes	2024-12-19 14:07:17 -08:00
Andrew Gillis	7c49860061	Upgrade to Boxo v0.26.0 (#10631) ... * Upgrade to Boxo v0.26.0 * Update docs/changelogs/v0.33.md	2024-12-19 13:54:02 -08:00
Andrew Gillis	19dc712498	chore: boxo v0.25.0 (#10619) ... https://github.com/ipfs/boxo/releases/tag/v0.25.0	2024-12-09 23:25:44 +01:00
Hector Sanjuan	433444b609	fix(cmds/add): disallow --wrap with --to-files (#10612) ... Close #10611 Co-authored-by: Marcin Rataj <lidel@lidel.org>	2024-12-03 21:49:18 +01:00
Marcin Rataj	53e793afdd	fix: ipfs-webui v4.4.1 (#10608) ... https://github.com/ipfs/ipfs-webui/releases/tag/v4.4.1	2024-12-03 20:11:34 +01:00
Marten Seemann	778a418952	refactor(rcmgr): use default libp2p rcmgr metrics (#9947) ... Co-authored-by: Marcin Rataj <lidel@lidel.org>	2024-11-27 20:50:43 +01:00
Hector Sanjuan	9433105a85	docs(changelog/v0.33): bitswap reprovide changes (#10604)	2024-11-27 19:40:16 +01:00
Marcin Rataj	3b2c2698e7	chore: p2p-forge/client v0.1.0 (#10605)	2024-11-27 19:28:11 +01:00