Commit Graph

2318 Commits

Author SHA1 Message Date
Hector Sanjuan
45e9a4c922 Feat: add --max-depth to the "refs" command
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-06-21 14:35:42 +02:00
Hector Sanjuan
2bd401c5c6 Feat: Arbitrary-depth recursive pin levels.
This implements #5133 introducing an option to limit how deep we fetch and store
the DAG associated to a recursive pin ("--max-depth"). This feature
comes motivated by the need to fetch and pin partial DAGs in order to do
DAG sharding with IPFS Cluster.

This means that, when pinning something to --max-depth, the DAG will be
fetched only to that depth and not more.

In order to get this, the PR introduces new recursive pin types: "recursive1"
means: the given CID is pinned along with its direct children (maxDepth=1)

"recursive2" means: the given CID is pinned along with its direct children
and its grandchildren.

And so on...

This required introducing "maxDepth" limits to all the functions walking down
DAGs (in merkledag, pin, core/commands, core/coreapi, exchange/reprovide modules).

maxDepth == -1 effectively acts as no-limit, and all these functions behave like
they did before.

In order to facilitate the task, a new CID Set type has been added:
thirdparty/recpinset. This set carries the MaxDepth associated to every Cid.
This allows to shortcut exploring already explored branches just like the original
cid.Set does. It also allows to store the Recursive pinset (and replaces cid.Set).
recpinset should be moved outside to a different repo eventually.

TODO: tests
TODO: refs -r with --max-depth

License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2018-06-21 14:35:42 +02:00
Whyrusleeping
b516aa1c31
Merge pull request #5122 from ipfs/kevina/filestore-hookup-fix
Fix how filestore is hooked up.
2018-06-18 01:56:52 +08:00
Steven Allen
dafe495376 extract ipns record logic to go-ipns
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-15 20:10:26 -07:00
Kevin Atkinson
a598a374e6 Fix how filestore is hooked up.
Closes #5121.

License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-06-15 02:33:01 -04:00
Whyrusleeping
cdc349790c
Merge pull request #5072 from Bren2010/review/core
Fix panic. Don't handle errors with fallthrough.
2018-06-13 15:30:58 +08:00
Whyrusleeping
aedc3217b5
Merge pull request #5107 from ipfs/fix/5102
improve swarm connect/disconnect commands
2018-06-13 15:29:02 +08:00
Rob Brackett
319f006386
Add package overview comments to coreapi
License: MIT
Signed-off-by: Rob Brackett <rob@robbrackett.com>
2018-06-12 15:56:15 -07:00
Steven Allen
78f82e8e79 allow disconnecting from a peer by ID
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-12 14:50:16 -07:00
Steven Allen
39febb1910 make ipfs swarm connect /ipfs/QmId work
fixes #5102

Also, allow specifying multiple addresses for a single peer.

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-12 14:37:29 -07:00
Steven Allen
85acad9a01 gx update go-log, sys, go-crypto
* go-log
* sys
* go-crypto

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-08 22:36:24 -07:00
Steven Allen
39f927aa04 update gx imports
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-05 23:55:08 -07:00
Steven Allen
b84a71de8c transport refactor update
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-05 23:51:06 -07:00
Steven Allen
c9c9986c9e update multiplexers
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-04 10:05:20 -07:00
Brendan McMillion
8387c394e9 Fix panic. Don't handle errors with fallthrough.
License: MIT
Signed-off-by: Brendan McMillion <brendan@cloudflare.com>
2018-06-03 13:58:58 -07:00
Whyrusleeping
f7a980926b
Merge pull request #4977 from ipfs/fix/4973-1
only resolve dnslinks once in the gateway
2018-06-03 17:20:45 +08:00
Steven Allen
e9928f7691 add test for 4973
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-02 20:43:00 -07:00
Steven Allen
31bb974bb1 only resolve dnslinks once in the gateway
If the domain has a DNS-Link, we want to use it even if it points to, e.g., an
IPNS address that doesn't resolve.

fixes #4973

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-02 20:43:00 -07:00
Steven Allen
a030455f3d fix key_test for peer ID inlining patch
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-05-31 18:29:22 -07:00
Steven Allen
1089eda84b cleanup namesys a bit
Remove ~50 lines of code, some casting, and a superfluous map (when go starts
looking like python, something's wrong).

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-05-31 18:29:22 -07:00
Steven Allen
60708ea60e store IPNS records *outside* of the DHT
fixes #4749

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-05-31 18:29:22 -07:00
Steven Allen
5dc0b7326e extract IPNS over pubsub as a ValueStore
And:

* Update for DHT changes.
* Switch to the new record validation system.

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-05-31 18:29:21 -07:00
Steven Allen
1e9e2f453c update deps
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-05-31 17:59:17 -07:00
Dominic Della Valle
56eb2b00d5 remove nofuse build constraints
License: MIT
Signed-off-by: Dominic Della Valle <ddvpublic@gmail.com>
2018-05-29 18:18:12 -04:00
Whyrusleeping
611d572ef2
Merge pull request #5022 from Bren2010/review/cmd/ipfs
Remove leftover bits of code.
2018-05-28 06:14:44 +01:00
Whyrusleeping
8c7c2ceb43
Merge pull request #5018 from forstmeier/fix/refs-goroutine-leak
Fix goroutine leaks in refs.go
2018-05-24 13:13:44 +02:00
Whyrusleeping
06f11bd81a
Merge pull request #5016 from alecbrick/fix/dag-goroutine-leak
Fix goroutine leak in dag put
2018-05-24 13:12:37 +02:00
Pierre-Alain TORET
1789888d47 Fix build on DragonFlyBSD
License: MIT
Signed-off-by: Pierre-Alain TORET <pierre-alain.toret@protonmail.com>
2018-05-21 17:23:42 +02:00
Brendan McMillion
80370f068b Remove leftover bits of code.
License: MIT
Signed-off-by: Brendan McMillion <brendan@cloudflare.com>
2018-05-16 21:48:08 -07:00
forstmeier
20b06c297c Fix goroutine leaks in refs.go
Description:
This addresses one of the listed problem files in #4414. I chose to
keep the return statement outside of the select statement on line
132 since that behavior was already there following the write to
out.

License: MIT
Signed-off-by: John Forstmeier <john.forstmeier@gmail.com>
2018-05-14 15:50:51 -04:00
Whyrusleeping
b3faaad131
Merge pull request #4952 from ipfs/fix/4951
report error source when failing to construct private network
2018-05-12 13:18:20 +01:00
Whyrusleeping
053f123461
Merge pull request #4962 from grokcoder/fix/core/commands
Fix key rename command output error
2018-05-12 12:15:38 +01:00
Alec Brickner
4a59b557e7 Fix goroutine leak in dag put
License: MIT
Signed-off-by: Alec Brickner <alecjbrick@gmail.com>
2018-05-12 03:38:38 -07:00
Alec Brickner
f3f186b493 Fix goroutine leak in pin
License: MIT
Signed-off-by: Alec Brickner <alecjbrick@gmail.com>
2018-05-10 19:08:10 -07:00
Jakub Sztandera
0aa9c0d3e6 fix: format of pnet error message
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2018-05-09 15:34:05 +02:00
Steven Allen
6cf42b54b6 report error source when failing to construct private network
fixes #4951

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-05-09 15:33:30 +02:00
Dominic Della Valle
b675ade0d8 gx: update go-ipfs-cmds
License: MIT
Signed-off-by: Dominic Della Valle <ddvpublic@gmail.com>
2018-04-24 15:01:16 -04:00
Xiaoyi Wang
b7ce80c0f5 Fix key rename command output error
License: MIT
Signed-off-by: Xiaoyi Wang <wangxiaoyi@hyperchain.cn>
2018-04-22 11:45:37 +08:00
Łukasz Magiera
3c32040ad8 fix unused imports
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-04-20 16:53:09 +02:00
Whyrusleeping
c225c344e4
Merge pull request #4833 from ipfs/misc/remove-dead-code
misc: Remove some dead code
2018-04-20 23:39:55 +09:00
Whyrusleeping
076fd91e5f
Merge pull request #4835 from ipfs/fix/typos
misc: Fix a few typos
2018-04-20 23:35:58 +09:00
Hector Sanjuan
8e63ddf7c8 fix json
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2018-04-19 12:13:33 +02:00
Hector Sanjuan
df59b29fdc Extract exchange/offline to go-ipfs-exchange offline
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2018-04-19 12:07:36 +02:00
Hector Sanjuan
9955208f8b Extract: exchange/interface.go to go-ipfs-exchange-interface
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2018-04-19 12:07:30 +02:00
Whyrusleeping
8c00a74190
Merge pull request #4846 from ipfs/feat/profile-help
Fix missing profile docs
2018-04-08 09:42:08 +09:00
Łukasz Magiera
b290286dd7 misc: Fix a few typos
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-03-30 09:47:22 +02:00
Łukasz Magiera
2ee5cfb90f fix error style
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-03-30 09:43:27 +02:00
Whyrusleeping
fa9489ef72
Merge pull request #4631 from ipfs/refactor/extract-fs-lock
refactor: extract fs lock into go-fs-lock
2018-03-29 17:59:04 -07:00
Whyrusleeping
9ed9ab5772
Merge pull request #4807 from ipfs/feat/coreapi/refactor-opts
coreapi: Refactor options
2018-03-29 16:53:42 -07:00
dignifiedquire
816787448f refactor: extract fs lock into go-fs-lock
License: MIT
Signed-off-by: dignifiedquire <dignifiedquire@gmail.com>
2018-03-29 12:22:33 -07:00