Commit Graph

8779 Commits

Author SHA1 Message Date
Lucas Molas
26feaeb0cc unixfs: fix FSNode accessor in NewDirectoryFromNode
License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>
2018-07-16 12:27:43 -03:00
Whyrusleeping
419bfdc20f
Merge pull request #4924 from ipfs/docs/config
Add information about bloom filter to config.md
2018-07-16 17:12:10 +02:00
Whyrusleeping
b126601d80
Merge pull request #5160 from schomatis/feat/unixfs/dir-interface
unixfs: add a directory interface
2018-07-16 16:53:36 +02:00
Whyrusleeping
8fa1c881f1
Merge pull request #5205 from spartucus/patch-1
Refactor code
2018-07-16 16:52:58 +02:00
Whyrusleeping
bda81cd2d4
Merge pull request #5045 from schomatis/fix/cmd/files-ls-file-long
cmd: fix `files ls` to report hash and size for files
2018-07-16 16:52:13 +02:00
Jeromy
7927196fe4 version bump to 0.4.17-dev
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2018-07-16 07:51:26 -07:00
Whyrusleeping
07feeec9c4
Merge pull request #5010 from ipfs/feat/diskusage2
Efficient "repo stat" (DiskUsage) and "--size-only" flag
2018-07-16 16:50:41 +02:00
Whyrusleeping
4f1391f477
Merge pull request #5139 from achingbrain/feat/specify-object-data-encoding
feat: Allow specifing how object data is encoded
2018-07-16 16:49:31 +02:00
Whyrusleeping
51607243c2
Merge pull request #5170 from schomatis/feat/mfs/root-val-as-dir
mfs: make `Root` value a `Directory`
2018-07-16 16:48:06 +02:00
Whyrusleeping
61d08eea4b
Merge pull request #5189 from schomatis/feat/pbdagreader/use-fsnode
pbdagreader: use FSNode instead of protobuf structure
2018-07-16 16:47:41 +02:00
Whyrusleeping
c9cda2c765
Merge pull request #5190 from schomatis/fix/dagreader/remove-offset
dagreader: remove `Offset()` method
2018-07-16 16:47:29 +02:00
Whyrusleeping
95f721c4df
Merge pull request #4896 from ipfs/feat/ai-mirror
URL store
2018-07-13 17:08:59 +02:00
Kevin Atkinson
1f29699d90 Address c.r. and additional tweaks.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:52 -04:00
Kevin Atkinson
8dd970b73a filestore: Return consistent err msg. when file/urlstore is not enabled.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:52 -04:00
Kevin Atkinson
6a4b1262a5 Make sure you can't add URL's unless the url store is enabled.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:52 -04:00
Kevin Atkinson
0c2efb90d3 More test fixes.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:52 -04:00
Kevin Atkinson
ed2bb81b8d Code cleanups to make code climate happy.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:52 -04:00
Kevin Atkinson
0e24444280 Add some documentation to ipfs urlstore add command.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:52 -04:00
Kevin Atkinson
b3457f240c Enhance tests.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:52 -04:00
Kevin Atkinson
e5189f4230 Return better error code when an http request failed.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:51 -04:00
Kevin Atkinson
90972095a9 Add test cases for urlstore.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:51 -04:00
Kevin Atkinson
b53a1b3022 Add config option to enable urlstore.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:51 -04:00
Kevin Atkinson
696a0f039e Simplify code: use prefix instead of flag to determine if a url
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:07:51 -04:00
Kevin Atkinson
d59a6e99a6 Fix "ipfs urlstore add" output.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-07-13 09:04:22 -04:00
Jakub Sztandera
1a835202b2 filestore: add URLStore
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2018-07-13 09:04:22 -04:00
Whyrusleeping
92ac43afef
Merge pull request #5179 from ipfs/release-0.4.16
Ipfs 0.4.16 release
2018-07-13 13:06:39 +02:00
Jeromy
7bcc9caa84 Ipfs 0.4.16 release
License: MIT
Signed-off-by: Whyrusleeping <why@ipfs.com>
2018-07-13 13:00:41 +02:00
Steven Allen
265295c789 add a note about the fixed js interop
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-13 13:00:23 +02:00
Rob Brackett
da061c2faf Tweak grammar and language in changelog
License: MIT
Signed-off-by: Rob Brackett <rob@robbrackett.com>
2018-07-13 13:00:23 +02:00
Steven Allen
6018de3fb5 add a note about the repo migration
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-13 13:00:23 +02:00
Steven Allen
8f51d011a3 paragraphs
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-13 13:00:23 +02:00
Whyrusleeping
a9efa7e201
Merge pull request #5214 from ipfs/gx/release-0.4.16-rc3
publish the gx 0.4.16-rc3 release
2018-07-11 15:53:09 +02:00
Steven Allen
bf0750a3c1 publish the gx 0.4.16-rc3 release
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-11 13:37:44 +02:00
Whyrusleeping
7207b1c1c9
Merge pull request #5207 from ipfs/release-0.4.16-rc3
Ipfs v0.4.16-rc3
2018-07-09 08:53:27 -07:00
Jeromy
310b16528b Ipfs v0.4.16-rc3
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2018-07-09 08:46:20 -07:00
Lucas Molas
c47cd13c0b unixfs: remove unused ShardSplitThreshold variable
License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>
2018-07-09 12:02:47 -03:00
Lucas Molas
7d531c00ac unixfs: add a directory interface
Add a UnixFS `Directory` that hides implementation details and helps to
distinguish *what* is a UnixFS directory.

Replace the `unixfs.io.Directory` structure that contained the HAMT and basic
directory implementations (through inner pointers) with an interface containing
the same methods. Implement those methods in two clearly distinct structures for
each implementation (`BasicDirectory` and `HAMTDirectory`) avoiding pointer
logic and clearly differentiating which implementation does what.

The potential basic to HAMT transition was being hidden behind the `AddChild`
call at the UnixFS layer (changing one implementation pointer  with the other
one), it is now being explicitly done at the MFS layer.

Rename the `dirbuilder.go` file to `directory.go` and change the `Directory` MFS
attribute `dirbuilder` to `unixfsDir` to be consistent.

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>
2018-07-09 12:02:22 -03:00
Steven Allen
8a9aa41542
Merge pull request #5202 from ipfs/fix/dnslink-recursion-alt
correctly handle multi-hop dnslink resolution
2018-07-09 09:01:32 +00:00
Whyrusleeping
0461716b3b
Merge pull request #5200 from ipfs/fix/5197
fix dht commands when pubsub routing is enabled
2018-07-09 01:41:31 -07:00
Spartucus
6f08c9e466
Refactor code
Keep the code style consistent. since all package alias are lowercase words, no need Camel Peak Name.

License: MIT
Signed-off-by: Spartucus <niubob@163.com>
2018-07-09 16:36:01 +08:00
Steven Allen
7df7d11199 fix dht commands when pubsub routing is enabled
Instead of checking if Routing is a DHT (because it can now be a tiered
router and still contain a DHT), stash the DHT in a separate field in the IPFS
node (same as we do with the PSRouter).

fixes #5197

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-09 09:58:44 +02:00
Hector Sanjuan
9c8d994c76 remove debug print statement
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2018-07-08 13:01:54 +02:00
Hector Sanjuan
9d88d2cde8 RepoStat: address review comments
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2018-07-08 13:01:54 +02:00
Hector Sanjuan
37d4989647 Sharness: add tests for ipfs repo stat --size-only
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2018-07-08 13:01:46 +02:00
Hector Sanjuan
79b388c690 Feat: use datastore.DiskUsage() and add --size-only to "repo stat"
This makes use of the PersistentDatastore DiskUsage method to
obtain the Repo's storage usage (GetStorageUsage()).

Additionally, the --size-only flag has been added to the
"ipfs repo stat" command. This avoids counting the number of objects
in the repository and returns faster.

License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2018-07-08 13:01:46 +02:00
Steven Allen
6a81c72cfb correctly handle multi-hop dnslink resolution
Namesys returns `ErrResolveRecursion` when it stops recursing due to a depth
limit. It doesn't return success.

Alternative to #5199.

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-07 00:18:30 -07:00
Steven Allen
cb0ad0d6ce fix starting iptb nodes with additional arguments
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-06 23:33:12 -07:00
Steven Allen
efa4e332e9 update routing helpers to fix an issue in the parallel find providers
See: https://github.com/libp2p/go-libp2p-routing-helpers/pull/3

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-06 23:32:28 -07:00
Lucas Molas
18361d3849 unixfs: remove Get prefix from FSNode accessors
See https://golang.org/doc/effective_go.html#Getters.

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>
2018-07-06 13:29:47 -03:00
Lucas Molas
acb9e23163 pbdagreader: use FSNode instead of protobuf structure
Focus on the UnixFS layer and avoid explicit references to protocol buffers
format (used to serialize objects of that layer). Use the `unixfs.FSNode`
structure which it abstracts from the `unixfs.pb.Data` format.

Replace `PBDagReader` field `ftpb.Data` with `ft.FSNode`, renaming it to `file`
(which is the type of UnixFS object represented in the reader) and changing its
comment removing the "cached" reference, as this structure is not used here as a
cache (`PBDagReader` doesn't modify the DAG, it's read-only). Also, removed
unused `ProtoNode` field to avoid confusions, as it would normally be present if
the `FSNode` was in fact used as a cache of the contents of the `ProtoNode`.

An example of the advantage of shifting the focus from the format to the UnixFS
layer is dropping the of use `len(pb.Blocksizes)` in favor of the more clear
`NumChildren()` abstraction.

Added `BlockSize()` accessor.

License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>
2018-07-06 13:27:18 -03:00