Commit Graph

1139 Commits

Author SHA1 Message Date
Jeromy
c4c665395a add global config switch for sharding
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-03-23 16:42:31 -07:00
Jeromy Johnson
2de21bc018 Merge pull request #3653 from ipfs/kevina/filestore-util
Basic Filestore Utilties
2017-03-22 21:41:48 -07:00
Jeromy Johnson
a3fc6f18b6 Merge pull request #3805 from ipfs/kevina/repo-init
daemon: use fsrepo.IsInitialized to test for initialization
2017-03-22 20:55:42 -07:00
Kevin Atkinson
620b52b2aa filestore util: refactor and clean up tests
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-03-22 20:50:22 -04:00
Kevin Atkinson
f7efb34e68 filestore util: Add 'filestore dups' command. Enhance tests.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-03-22 16:24:56 -04:00
Kevin Atkinson
033c442d32 filestore util: add tests for verifying and listing filestore blocks.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-03-22 16:24:56 -04:00
Kevin Atkinson
28921471db daemon: use fsrepo.IsInitialized to test for initialization
Use fsrepo.IsInitialized to test for initialization instead of just
testing if the directory exists.

Also add test cases for '--init' option, including one the creates an
empty directory.

License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-03-22 04:25:57 -04:00
Jeromy
e8764345d6 fix handling of filestore nodes in mfs during add
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-03-21 20:19:22 -07:00
Jeromy
06fb495df1 fix mfs hamt integration
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-03-21 20:19:22 -07:00
Jeromy
bb09ffd756 implement an HAMT for unixfs directory sharding
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-03-21 20:19:22 -07:00
Jeromy Johnson
21072a5f81 Merge pull request #3712 from ipfs/kevina/more-robust-gc
More Robust GC
2017-03-21 17:16:37 -07:00
Jeromy Johnson
56bbcc9f16 Merge pull request #3774 from ipfs/feat/docs/80-chars
Add 80 columns mans tests
2017-03-10 14:42:38 -08:00
Jakub Sztandera
5489025210
test: add test for checking if commands mans lengths are shorter than 80
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-10 19:05:34 +01:00
Jakub Sztandera
2317ced4aa
test: fix commands tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-10 19:05:34 +01:00
Jakub Sztandera
40cc4dc024
test: add test for ipfs add --quieter
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-10 14:21:54 +01:00
Jakub Sztandera
66cc2f2e88
fix: ipfs get panic with empty API call
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-09 15:42:15 +01:00
Jeromy Johnson
0d6640434b Merge pull request #3765 from ipfs/test/filestore/more-decriptive
test: fix 'disk_usage' returning number smaller by factor of 512 on BSD and Darvin
2017-03-08 20:16:07 -08:00
Jeromy Johnson
74afd87986 Merge pull request #3760 from ipfs/fix/pin-add-api
fix pin add api break
2017-03-07 16:27:23 -08:00
Jeromy Johnson
eca0d1c734 Merge pull request #3757 from ipfs/fix/get-raw-leaves
make raw leaves work with 'ipfs get'
2017-03-07 15:40:18 -08:00
Jakub Sztandera
bd5b48d0ea
test: added issue number to regression test
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-08 00:12:52 +01:00
Jakub Sztandera
e2ececa4fa
test: fix sharness disk_usage util
on bsd based systems du returns block count not bytes

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-08 00:07:18 +01:00
Jakub Sztandera
afc0e77320
test: skip not necessary var assigment
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-08 00:07:18 +01:00
Jakub Sztandera
0ccb4e82f8
test: make the repo size check error message better
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-08 00:07:18 +01:00
Jeromy
6a7750d5c2 fix pin add api break
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-03-07 01:10:46 -08:00
Jeromy
b1588c7162 make raw leaves work with 'ipfs get'
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-03-06 20:12:05 -08:00
Jeromy Johnson
e3d483fc7c Merge pull request #3751 from ipfs/feat/sharness/small-clean-p1
test: small cleanup of t0010
2017-03-06 16:43:06 -08:00
Jeromy Johnson
60b94a2c4f Merge pull request #3750 from ipfs/fix/sharness/filestore/format
test: small cleanup to the filestore sharness test
2017-03-06 12:37:28 -08:00
Kevin Atkinson
f338520aa8 gc: add option to stream errors
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-03-06 14:26:14 -05:00
Kevin Atkinson
c709113257 gc: add sharness test script
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-03-06 14:26:09 -05:00
Jakub Sztandera
454085c810
test: small cleanup of t0010
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-06 20:24:43 +01:00
Jeromy Johnson
cbf8a0cdb4 Merge pull request #3748 from ipfs/deps/update-dht
update go-libp2p-kad-dht with getclosestpeers fix
2017-03-06 11:21:38 -08:00
Jakub Sztandera
5a5a65381f
test: small cleanup to the filestore sharness test
you can use the test_debug by calling tests with
`debug=t verbose=t make test/sharness/t0000-xxx.sh

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-06 20:03:36 +01:00
Jakub Sztandera
ffeef8c9cb
fix: filestore silently being skipped on add if it wasn't enabled
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-03-06 19:16:01 +01:00
Jeromy Johnson
7c707b062a Merge pull request #3635 from ipfs/feat/bitswap-tx-stats
Add more info to bitswap stat
2017-03-06 00:54:03 -08:00
Jeromy
332d760f12
Add more info to bitswap stat
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-03-06 09:47:53 +01:00
Jeromy
2884c84343 Implement basic filestore 'no-copy' functionality
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-03-06 00:37:24 -08:00
Jeromy
4e168dc323 update go-libp2p-kad-dht with getclosestpeers fix
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-03-05 23:06:04 -08:00
Jeromy Johnson
d2f41e22fe Merge pull request #3725 from ipfs/feat/better-muxer
feat: remove broken spdy multiplexer and enable multiplex by default as second option
2017-03-02 09:15:16 -08:00
Friedel Ziegelmayer
8b2aa5617d feat: remove broken spdy multiplexer and enable mplex by default
License: MIT
Signed-off-by: Friedel <dignifiedquire@gmail.com>
2017-03-01 23:28:05 -08:00
Jeromy Johnson
57e4e2103e Merge pull request #3734 from ipfs/feat/keystore/list-self
keystore: add self key to the listing
2017-03-01 23:26:09 -08:00
Jeromy Johnson
dd9584ba28 Merge pull request #3697 from ipfs/feat/pnet2
PNet take 2
2017-03-01 16:43:48 -08:00
Jeromy Johnson
34a94c2812 Merge pull request #3671 from ipfs/kevina/pin-add-progress
Report progress during `pin add`
2017-03-01 16:39:10 -08:00
Jakub Sztandera
fe0cc96b24
fix: race of conditions in keystore test
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-02-28 18:19:42 +01:00
Jakub Sztandera
25c3e126b8
keystore: add self key to the listing
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-02-28 16:16:16 +01:00
Jakub Sztandera
4eed546e06
deps: update dependencies for PNet
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-02-22 20:04:43 +01:00
Jeromy Johnson
29c80d76b4 Merge pull request #3698 from ipfs/fix/repo-migration-musl
WIP: fsrepo: fix musl detection for migrations
2017-02-20 20:40:45 -08:00
Jeromy
14daf0a459 print out all daemon stderr files when iptb stop fails
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-02-19 16:25:28 -08:00
Kevin Atkinson
cdd29c24a2 Report progress during 'pin add'.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-02-17 16:19:42 -05:00
Jeromy
c817f09b8a
add tests to make sure docker requests correct migrations version
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-02-17 08:37:27 +01:00
Lars Gierth
26770b7ebb
fsrepo: fix musl detection for migrations
The ldd command used for detection doesn't seem to have a
--version flag on Alpine Linux. It would print the expected
output, but instead of stdout, it would print it on stderr.

The musl detection code would only scan stdout for mentions
of "musl", and would thus *not* download the musl version
of the fs-repo-migrations executable.

This manifested in the well-known "fs-repo-migrations: not found"
error, which you get when executing something that was linked
against a different libc than the one present on the system.

License: MIT
Signed-off-by: Lars Gierth <larsg@systemli.org>
2017-02-17 08:37:26 +01:00
Jeromy Johnson
765fb0f612 Merge pull request #3523 from ipfs/feat/ipv6-bootstrap
bootstrap: add a few /ip6 nodes
2017-02-16 17:00:37 -08:00
Jeromy Johnson
e5def26b92 Merge pull request #3687 from ipfs/feat/sub-obj-dag-get
Feat/sub obj dag get
2017-02-16 15:51:34 -08:00
Kevin Atkinson
6867c87bcf Add back removed test.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-02-15 17:35:29 -05:00
Kevin Atkinson
4b566ede96 Add tests for recursively pinning a dag (i.e. large file).
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-02-15 16:51:40 -05:00
Jeromy
cb611c8873 allow for sub-object resolution in dag get
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-02-13 19:15:17 -08:00
Jeromy
b4eeff2d84 update go-multihash and bubble up deps
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-02-12 12:25:41 -08:00
Jakub Sztandera
dd63187826
make: make default rule 'aggregate' in sharness
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-02-12 01:18:40 +01:00
Jakub Sztandera
a2e3aa5d78
make: fix standalone sharness run
The comparison was wrong

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-02-12 01:18:40 +01:00
Jakub Sztandera
f77d01a965
make: add dummy makefile in sharness directory
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-02-12 01:18:40 +01:00
Jakub Sztandera
f630222580
make: rework makefiles for non-recursive make and add sharness coverage
This commit introduces non-recursive Makefile infrastructure that replaces current Makefile infrastructure.
It also generally cleanups the Makefiles, separates them into nicer sub-modules and centralizes common operations into single definitions.

It allows to depend on any target that is defined in the makefile, this means that for example `gx install` is called once when `make build test_expensive_sharness` is called instead of 4 or 5 times.

It also makes the dependencies much cleaner and allows for reuse of modules. For example sharness coverage collection (WIP) uses sharness target with amended PATH, previously it might have been possible but not without wiring in the coverage collection into sharness make runner code.

Yes, it is more complex but not much more. There are few rules that have to be followed and few complexities added but IMHO it is worth it.

How to NR-make:
1. If make is to generate some file via a target, it MUST be defined in Rules.mk file in the directory of the target.
2. `Rules.mk` file MUST have `include mk/header.mk` statement as the first line and `include mk/footer.mk` statement as the last line (apart from project root `Rules.mk`).
3. It then MUST be included by the closest `Rules.mk` file up the directory tree.
4. Inside a `Rules.mk` special variable accessed as `$(d)` is defined. Its value is current directory, use it so if the `Rules.mk` file is moved in the tree it still works without a problem. Caution: this variable is not available in the recipe part and MUST NOT be used. Use name of the target or prerequisite to extract it if you need it.
5. Make has only one global scope, this means that name conflicts are a thing. Names SHOULD  follow `VAR_NAME_$(d)` convention. There are exceptions from this rule in form of well defined global variables. Examples: General lists `TGT_BIN`, `CLEAN`; General targets: `TEST`, `COVERAGE`; General variables: `GOFLAGS`, `DEPS_GO`.
3. Any rules, definitions or variables that fit some family SHOULD be defined in `mk/$family.mk` file and included from project root `Rules.mk`

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-02-12 01:18:40 +01:00
Jeromy
c5f0f7f77c fix printing out of binary escaped data for test
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-02-09 10:31:18 -08:00
Jeromy
85a06abacc Fix marshaling of null cbor arrays
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>

Fix non-canonical imports via dag put

License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-02-08 16:24:31 -08:00
Jeromy
c00c142bf9 dag/get: fix link formatting in json output
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-02-06 10:36:57 -08:00
Jeromy Johnson
4add5b8a9a Merge pull request #3631 from ipfs/lgierth-patch-1
migrations: update dist.ipfs.io path
2017-01-27 14:59:13 -08:00
Jeromy
7fc9c30168 close file before removing it in check writeable
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-01-26 22:43:54 -08:00
Jeromy
f28ba8559b remove error for not having an upgrade
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-01-26 09:12:34 -08:00
Jeromy
8c3f78055e add test check for pinning cbor objects
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-01-21 10:47:19 -08:00
Jeromy
29c530ac0e update to the correct ipld cbor code
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-01-21 10:47:19 -08:00
Jeromy
e5bc81ad94 don't select README or SHARDING file for random corruption in t0086
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-01-21 10:19:50 -08:00
Jeromy
1366795f31 Change repo version to 5, use new flatfs sharding
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-01-19 14:59:12 -08:00
Jeromy Johnson
75cce80b5c Merge pull request #3571 from ipfs/feat/better-enum-async
rewrite enumerate children async to be less fragile
2017-01-17 10:14:49 -08:00
Jeromy
397a35a33a update test to print error from EnumerateChildren
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-01-12 13:51:53 -08:00
Jeromy Johnson
3faf8974ec Merge pull request #3581 from ipfs/kevina/keystore
"ipfs key list": include the hash of the key id in addition to the name
2017-01-11 08:44:53 -08:00
Jeromy
a3b38e8be8 Add a test for the keystore
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-01-11 04:23:58 -08:00
Jeromy Johnson
8f165f305d Merge pull request #3582 from ipfs/deps/negotiate-lazy-fix
update go-libp2p with negotiate lazy fixes
2017-01-11 03:32:20 -08:00
Jakub Sztandera
e8be741c7f test: add simple multinode test for multiplex feature
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-01-10 14:52:04 -08:00
Jeromy
30aacd1b0a update go-libp2p with negotiate lazy fixes
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-01-10 14:52:00 -08:00
Jakub Sztandera
df67f3d1bd
test: add test for invalid routing option
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-01-10 19:07:58 +01:00
Jeromy
7c0149d048 set the agent version based on version string
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2017-01-06 06:37:47 -08:00
Jeromy Johnson
87f8bfd31b Merge pull request #3539 from ipfs/feat/update-identify
update libp2p for identify configuration updates
2017-01-05 08:19:59 -08:00
Jeromy Johnson
d83a911254 Merge pull request #3562 from ipfs/kevina/minor-cr-0.4.5
Clean up minor issues in 0.4.5 cr.
2017-01-05 07:18:12 -08:00
Kevin Atkinson
78ff01757f Fix typo and formatting issues.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-01-04 17:26:08 -05:00
Kevin Atkinson
980e341489 Add tests for "ls --resolve-type=false".
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-01-04 15:08:01 -05:00
Kevin Atkinson
6cc0903d25 Fix "ipfs ls" so it works correctly with raw leaves.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-01-03 21:20:04 -05:00
Kevin Atkinson
3526c26f31 Add test for adding directory with --raw-leaves option.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2017-01-02 21:19:03 -05:00
Jeromy
d8f257c264 update libp2p for identify configuration updates
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-12-27 02:13:59 -08:00
Jeromy Johnson
99d72c2781 Merge pull request #3515 from ipfs/fix/sharness/osx
Fixes nc on macOS not closing socket when the stdin sends EOF
2016-12-21 11:21:08 -08:00
Jakub Sztandera
abb4d1760b
sharness: don't run go-ipfs instance with default config
It conflicts with already running instance on the Dev's machine so
running this test requires disabling the normal ipfs.

The launch of ipfs here doesn't test much as we compare the config,
after initing from it and we also launch from default config in many
other cases (with few variables changed to not conflict with already
running standalone ipfs instance).

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-12-21 10:29:38 +01:00
Lars Gierth
9f71de8fcc bootstrap: add a few /ip6 nodes
License: MIT
Signed-off-by: Lars Gierth <larsg@systemli.org>
2016-12-18 05:52:56 +01:00
Jeromy
8e23482c7e Add a test for dag get with a path
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-12-17 13:36:56 -08:00
Jakub Sztandera
20665fc5e3
Fixes nc on macOS not closing socket when the stdin sends EOF
Uses `-d` option that is supported both by BSD and GNU nc.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-12-16 21:10:53 +01:00
Jeromy
4373bf9d75 merkledag: fix json marshalling of pbnode
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-12-14 13:11:49 -08:00
Jeromy Johnson
e893fb90b7 Merge pull request #3484 from ipfs/fix/pubsub-peers-cmd
cmd/pubsub: fix peers command topic filtering
2016-12-09 12:08:45 -08:00
Jeromy
f104b8ae57 cmd/pubsub: fix peers command topic filtering
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-12-08 21:26:09 -08:00
Jeromy
cf6e3219b6 cmd/block: add selection of multihash parameters to block put command
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-12-07 16:36:00 -08:00
Jeromy Johnson
0c413de87f Merge pull request #3432 from keks/feat/pubsub-sharness
add sharness test for pubsub
2016-12-04 21:29:45 -08:00
Jan Winkelmann
993e7816f8 pubsub sharness tests after chriscool feedback
License: MIT
Signed-off-by: Jan Winkelmann <j-winkelmann@tuhh.de>
2016-12-04 03:22:51 +01:00
Jan Winkelmann
1b3158f860 add sharness test for pubsub
License: MIT
Signed-off-by: Jan Winkelmann <j-winkelmann@tuhh.de>
2016-12-04 03:22:49 +01:00
Jeromy
53d47669da bubble up go-datastore deps
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-11-28 22:29:38 -08:00
Jeromy Johnson
0fcb92f3a1 Merge pull request #3403 from ipfs/feat/dg-reader-cleanup
Fix panic in dagreader with raw nodes
2016-11-22 11:30:08 -08:00
Jakub Sztandera
1e170e8d6d
Update go-libp2p across codebase
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-11-22 01:22:50 +01:00
Jakub Sztandera
8c260f5193
Add sharness test for raw node fetch
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-11-21 18:15:40 +01:00
Jeromy
396c629301 update to newer ipld node interface with Copy and better Tree
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-11-15 18:00:49 -08:00
Jeromy
7fbaae49be update to go-libp2p 4.1.0
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-11-10 17:38:10 -08:00
Jeromy
25d9f8afd1 update to libp2p 4.0.4
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-11-05 21:44:36 -07:00
Jeromy
ec21220907 update go-libp2p
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-11-03 20:06:32 -07:00
Lars Gierth
dae854eaf3 assets: rebuild them
License: MIT
Signed-off-by: Lars Gierth <larsg@systemli.org>
2016-11-03 00:38:32 +01:00
Jeromy Johnson
437cc7fa78 Merge pull request #2911 from ipfs/feature/ifps-capitalize
docs: decapitalize IPFS where possible
2016-11-02 13:20:51 -07:00
Jeromy
afce683eae update go-libp2p-swarm with deadlock fixes
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-30 19:16:28 -07:00
Jeromy Johnson
634005a1ab Merge pull request #3324 from ipfs/feat/block-cid-codec
allow cid format selection in block put command
2016-10-29 21:59:19 -07:00
Jeromy
f68e1843f4 allow cid format selection in block put command
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-28 19:03:14 -07:00
Richard Littauer
9843e86258 Changed so only explicit ipfs cli commands are lowercased
License: MIT
Signed-off-by: Richard Littauer <richard.littauer@gmail.com>
2016-10-27 22:55:13 -07:00
Richard Littauer
9aaa743a51 docs: decapitalize IPFS where possible
Tried to check all instances of IPFS and make sure they werent referring to the CLI tool. See #2910.

License: MIT
Signed-off-by: Richard Littauer <richard.littauer@gmail.com>
2016-10-27 22:54:36 -07:00
Jeromy
f7d3f61673 clean up some code, update cbor package, and add tests
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-27 15:49:41 -07:00
Jeromy
eac13abaec update to new cid and ipld node packages
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-25 09:54:04 -07:00
Jeromy Johnson
6f3ae5da29 Merge pull request #3307 from ipfs/feat/raw-nodes
Implement 'Raw Node' node type
2016-10-24 11:59:27 -07:00
Jeromy
9796a03624 update HashOnRead validation to properly support cids
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-18 16:03:26 -07:00
Jeromy
8ce9963289 fix add/cat of small files
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-18 15:26:44 -07:00
Jeromy
3796e7020e raw dag: make raw nodes work in cat and get, add tests
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-18 11:07:32 -07:00
Jakub Sztandera
e254f0d8b5
test: check if metrics work in sharness
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-10-18 12:28:50 +02:00
Jeromy
8a33801607 add test to be run to detect future regressions in pinsets
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-12 09:29:09 -07:00
Jeromy
f4d7369c4a bitswap: protocol extension to handle cids
This change adds the /ipfs/bitswap/1.1.0 protocol. The new protocol
adds a 'payload' field to the protobuf message and deprecates the
existing 'blocks' field. The 'payload' field is an array of pairs of cid
prefixes and block data. The cid prefixes are used to ensure the correct
codecs and hash functions are used to handle the block on the receiving
end.

License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-10 08:19:31 -07:00
Jeromy
282bdc4816 cid: integrate cid into bitswap and blockstores
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-08 12:14:58 -07:00
Jeromy
1f9ec4e3ed update to libp2p 4.0.1 and propogate other changes
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-10-05 22:12:43 -07:00
Jeromy Johnson
5c212d39a2 Merge pull request #3073 from ipfs/feat/test-config-replace
Add test for 'ipfs config replace'
2016-10-03 17:29:52 -07:00
Jeromy
2871decd48 clean up test, run checks on all nodes
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-30 16:10:20 -07:00
Jeromy
56a8c43aaf add experimental dht client mode flag
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-30 16:10:20 -07:00
Jakub Sztandera
80a776286c
more fixes for standard sed
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-28 16:22:32 +02:00
Jakub Sztandera
5b4a6eac10
more bsd sed fixes
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-28 14:55:09 +02:00
Jakub Sztandera
daf212a65e
try to fix travis on BSDs again
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-28 13:57:25 +02:00
Jeromy
0832a640fa remove utp tests for now
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-26 00:52:19 -07:00
Jeromy
e43c770530 update libp2p and dht packages
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-25 23:42:14 -07:00
Jeromy Johnson
300187ac52 Merge pull request #3242 from ipfs/test/repro-random-fail
trying to debug random test failures
2016-09-20 23:48:55 -07:00
Jeromy
5457a85cef
Merge branch 'version/0.4.3-rc4'
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-20 19:10:10 -07:00
Jeromy
fb05a5fbb8 trying to debug random test failures
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-19 19:37:03 -07:00
Jeromy Johnson
0aa136a98e Merge pull request #3206 from ipfs/feat/writable-flag
gateway: fix --writable flag :|
2016-09-14 13:50:32 -04:00
Jeromy
1de17e2233 Update libp2p to 3.5.2
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-12 14:26:55 -07:00
Jeromy
1bb6a842c5 Update libp2p to have fixed spdystream dep
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-12 07:47:04 -07:00
Jakub Sztandera
92d1d65fc2
test: fix sed usage on OSX
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-12 13:30:32 +02:00
Lars Gierth
fc8e6de6a9 gateway: fix --writable flag :|
License: MIT
Signed-off-by: Lars Gierth <larsg@systemli.org>
2016-09-11 21:09:09 +02:00
George Antoniadis
89d8ca5798 Extract peerset, update peer, peerset, secio, libp2p
License: MIT
Signed-off-by: George Antoniadis <george@noodles.gr>
2016-09-10 23:22:17 +01:00
George Antoniadis
6859b8ccd8 Extract key and datastore
License: MIT
Signed-off-by: George Antoniadis <george@noodles.gr>
2016-09-09 15:52:25 +01:00
Jakub Sztandera
25a035f92c
test: attempt to fix sed on travis
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-08 13:18:29 +02:00
Jakub Sztandera
a680b1bd7b
test: split 'ipfs config replace' test into parts
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-08 11:13:28 +02:00
Jakub Sztandera
2a2e3eb185
sharness: remove mixed indentation
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-08 11:07:54 +02:00
Jakub Sztandera
077948ab38
sharness: add test for 'ipfs config replace'
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-08 11:07:54 +02:00
Jeromy
c8fe495934 integrate CIDv0
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-07 13:32:32 -07:00
Jeromy Johnson
8803a7628f Merge pull request #3141 from ipfs/feat/cmd/config-priv
cmd: harden the security of privkey field in config show
2016-09-04 08:27:01 -07:00
Jeromy Johnson
d6092eb536 Merge pull request #3182 from ipfs/fix/bitswap/want-cancel
Remove entries from wantlists when their related requests are cancelled
2016-09-04 07:05:28 -07:00
Jakub Sztandera
671425ea33 cmd: harden config show with key
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-04 06:50:10 -07:00
Jeromy
1548c8aabb bitswap: clear wantlists when GetBlocks calls are cancelled
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-04 06:44:21 -07:00
Jeromy Johnson
1f387af2b0 Merge pull request #3149 from ipfs/test/fdlimit-raising
fdlimit: improve fdlimit autoraising tests
2016-09-03 09:27:52 -07:00
Jeromy Johnson
309535c057 Merge pull request #3151 from ipfs/kevina/more3138tests
Enhance tests for files API root best-effort pin.
2016-09-03 09:27:34 -07:00
Jeromy
af914c5193 add better test to be more sure that file descriptor limits were actually raised
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-02 07:15:08 -07:00
Jeromy
6c340563d4 fdlimit: improve fdlimit autoraising tests
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-02 07:14:48 -07:00
Jeromy
aafe084b92 sharness: fix typo in hash in t0050
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-01 15:42:05 -07:00
Jakub Sztandera
f59751d1a2
test: remove time-out script, use go-timeout instead
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-01 15:59:12 +02:00
Jakub Sztandera
f012b5aed5
test: add go-timeotu to test build system
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-01 15:59:11 +02:00
Jakub Sztandera
7639a2f0a7
test: introduce go-timeout
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-01 15:59:11 +02:00
Jeromy Johnson
ade598eead Merge pull request #3135 from ipfs/kevina/2839directfix
Directly Fix #2839
2016-08-31 19:34:21 -07:00
Kevin Atkinson
6e4f3acb4a Enhance tests for files API root best-effort pin.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-31 18:16:36 -04:00
Jeromy Johnson
40159e50a0 Merge pull request #3158 from ipfs/feat/migrations-help
fsrepo: improve migrations copy
2016-08-30 22:34:33 -07:00
Jeromy Johnson
4286cd3695 Merge pull request #3144 from ipfs/test/add/revert
test: revert few stdin tests that were removed
2016-08-30 22:03:54 -07:00
Jeromy Johnson
ea343fbfa1 Merge pull request #3142 from ipfs/test/CORS/defaults
test: do explicit check of CORS headers
2016-08-30 21:46:59 -07:00
Jeromy
b4718a246c fix tests for changed migrations text
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-08-30 21:37:45 -07:00
Jeromy
7baac76a3b repo/verify: add better testing on repo verify command
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-08-29 22:55:06 -07:00
Jakub Sztandera
384fb1095c
test: revert few stdin tests that were removed
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-29 22:11:11 +02:00
Kevin Atkinson
802d3f9570 Add back still useful test from fe7b01f1 (Resolve symlink if ...)
Add back still useful test from reverted commit:
  fe7b01f14e
  Resolve symlink if it is directly referenced in cli (#2897)

License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-29 16:10:46 -04:00
Jakub Sztandera
3754803a67
test: do explicit check of CORS headers
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-29 21:43:58 +02:00
Kevin Atkinson
10a692f9a2 Fix "ipfs add -r ." to always add the contents of the current directory.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-27 16:48:03 -04:00
Kevin Atkinson
88e4b110ba Revert "Resolve symlink if it is directly referenced in cli (#2897)"
This reverts commit fe7b01f14e.

Conflicts:
	commands/cli/parse.go

Revert "Merge pull request #3023 from ipfs/feature/eval-symlink-windows"

This reverts commit 16c5a89dd4, reversing
changes made to 8c77ff8188.

Conflicts:
	commands/cli/parse.go

License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-27 14:36:28 -04:00
Jeromy Johnson
53b927e3eb Merge pull request #3130 from ipfs/test/repo/version-digits
test: accept more than one digit in repo version tests
2016-08-26 14:17:50 -07:00
Jakub Sztandera
8181e9934a
test: accept more than one digit in repo version tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-26 18:23:40 +02:00
Jeromy
05b197df2d update deps for libp2p 3.4.0
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-08-25 19:02:55 -07:00
Jeromy Johnson
10048ceca9 Merge pull request #2962 from ipfs/kevina/block-rm
Add "ipfs block rm" command.
2016-08-18 13:27:26 -07:00
Kevin Atkinson
8679af7a02 "block rm": add "--force" and "--quiet" option
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-17 01:29:40 -04:00
Kevin Atkinson
92f6747a95 "block rm": test case for removing pinned, valid, and non-existent blocks
Add test that removes a combination of pinned, valid, and non-existent
blocks in one command.

License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-16 20:52:00 -04:00
Jeromy Johnson
f2dcad8531 Merge pull request #2999 from ipfs/feature/makefile-cleanup
Cleanup makefiles
2016-08-16 10:15:08 -07:00
Kevin Atkinson
c88b4b0941 "block rm": remove the option to ignore pins
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-15 13:17:43 -04:00
Kevin Atkinson
efeb789878 Check for multiple pinned blocks in a single pass.
Provide a new method, Pinner.CheckIfPinned(), which will check if
any of the arguments are pinned.  Previously IsPinned would need to be
called once for each block.  The new method will speed up the checking
of multiple pinned blocks from O(p*n) to O(p) (where p is the number
of pinned blocks and n is the number of blocks to be check)

Use the new method in "block rm".

License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-15 13:17:43 -04:00
Kevin Atkinson
6ad497bcf0 "block rm": use channel instead of pipe / don't abort on non-fatal error
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-15 13:17:43 -04:00
Kevin Atkinson
453be22dfb Add "ipfs block rm" command.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-15 13:17:43 -04:00
Christian Couder
2489dfe8a9 ipfs-test-lib: fix test_fsh arg quoting
test_fsh() should quote its arguments before passing them
to `eval` otherwise there are problems when the arguments
contain spaces.

For example when running the following program:

```
#!/bin/sh

. ./ipfs-test-lib.sh

die () {
    printf >&2 "%s\n" "$@"
    exit 1
}

DIR1="test dir 1"
DIR2="test dir 2"

mkdir "$DIR1" "$DIR2" || die "Could not mkdir '$DIR1' '$DIR2'"

echo "in dir 1" >"$DIR1/file1" || die "Could not write into '$DIR1/file1'"
echo "in dir 2" >"$DIR2/file2" || die "Could not write into '$DIR2/file2'"

if test_cmp "$DIR1/file1" "$DIR2/file2"
then
    echo "test_cmp succeeded!"
else
    echo "test_cmp failed!"
fi

rm -rf "$DIR1" "$DIR2" || die "Could not rm -rf '$DIR1' '$DIR2'"

```

we get:

```
> diff -u test dir 1/file1 test dir 2/file2
diff: extra operand '1/file1'
diff: Try 'diff --help' for more information.

test_cmp failed!
```

License: MIT
Signed-off-by: Christian Couder <chriscool@tuxfamily.org>
2016-08-15 12:10:15 +02:00
Jeromy
8a75a8cf08 commands: fix panic when stdin is empty for string args
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-08-07 09:24:17 -07:00
Jakub Sztandera
cc60f6909b make: cleanup -rm calls
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-04 16:38:00 +02:00
Jakub Sztandera
c1014aea88 make: 'make clean' clears sharness too
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-04 16:38:00 +02:00
Jakub Sztandera
f3dc11c566 use $(MAKE) instead of 'make' in Makefiles
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-04 16:38:00 +02:00
Jakub Sztandera
63072758a9 make: use 'make -C' instead of 'cd && make'
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-04 16:38:00 +02:00
Jeromy Johnson
1eb94e64e3 Merge pull request #2990 from csasarak/janky_version
Alias 'ipfs --version' to 'ipfs version'
2016-08-04 06:58:15 -07:00
Jeromy Johnson
5a831ff16d Merge pull request #3033 from ipfs/fix/stdin-read-msg
commands/cli: fix reading from stdin message
2016-08-03 11:19:34 -07:00
Jeromy
068c6d2211 commands/cli: fix reading from stdin message
Only print "Reading from /dev/stdin" message when we actually read from
stdin (and not in other cases such as ipfs add --help).

License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-08-03 09:04:41 -07:00
Jakub Sztandera
a42302443b cli: reword message about mount and offline
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-03 08:04:07 -07:00
Jakub Sztandera
8273b0f493 sharness: fix improper use of test_expect_failure
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-03 05:24:20 -07:00
Jakub Sztandera
2cae0bc616 daemon: ipfs daemon --offline --mount should fail with nice message
ipfs daemon --offline;
ipfs mount;
fails. This uniforms this behaviour.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-03 05:24:20 -07:00
Jeromy
1b50fcefed default add progress to false, unless using CLI
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-08-01 10:03:43 -07:00
Jakub Sztandera
66686e66be commands: fix refs 'edges' option work
also change it to use format instead of separate variable

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-28 20:25:32 +01:00
Jeromy Johnson
0bd8ced0d6 Merge pull request #2993 from ipfs/fix/provstore-batching
use batching datastore for providers storage
2016-07-28 03:27:21 -07:00
Chris Sasarak
5e9cbd740d Added tests for ipfs --version.
1. Test that ipfs --version has a 0 exit status
2. Check the ipfs --version output matches ipfs version

License: MIT
Signed-off-by: Chris Sasarak <chris.sasarak@gmail.com>
2016-07-26 19:41:20 -04:00
Jeromy
e8addf5ee3 use batching datastore for providers storage
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-07-26 10:48:25 -07:00
Jeromy
ed551131f2 commands: fix panic when expected files field is nil
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-07-25 09:12:58 -07:00