Commit Graph

107 Commits

Author SHA1 Message Date
Jeromy
0a6b880bee fix for #1008 and other pinning fixes
This commit adds a new set of sharness tests for pinning, and addresses
bugs that were pointed out by said tests.

test/sharness: added more pinning tests

Pinning is currently broken. See issue #1051. This commit introduces
a few more pinning tests. These are by no means exhaustive, but
definitely surface the present problems going on. I believe these
tests are correct, but not sure. Pushing them as failing so that
pinning is fixed in this PR.

make pinning and merkledag.Get take contexts

improve 'add' commands usage of pinning

FIXUP: fix 'pin lists look good'

ipfs-pin-stat simple script to help check pinning

This is a simple shell script to help check pinning.

We ought to strive towards making adding commands this easy.
The http api is great and powerful, but our setup right now
gets in the way. Perhaps we can clean up that area.

updated t0081-repo-pinning

- fixed a couple bugs with the tests
- made it a bit clearer (still a lot going on)
- the remaining tests are correct and highlight a problem with
  pinning. Namely, that recursive pinning is buggy. At least:
  towards the end of the test, $HASH_DIR4 and $HASH_FILE4 should
  be pinned indirectly, but they're not. And thus get gc-ed out.
  There may be other problems too.

cc @whyrusleeping

fix grep params for context deadline check

fix bugs in pin and pin tests

check for block local before checking recursive pin
2015-04-19 23:40:25 -07:00
Ho-Sheng Hsiao
d90ada9b4e Added fuse allow_other option
ipfs config Mounts.FuseAllowOther --bool true
    ipfs daemon --mount
2015-04-02 15:11:27 -07:00
Ho-Sheng Hsiao
bf22aeec0a Reorged imports from jbenet/go-ipfs to ipfs/go-ipfs
- Modified Godeps/Godeps.json by hand
- [TEST] Updated welcome docs hash to sharness
- [TEST] Updated contact doc
- [TEST] disabled breaking test (t0080-repo refs local)
2015-03-31 12:52:25 -07:00
Jeromy
9715cab58d set proper UID and GID on fuse filesystems 2015-03-30 14:56:42 -07:00
Jeromy
5440bb0e6d fix WriteAt race condition 2015-03-24 12:23:01 -07:00
Jeromy
13c489eca1 fix context respect through fuse reading 2015-03-24 12:23:01 -07:00
Jeromy
13de031b44 code cleanup and better naming of methods 2015-03-24 12:23:01 -07:00
Jeromy
b9658f0cb2 refactor ipns fuse to utilize ipnsfs 2015-03-24 12:23:01 -07:00
Konstantin Koroviev
b6c0ade276 FUSE: Stop treating "no errors" as an error 2015-03-22 17:50:20 +02:00
Juan Batiz-Benet
8a3db7cbc4 testing: nofuse testing (for osx travis) 2015-03-18 01:44:36 -07:00
Jeromy
63e15abd8f refactor dagmodifier to work with trickledag format 2015-03-11 19:38:01 -07:00
Jeromy
da47c218b7 take offset into account for computing read size 2015-03-06 11:07:09 -08:00
Tonis Tiigi
91ab1401ab Fix nofuse build tags syntax 2015-03-05 18:00:36 +02:00
Henry
293234ae63 InitializeKeyspace doesnt care about fuse 2015-03-05 01:24:17 +01:00
Henry
66f1035d93 simple nofuse build tag to allow freebsd compilation and maybe pave the way towards windows as well 2015-03-05 01:24:17 +01:00
Juan Batiz-Benet
38425b1a06 fuse: fix read problem in osx
@whyrusleeping's fix in c88340b broke reading fuse in osx.
i'm not sure why... anyway, i chose to revert back to
io.ReadFull, but use the min of req.Size and r.Size(), which
should not encounter the reading problem in linux that a77ea2f
fixed in the first place.

This commit also changes ipns, which had not been changed.
2015-03-04 07:34:05 -08:00
Juan Batiz-Benet
f77dbe0a57 fuse/ipns: implement NodeReadlinker 2015-03-04 07:34:04 -08:00
Henry
94f55f2d51 added implements check for root types and fixed remaining interfaces on nodes 2015-03-01 13:47:52 +01:00
Henry
335caf0bc7 implements check and fixed argument ordering 2015-03-01 13:47:52 +01:00
Henry
faef01a17e update to recent bazil.org/fuse (drop custom Error, Intr dropped in favor or context.Context) 2015-03-01 13:47:52 +01:00
Jeromy
36a21561f7 stress test for ipfs fuse 2015-02-26 19:12:05 -08:00
Jeromy
88b5a1a019 path.Join for cross platform goodness 2015-02-26 19:03:33 -08:00
Jeromy
856c87bdc0 add some fuse tests for readonly ipfs fs 2015-02-26 19:03:33 -08:00
Henry
92d08db7a5 rewrote import paths of go.net/context to use golang.org/x/context
- updated go-ctxgroup and goprocess
ctxgroup: AddChildGroup was changed to AddChild. Used in two files:
- p2p/net/mock/mock_net.go
- routing/dht/dht.go

- updated context from hg repo to git
prev. commit in hg was ad01a6fcc8a19d3a4478c836895ffe883bd2ceab. (context: make parentCancelCtx iterative)
represents commit 84f8955a887232b6308d79c68b8db44f64df455c in git repo

- updated context to master (b6fdb7d8a4ccefede406f8fe0f017fb58265054c)

Aaron Jacobs (2):
net/context: Don't accept a context in the DoSomethingSlow example.
context: Be clear that users must cancel the result of WithCancel.

Andrew Gerrand (1):
go.net: use golang.org/x/... import paths

Bryan C. Mills (1):
net/context: Don't leak goroutines in Done example.

Damien Neil (1):
context: fix removal of cancelled timer contexts from parent

David Symonds (2):
context: Fix WithValue example code.
net: add import comments.

Sameer Ajmani (1):
context: fix TestAllocs to account for ints in interfaces
2015-02-25 11:58:19 +01:00
Jeromy
c88340b5a4 move to use io.CopyN 2015-02-23 19:29:02 -08:00
Jeromy
a77ea2f0c8 fix fuse reading on linux 2015-02-23 15:51:16 -08:00
Juan Batiz-Benet
58f39687cf logs: removed all log.Errors unhelpful to users
Let's save log.Error for things the user can take action on.
Moved all our diagnostics to log.Debug. We can ideally reduce them
even further.
2015-02-03 01:06:07 -08:00
Mildred Ki'Lya
d221d55d85 HTTP: add handlers to allow object creation and modification 2015-01-31 20:47:34 +01:00
Juan Batiz-Benet
a8bfa947d8 fuse/ipns: use Read() not ReadAll() 2015-01-29 16:12:45 -08:00
Juan Batiz-Benet
c05b4f06f0 fuse/ipfs: remove ReadAll 2015-01-29 16:12:45 -08:00
Juan Batiz-Benet
fcf7f0e7c1 fuse/ipfs: seeking
This commit changed the "ReadAll" to do proper read requests.
Seeking in fuse mounted fs now works. Note: this is why opening a
mounted video didnt work... we just didnt look at this code in
months.
2015-01-29 16:12:45 -08:00
Jeromy
abb3c9c9c4 implement path type 2015-01-29 17:51:08 +00:00
Jeromy
f1267d0624 change ipns resolve/publish to store raw keys, not b58 encoded 2015-01-28 19:36:30 +00:00
Jeromy
26826bd55e implement seeking in the dagreader 2015-01-27 01:33:09 +00:00
Jeromy
1244fd251d update tests, and ensure 'default' blocks are pinned 2015-01-22 00:16:30 +00:00
Jeromy
a5233faeae some comments 2015-01-19 08:06:51 +00:00
Jeromy
feeada0d90 fix fuse mounting issues
this time, without loading the private key on every startup
2015-01-19 08:05:52 +00:00
Juan Batiz-Benet
0311c0518d testing/ci: all env var checks now use new pkgs
Good thing, i checked one wrong, too!
2015-01-14 16:01:03 -08:00
Jeromy
edd7062c56 mark ipns as readonly 2015-01-10 01:22:44 -08:00
Juan Batiz-Benet
919e9bebee ipns test: is fast republish a timing prob? 2015-01-05 05:48:35 -08:00
Juan Batiz-Benet
e21b1f662b fuse mount lifecycle fixes
This commit cleans up how mounting was being done.
It now successfully signals when it is properly mounted
and listen to close signals correctly.
2015-01-04 00:47:27 -08:00
Juan Batiz-Benet
cc0d7c9b57 crypto -> p2p/crypto
The crypto package moves into p2p. Nothing in it so far is ipfs
specific; everything is p2p-general.
2015-01-02 08:46:45 -08:00
Juan Batiz-Benet
c84a714b16 peer change: peer.Peer -> peer.ID
this is a major refactor of the entire codebase
it changes the monolithic peer.Peer into using
a peer.ID and a peer.Peerstore.

Other changes:
- removed handshake3.
-	testutil vastly simplified peer
-	secio bugfix + debugging logs
-	testutil: RandKeyPair
-	backpressure bugfix: w.o.w.
-	peer: added hex enc/dec
-	peer: added a PeerInfo struct
  PeerInfo is a small struct used to pass around a peer with
 	a set of addresses and keys. This is not meant to be a
 	complete view of the system, but rather to model updates to
 	the peerstore. It is used by things like the routing system.
-	updated peer/queue + peerset
-	latency metrics
-	testutil: use crand for PeerID gen
 	RandPeerID generates random "valid" peer IDs. it does not
 	NEED to generate keys because it is as if we lost the key
 	right away. fine to read some randomness and hash it. to
 	generate proper keys and an ID, use:
 	  sk, pk, _ := testutil.RandKeyPair()
 	  id, _ := peer.IDFromPublicKey(pk)
 	Also added RandPeerIDFatal helper
- removed old spipe
- updated seccat
- core: cleanup initIdentity
- removed old getFromPeerList
2014-12-23 08:33:32 -08:00
Juan Batiz-Benet
41751b4938 Integrated new network into ipfs 2014-12-16 14:47:29 -08:00
Juan Batiz-Benet
6ff472be61 mount: move Mount func into mount obj 2014-11-16 01:56:34 -08:00
Juan Batiz-Benet
99f2378bac mount: fixed mount init + teardown
This commit adds a Mount abstraction (which is really just
a wrapped context closer). It makes sure to bind the mount
to the fate of the Node (i.e. close it if the node ends).
This fixes #350
2014-11-16 01:42:42 -08:00
Brian Tiger Chow
ed4a8eb782 chore(tests) add Short() -> SkipNow() to slowest tests
vanilla:
    21.57 real        45.14 user         8.51 sys

short:
    14.40 real        31.13 user         5.56 sys

License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
2014-11-15 02:10:53 -08:00
Jeromy
4f083d54d6 write a few package doc strings to improve look of godoc 2014-11-08 21:42:36 -08:00
Juan Batiz-Benet
387d0a935d ipns test: unused import + rmv old comment 2014-11-07 14:21:12 -08:00
Jeromy
bc0e31922b probably fix the cat bug 2014-11-07 14:13:11 -08:00