Commit Graph

999 Commits

Author SHA1 Message Date
Jeromy
13c489eca1 fix context respect through fuse reading 2015-03-24 12:23:01 -07:00
Henry
07008042f1 ipfs ls: added --headers option
- added tests for 'ipfs ls --headers'
- comments from CR (opts)
- sharness: fix ls test whitespace
2015-03-20 15:34:56 -07:00
Juan Batiz-Benet
8a3db7cbc4 testing: nofuse testing (for osx travis) 2015-03-18 01:44:36 -07:00
Jeromy
7ad8dd8523 ignore bootstrap failures in namesys initialization 2015-03-17 21:57:57 -07:00
Jeromy
f679127d83 comments! and cleanup 2015-03-17 20:57:21 -07:00
Jeromy
eb228eb615 remove addCloser 2015-03-17 20:57:21 -07:00
Jeromy
9ab59e44ad implement in memory model for ipns filesystem, to be used as backing for ipns fuse interface 2015-03-17 20:57:20 -07:00
Andy Leap
512171aa98 Fixing test failure(issue with looking for exact text) 2015-03-16 16:27:34 -04:00
Andy Leap
89ca37d1d1 Fixes issue #924 2015-03-16 16:08:45 -04:00
Tommi Virtanen
fdd1cd8dc0 Remove fsrepo.At, make Open a constructor function
Nobody calls At without immediately calling Open.

First step, a mechanical transformation. Cleanups will follow.
2015-03-13 20:19:03 -07:00
Henry
b688e72de0 ipfs object put: return error if object is empty (fixes #883) 2015-03-10 22:58:50 +01:00
Henry
759437e054 ls: introduce specific output types (removes IsDir from object plumbing commands) 2015-03-10 13:56:57 +01:00
Henry
d88ba19357 disabled 'ipfs update' command for now 2015-03-09 10:22:11 +01:00
Henry
e8403b1f11 removed dead code
- old http server (superseeded by core/corehttp)
- unused makeDatastore() helpers
2015-03-09 10:21:35 +01:00
anarcat
451222cf1d gc is actually repo gc, reflect in docs
not exactly elegant, but fixes #871 in the short term. in the mid term, unless more `repo` commands show up, i suggest just replacing `repo gc` simply by `gc`.
2015-03-08 18:05:42 -04:00
Juan Batiz-Benet
bff7f73068 Merge pull request #878 from jbenet/dontIgnoreCancelFuncs
context: Always call returned cancel funcs
2015-03-07 09:49:19 -08:00
Juan Batiz-Benet
1d5b903611 added cancel func calls previously ignored 2015-03-07 09:31:46 -08:00
Juan Batiz-Benet
dfe2b16763 cmds/id: use req context -- dont timeout unnecessarily
commands should last as long as the user keeps the cmd going
2015-03-07 09:24:15 -08:00
Henry
bc84ffafe3 enable stdin input for ipfs object put 2015-03-07 16:50:00 +01:00
anarcat
6a3578be84 explain what direct/indirect/recursive means
i couldn't understand what those meant. it was explain (at least partly) in #590 so let's share the goods!
2015-03-07 08:32:48 -05:00
Tonis Tiigi
0f69823077 Add nofuse build tag to darwin mounter 2015-03-05 18:00:45 +02:00
Tonis Tiigi
91ab1401ab Fix nofuse build tags syntax 2015-03-05 18:00:36 +02:00
Henry
e55aaf3f83 nofuse: better help description for 'ipfs mount' 2015-03-05 01:24:17 +01:00
Henry
66f1035d93 simple nofuse build tag to allow freebsd compilation and maybe pave the way towards windows as well 2015-03-05 01:24:17 +01:00
Juan Batiz-Benet
51a8bcbf64 Merge pull request #847 from jbenet/publish-webui
published new webui
2015-03-02 23:38:30 -08:00
Juan Batiz-Benet
7bc1de4ec5 published new webui
/ipfs/QmXX7YRpU7nNBKfw75VG7Y1c3GwpSAGHRev67XVPgZFv9R

ee74f75d0b
2015-03-02 23:33:10 -08:00
Juan Batiz-Benet
9f27556090 Merge pull request #823 from BrendanBenshoof/master
fixing bug 812
2015-03-02 17:02:24 -08:00
bbenshoof
ac5cfc5664 fixing bug 812 2015-03-02 17:07:21 -05:00
Henry
607468a96d beautify 'ipfs ls' and 'ipfs object links' (updates #799) 2015-03-01 14:03:51 +01:00
Jeromy
3c8a391fe4 dont put wantlist getter in exchange interface 2015-02-27 00:12:21 -08:00
Jeromy
98a183d53e fix output formatting on stat 2015-02-27 00:12:21 -08:00
Jeromy
b514478f32 rename wantlist to bitswap, add stat command 2015-02-27 00:12:21 -08:00
Jeromy
559a241566 implement a simple wantlist command to allow the user to view their wantlist 2015-02-27 00:12:21 -08:00
Jeromy
7fb63d7e43 move signing options into a validation checker struct 2015-02-26 22:05:03 -08:00
Jeromy
049b5ad945 make signing dht put records optional 2015-02-26 22:05:03 -08:00
Jeromy
36a21561f7 stress test for ipfs fuse 2015-02-26 19:12:05 -08:00
Juan Batiz-Benet
88dea5771d Merge pull request #819 from jbenet/x_net_context_leeroy
update context imports to golang.org/x/net
2015-02-25 03:17:28 -08:00
Henry
92d08db7a5 rewrote import paths of go.net/context to use golang.org/x/context
- updated go-ctxgroup and goprocess
ctxgroup: AddChildGroup was changed to AddChild. Used in two files:
- p2p/net/mock/mock_net.go
- routing/dht/dht.go

- updated context from hg repo to git
prev. commit in hg was ad01a6fcc8a19d3a4478c836895ffe883bd2ceab. (context: make parentCancelCtx iterative)
represents commit 84f8955a887232b6308d79c68b8db44f64df455c in git repo

- updated context to master (b6fdb7d8a4ccefede406f8fe0f017fb58265054c)

Aaron Jacobs (2):
net/context: Don't accept a context in the DoSomethingSlow example.
context: Be clear that users must cancel the result of WithCancel.

Andrew Gerrand (1):
go.net: use golang.org/x/... import paths

Bryan C. Mills (1):
net/context: Don't leak goroutines in Done example.

Damien Neil (1):
context: fix removal of cancelled timer contexts from parent

David Symonds (2):
context: Fix WithValue example code.
net: add import comments.

Sameer Ajmani (1):
context: fix TestAllocs to account for ints in interfaces
2015-02-25 11:58:19 +01:00
Juan Batiz-Benet
f51e464a55 Merge pull request #801 from jbenet/feat/get-put-cmds
Implement dht put and get CLI commands
2015-02-25 01:35:38 -08:00
Jeromy
ff30558195 make it easier to create custom dag objects via the CLI 2015-02-23 21:33:38 -08:00
Jeromy
29fe7f03f8 remove unused case 2015-02-23 21:09:16 -08:00
Jeromy
7c0c3c4511 add put and get dht commands to cli 2015-02-23 21:09:16 -08:00
Jeromy
69e09d40c5 add version info endpoint to gateway 2015-02-20 11:49:48 -08:00
Jeromy
15b181ffe2 return early from add PostRun if error is set 2015-02-19 13:52:30 -08:00
Jeromy
a29c0fc751 move blocking calls out of single threaded loops, cancel contexts ASAP 2015-02-19 06:04:39 +00:00
Jeromy
3cda8ca685 teach ipfs refs -r how to use GetBlocks 2015-02-19 03:21:55 +00:00
Jeromy
5253b6ab13 pass routed host into bitswap construction 2015-02-18 19:11:38 +00:00
Jeromy
03c0b2d3e0 keep routing logic out of NewStream on routedHost 2015-02-18 19:11:37 +00:00
Jeromy
6241c25984 make contructor code a little less magical 2015-02-18 19:11:33 +00:00
Jeromy
e40e5699f9 use a routedHost in the core node constructor 2015-02-18 18:56:57 +00:00
Jeromy
d8d933c862 move core/net.go to 'corenet' and change interface a tad 2015-02-18 18:56:56 +00:00
Jeromy
8b8a600a81 add dial and listen methods to the core for super awesomeness 2015-02-18 18:56:56 +00:00
Juan Batiz-Benet
34e4d8c3a6 updated webui 2015-02-16 13:53:21 -08:00
Juan Batiz-Benet
01feeac1bb new webui hash 2015-02-16 04:34:36 -08:00
Juan Batiz-Benet
cc8ed14e7a bootstrap: update bootstrapping process.
Note: the dht-specific part of the bootstrap function
was only there to make sure to call `dht.Update(ctx, npeer)`.
This already happens on all new connections made by the
network, as the dht is signed up for notifications.
2015-02-15 04:41:16 -08:00
Brian Tiger Chow
9dd12922b3 refactor(routing) expose Bootstrap() error on routing interface 2015-02-15 04:41:16 -08:00
Brian Tiger Chow
1dfcce9f5a fix(grc) move Bootstrap method onto routing interface 2015-02-15 04:41:16 -08:00
Brian Tiger Chow
19eb35137b refactor(routing) rename grandcentral to supernode
thanks @mappum

remove .go-ipfs
2015-02-15 04:41:10 -08:00
Brian Tiger Chow
770489ab2c fix(corerouting) remove TODO. no longer applies now that routing servers are specified manually 2015-02-14 14:13:56 -08:00
Brian Tiger Chow
a6710e9f53 feat(gcr/s) comment 2015-02-14 14:13:56 -08:00
Brian Tiger Chow
9e5b3b7773 refactor(gcr/c) pass host.Host into GCR client 2015-02-14 14:13:54 -08:00
Brian Tiger Chow
46bbd11e6b fix(gcr/s,c) register stream handlers 2015-02-14 14:13:54 -08:00
Brian Tiger Chow
d80e9aba7a feat(gcr/c) add support for multiple servers 2015-02-14 14:13:54 -08:00
Brian Tiger Chow
73b544c932 feat(corerouting) add package for custom routing options
fix(corerouting): connect to routing servers when setting up GCR client

doc(corerouting) add TODO to move stuff to routing bootstrap
2015-02-14 14:13:54 -08:00
Juan Batiz-Benet
247649969e Merge pull request #726 from kevinwallace/gateway_hostname
gateway: attempt to resolve hostname to ipfs path
2015-02-12 18:52:16 -08:00
Jeromy Johnson
6eb5d8ea77 Merge pull request #774 from jbenet/block-put-fix
Fixed 'ipfs block put' panic
2015-02-11 20:21:11 -08:00
Matt Bell
bbca9a1c37 Fixed 'ipfs block put' panic 2015-02-11 14:56:36 -08:00
Jeromy
7a2545a14b implement nodebuilder 2015-02-11 21:47:07 +00:00
Jeromy
140c70d772 document some packages 2015-02-10 22:59:10 +00:00
Kevin Wallace
e5abf0764c corehttp: add test for gateway with mocked namesys
License: MIT
Signed-off-by: Kevin Wallace <kevin@pentabarf.net>
2015-02-08 12:54:43 -08:00
Kevin Wallace
794b7b7b3e corehttp: tear off makeHandler, for tests
License: MIT
Signed-off-by: Kevin Wallace <kevin@pentabarf.net>
2015-02-08 12:50:47 -08:00
Kevin Wallace
084cdc3ed8 gateway: attempt to resolve hostname to ipfs path
This allows someone to host a static site by pointing a TXT record at their
content in IPFS, and a CNAME record at an IPFS gateway.

Note that such a setup technically violates RFC1912 (section 2.4; "A CNAME
record is not allowed to coexist with any other data."), but tends to work in
practice.

We may want to consider changing the DNS->IPFS resolution scheme to allow this
scenario to be RFC-compliant (e.g. store the mapping on a well-known subdomain
to allow CNAME records on the domain itself).

License: MIT
Signed-off-by: Kevin Wallace <kevin@pentabarf.net>
2015-02-08 11:27:06 -08:00
Kevin Wallace
fbd76ebb5b corehttp: ServeOption supports chaining muxes
Each option now additionally returns the mux to be used by future options. If
every options returns the mux it was passed, the current behavior is unchanged.

However, if the option returns an a new mux, it can mediate requests to handlers
provided by future options:

    return func(n *core.IpfsNode, mux *http.ServeMux) (*http.ServeMux, error) {
      childMux := http.NewServeMux()
      mux.Handle("/", handlerThatDelegatesToChildMux)
      return childMux, nil
    }

License: MIT
Signed-off-by: Kevin Wallace <kevin@pentabarf.net>
2015-02-08 11:27:06 -08:00
Juan Batiz-Benet
872c64dd79 gateway: dont cache ipns paths
ipns paths are mutable and should not be cached. this error is
a byproduct of the currently messy gateway route. We should split
the /ipfs and /ipns routes up.
2015-02-07 10:10:05 -08:00
Brian Tiger Chow
8558838d00 fix(core) check nil for _all_ owned resources
since construction can fail, and construction is non-trivial, it's
probably safer to never assume resource exists.

cc @jbenet @whyrusleeping
2015-02-06 11:22:43 -07:00
Brian Tiger Chow
db644fe1b7 allow access to the field for convenience
decalarative configuration is superior. the thread-safety because
important during normal operation
2015-02-06 08:13:15 -08:00
Juan Batiz-Benet
64a4c27913 corehttp: allow all webui paths we published.
Otherwise we break users links! cc @mappum
2015-02-06 07:30:42 -08:00
Matt Bell
0195c03664 core/corehttp: Updated WebUI hash 2015-02-04 23:51:06 -08:00
Matt Bell
2d173c3a25 core/corehttp: Return 403 for blocked requests instead of 404 2015-02-04 18:46:59 -08:00
Matt Bell
b1ca07d6c5 core/corehttp: Added gateway path whitelisting 2015-02-04 18:46:54 -08:00
Matt Bell
262e78122a core/corehttp: Added Suborigin header to gateway responses 2015-02-04 16:53:24 -08:00
Brian Tiger Chow
d50a7ff003 feat(corehttp) add a Gateway blocklist
use pointer

use func

comment on decider to clarify whether it allows or denies

fix set conf

gstw
2015-02-04 16:17:39 -08:00
Jeromy
2501a7c7b7 update UI from PR comments 2015-02-04 23:07:13 +00:00
Jeromy
4770c5e142 only expose IpfsNode as param 2015-02-04 23:07:13 +00:00
Jeromy
b79fffc965 implement metadata node for unixfs and other 2015-02-04 23:07:12 +00:00
Juan Batiz-Benet
e384aec2a9 cmds/root: ipfs root text arrangement 2015-02-03 12:17:59 -08:00
Juan Batiz-Benet
10cd499a8b cmds/swarm connect had broken 2015-02-03 05:51:31 -08:00
Juan Batiz-Benet
581c4e558e cmds/id: show self addrs 2015-02-03 05:51:31 -08:00
Juan Batiz-Benet
58f39687cf logs: removed all log.Errors unhelpful to users
Let's save log.Error for things the user can take action on.
Moved all our diagnostics to log.Debug. We can ideally reduce them
even further.
2015-02-03 01:06:07 -08:00
Juan Batiz-Benet
d13876ffe9 commands/id: version was flipped 2015-02-02 21:05:32 -08:00
Juan Batiz-Benet
b0a1cf0371 ipfs swarm addrs: print out known addresses
this will help us introspect what's going on.
2015-02-02 21:05:32 -08:00
Juan Batiz-Benet
e908effb4b AddrManager: use addr manager with smarter TTLs
This addr manager should seriously help with the addrsplosion
problem.
2015-02-02 21:04:14 -08:00
Matt Bell
e5f3ac99c3 core/coreunix: Documented return values 2015-02-02 10:13:33 -08:00
Matt Bell
1ad5b345b8 core/commands: add: Added -w/--wrap-with-directory option 2015-02-02 10:07:35 -08:00
Matt Bell
62333521c6 core/coreunix: Created 'AddWrapped' function to add files with a wrapped directory (to preserve filename in path) 2015-02-02 10:07:35 -08:00
Jeromy
061a866306 ensure dagreaders are cleaned up after 'cat' command finishes 2015-02-02 08:33:54 +00:00
Brian Tiger Chow
88fa7388de feat(core) add shutdown message 2015-02-01 21:54:20 -08:00
Brian Tiger Chow
d0f9be56e7 refac(core) privatize method 2015-02-01 21:54:20 -08:00
Brian Tiger Chow
1beef957da refac(core): expose core.OnlineWithRouting constructor option
fix FIXUP maybeRouter in core
2015-02-01 21:54:19 -08:00
Brian Tiger Chow
c114b04ae1 feat(bitswap): synchronous close 2015-02-01 21:54:19 -08:00
Juan Batiz-Benet
c43f539f3d cmds/cat: fix length to use reader.Size()
unixfs file size != merkledag cumulative size
2015-02-01 19:24:36 -08:00
Juan Batiz-Benet
aff1d8bdcf ipfs swarm disconnect (opposite of connect) 2015-02-01 06:37:14 -08:00
Juan Batiz-Benet
3cd3424900 cmds/swarm: now speaks ipfsaddr (.../ipfs...) 2015-02-01 06:36:51 -08:00
Juan Batiz-Benet
bebc3ca0fd cmd/bootstrap: bugfix on add (dedup) 2015-02-01 06:07:21 -08:00
Juan Batiz-Benet
188d336204 cmds/bootstrap: fix marshalling + listing errors 2015-02-01 05:36:07 -08:00
Juan Batiz-Benet
29bf59dded bootstrap: use ipfsaddr for boostrap peers ⚠️
⚠️ this commit makes your current configs unusable, as the
default bootstrap peers. You may need to edit your config.

Go from:

```js
Bootstrap: [
  {
    "Address": "/ip4/104.131.131.82/tcp/4001",
    "PeerID": "QmaCpDMGvV2BGHeYERUEnRQAwe3N8SzbUtfsmvsqQLuvuJ"
  }
]
```

To:
```js
Bootstrap: [
  "/ip4/104.131.131.82/tcp/4001/ipfs/QmaCpDMGvV2BGHeYERUEnRQAwe3N8SzbUtfsmvsqQLuvuJ"
]
```
2015-02-01 05:16:52 -08:00
Juan Batiz-Benet
f1d34a2a85 test/sharness: fix errors
- core: daemon stdout print to cmd + daemon init checks
- core: fixed bug where the gateway was printed as "API"
- sharness/test-lib: daemon init checks
- sharness/test-lib: portable TCP port check
- sharness/init: fix test bits output
- sharness: use common hashes in one place.
- move t0100-http-gateway -> t0111-gateway-writable
- sharness: test-lib funcs for gateway config
- sharness/t0111-gateway-writable: use sh funcs
- sharness/t0111-gateway-writable: fixes
  - escape all vars (always `cmd "$VAR"` never `cmd $VAR`)
  - use $FILEPATH, not $path
  - last test seems to fail
2015-01-31 22:54:34 -08:00
Juan Batiz-Benet
4016d35a81 Merge pull request #617 from mildred/http-rest
HTTP: add handlers to allow object creation and modification
2015-01-31 18:07:56 -08:00
Juan Batiz-Benet
f43cf2d917 Merge pull request #703 from jbenet/net-set-listener
online services started before network listens
2015-01-31 17:25:18 -08:00
Juan Batiz-Benet
7b85579d7a core: move online service init block into own func
addresses CR comments
2015-01-31 17:20:34 -08:00
Jeromy
b57ba192e6 fix cast panic in ipfs name resolve when daemon is running
Addresses bug #689
2015-01-31 23:55:07 +00:00
Mildred Ki'Lya
c9ff778bd6 Added -bool option to ipfs config command 2015-01-31 23:36:46 +01:00
Mildred Ki'Lya
295cc443da HTTP Gateway: add /ipns/ GET requests 2015-01-31 23:36:46 +01:00
Mildred Ki'Lya
7d09da3c8b Make gateway read-only by default and add option to make it writable 2015-01-31 23:36:45 +01:00
Mildred Ki'Lya
d221d55d85 HTTP: add handlers to allow object creation and modification 2015-01-31 20:47:34 +01:00
Juan Batiz-Benet
1a3752b81f core: setup peerhost + listen separate steps
We had a problem: we were starting all the services with the network
live, and so would miss early messages. We were noticing bitswap
messages not handled (not in muxer). Many of the subsystems expect
the network to _exist_ when they start up, so we split construction
and starting to listen into two separate steps.
2015-01-30 20:37:53 -08:00
Jeromy
9ddfafb40a address concerns about user interface with new Path type 2015-01-30 19:55:38 +00:00
Jeromy
abb3c9c9c4 implement path type 2015-01-29 17:51:08 +00:00
Juan Batiz-Benet
14eceee35e epictest: fix three-legged-cat
http://gateway.ipfs.io/ipfs/QmfUFkQuqjfQzLNhMLwiibiAxnAaZEJAbYkey9orXJ4aQe/3lcat.jpg
2015-01-29 01:10:01 -08:00
Juan Batiz-Benet
17e542a559 Merge pull request #675 from jbenet/diag-helptext
add more help text for ipfs diag net
2015-01-28 17:14:35 -08:00
Juan Batiz-Benet
c36e8dd04c gateway: reordered headers to avoid error
cc @mappum
2015-01-28 16:55:00 -08:00
Matt Bell
cea68afa2e core/corehttp: Handle Etag for caching 2015-01-28 16:50:16 -08:00
Matt Bell
fb986fd822 core/corehttp: Added cache headers to gatewayy requests 2015-01-28 16:48:07 -08:00
Matt Bell
e4eb964f69 core/corehttp: Use consts for path prefixes 2015-01-28 16:43:45 -08:00
Matt Bell
2759d1c126 core/corehttp: Added handling of /ipns/<hash>/x paths 2015-01-28 16:38:36 -08:00
Matt Bell
950e492fc4 core/corehttp: Close DAGReaders when done 2015-01-28 16:01:42 -08:00
Matt Bell
58d401c3b0 core/corehttp: gateway_handler: Redirect to path with trailing slash when showing a directory's index.html 2015-01-28 16:01:42 -08:00
Matt Bell
e2be5c2039 core/corehttp: Added RedirectOption 2015-01-28 16:01:41 -08:00
Matt Bell
b8fcece0e5 core/corehttp: Handle IPNS paths in gateway 2015-01-28 16:01:41 -08:00
Matt Bell
d338a81eca core/corehttp: Support Range requests in gateway handler 2015-01-28 15:49:55 -08:00
Juan Batiz-Benet
9959775ff7 Merge pull request #684 from jbenet/fuse-emancipation
fuse: no longer require fuse to compile ipfs
2015-01-28 13:25:23 -08:00
Jeromy
72a5902e12 address concerns from PR 2015-01-28 19:36:30 +00:00
Jeromy
f1267d0624 change ipns resolve/publish to store raw keys, not b58 encoded 2015-01-28 19:36:30 +00:00
Juan Batiz-Benet
7ae3706b6d fuse: no longer require fuse to compile ipfs
This commit removes the dependency on go-fuse-version, and thus the
fuse headers. It also introduces an elaborate troubleshooting process
that diagnoses whether fuse installed -- and which version -- with as
little requirements as possible (attept to use sysctl, fall-back on
the go-fuse-version binary, etc). It then nicely instructs the user
what to do next.
2015-01-28 05:18:41 -08:00
Brian Tiger Chow
bbce860bd0 remove debug log output 2015-01-27 17:15:56 -08:00
Brian Tiger Chow
961e3ced43 feat(coreunix): AddR for recursive Adds 2015-01-27 16:24:36 -08:00
Brian Tiger Chow
1ea9481a63 move config.Init into config package 2015-01-27 16:23:58 -08:00
Jeromy
b456d476a3 updates from CR 2015-01-27 17:28:02 +00:00
Jeromy
c50d763727 add more help text for ipfs diag net 2015-01-27 09:05:06 +00:00
Jeromy Johnson
4940c3e0ae Merge pull request #655 from jbenet/feat/dagseek
Implement io.Seeker on unixio.DAGReader
2015-01-26 19:33:41 -08:00
Juan Batiz-Benet
1eb0bfe834 Merge pull request #668 from jbenet/hack
misc user-friendliness fixes
2015-01-26 19:00:09 -08:00
Juan Batiz-Benet
2b0c89a5c7 commands/diag: switch clarity 2015-01-26 18:50:16 -08:00
Jeromy
26826bd55e implement seeking in the dagreader 2015-01-27 01:33:09 +00:00
Juan Batiz-Benet
36d03306d7 Merge pull request #652 from jbenet/cli-changes
CLI changes
2015-01-26 17:24:54 -08:00
Matt Bell
d666155a0a core/commands: get: Clean output path 2015-01-26 17:07:30 -08:00
Juan Batiz-Benet
76d9d89aff user friendliness in logs + output 2015-01-26 17:01:00 -08:00
Matt Bell
2c019b542e core/commands: Fixed net diag command not outputting in chosen format 2015-01-26 17:01:00 -08:00
Juan Batiz-Benet
ae5e244354 Merge pull request #648 from jbenet/nat-lite
NAT-Lite
2015-01-26 16:59:33 -08:00
Matt Bell
3799ad9023 core/commands: log tail: Return from goroutine when request context closes, resolves #659 2015-01-26 14:24:33 -08:00
Juan Batiz-Benet
ca757c66ff p2p/nat: managed by host now.
Exposing the NAT to the core is unnecessary. The Host can take
care of it. If a need emerges, we can address it then.
2015-01-26 14:00:00 -08:00
Juan Batiz-Benet
332d350196 p2p/nat: re-factors nat object
- allow retrieving addresses
- allow notifications on mapping changes
- allow lifecycle mgmt (future commit will manage it)
2015-01-26 13:45:02 -08:00
Matt Bell
41d5c822d7 core/commands: get: Place files at root of TAR when using a multi-element ipfs path 2015-01-24 21:40:19 -08:00
Matt Bell
e6d6e9fed6 core/commands: Added 'get' to root command helptext 2015-01-24 21:40:18 -08:00
Jeromy
403940af42 print out correct object for dht findproviders command 2015-01-25 01:21:23 +00:00
Juan Batiz-Benet
069cff3d25 p2p/nat: upnp + pmp 2015-01-24 12:42:22 -08:00
Brian Tiger Chow
f9395b7667 fix: flush the pinner 2015-01-24 12:22:22 -08:00
Brian Tiger Chow
7f6bd2807d feat(coreunix): AddR for recursive Adds 2015-01-24 12:22:22 -08:00
Matt Bell
27c7ebdf48 core/commands: get: Changed option description 2015-01-24 07:28:43 -08:00
Matt Bell
3909905313 core/commands: get: Cleaned up option handling 2015-01-24 05:35:27 -08:00
Matt Bell
fe48ae2dd6 Extracted TAR archive building/reading code out of 'ipfs get' 2015-01-24 03:06:25 -08:00
Matt Bell
5efd99c1fe core/commands: get: Error if specified compression level is invalid 2015-01-24 03:06:25 -08:00
Matt Bell
816a047a12 core/commands: 'get' arguments shouldn't be variadic 2015-01-24 03:06:25 -08:00
Matt Bell
f034f3e13a core/commands: Show download progress in 'get' 2015-01-24 03:06:25 -08:00
Matt Bell
f3c4f87ec2 core/commands: Added GZIP compression to 'get' 2015-01-24 03:06:25 -08:00
Matt Bell
f433a95201 core/commands: Save 'get' output to disk
squash! core/commands: Save 'get' output to disk

core/commands: get: Fixed PostRun signature
2015-01-24 03:06:25 -08:00
Matt Bell
276a8d062c core/commands: Made 'get' copying thread-safe 2015-01-24 03:06:24 -08:00
Matt Bell
36249b9292 core/commands: Added 'get' command 2015-01-24 03:06:24 -08:00
Brian Tiger Chow
af20d67ac0 add synchronous garbage collect function 2015-01-24 01:32:28 -08:00
Brian Tiger Chow
d738a02428 rename GarbageCollectAsync method
corerepo package name provides sufficient context (even if renamed by
caller)
2015-01-24 01:32:28 -08:00
Brian Tiger Chow
be41444a9e provide simple wrapper methods for AllKeysRange
@jbenet @whyrusleeping

was the 1<<16 intentional? replaced the raw methods with wrappers.
2015-01-24 01:32:28 -08:00
Brian Tiger Chow
d5e4c6a0bf move core/repo to core/corerepo 2015-01-24 01:32:27 -08:00
Brian Tiger Chow
e9d3c9828c perform multiaddr conversion in the function 2015-01-24 01:32:27 -08:00
Jeromy
b287422ebd fix type in findProviders command 2015-01-24 08:59:34 +00:00
Brian Tiger Chow
6fedf259eb remove prefix logger 2015-01-24 00:30:56 -08:00
Jeromy
20c40c3f10 fix commands interface 2015-01-24 08:06:57 +00:00
Juan Batiz-Benet
4334f6fda3 Merge pull request #613 from jbenet/progress-bars
Progress Bars
2015-01-23 22:20:34 -08:00
Juan Batiz-Benet
b279da2918 Merge pull request #626 from jbenet/query-cmd
dht query command
2015-01-23 22:01:48 -08:00
Jeromy
d68efad06c respect verbose option a bit, and show query events for other commands 2015-01-24 05:32:50 +00:00
Jeromy
4607f54254 add findpeer command 2015-01-24 03:56:46 +00:00
Jeromy
56a5e72760 implement dht findprovs and add error output to dht query 2015-01-24 03:56:46 +00:00
Jeromy
528eb5a55a use a notification type strategy for the query events 2015-01-24 03:56:45 +00:00
Jeromy
ec5276c29c really ugly impl of 'ipfs dht query' command 2015-01-24 03:56:45 +00:00
Matt Bell
ccaabbc06d core/commands: Rearranged command list sections 2015-01-23 19:17:09 -08:00
Matt Bell
452f54a48e core/commands: Enabled stdin arguments for 'bootstrap {add, rm} 2015-01-23 19:11:56 -08:00
Matt Bell
71301d2c63 core/commands: Updated root command helptext 2015-01-23 19:11:56 -08:00
Matt Bell
5706471897 commands: Made PostRun signature match Run 2015-01-23 18:29:31 -08:00
Matt Bell
79741438d9 core/commands: config: Simplified some syntax 2015-01-23 18:29:31 -08:00
Matt Bell
3fc9bedb0b commands: Made Std{in|out|err} accessible in Request/Response 2015-01-23 18:29:31 -08:00
Matt Bell
b77d1c21b6 core/commands: add: Don't show progress bar when using --quiet option 2015-01-23 18:29:31 -08:00
Matt Bell
121dfb10b4 core/commands: Fixed progress bar line clear race condition in 'add' 2015-01-23 18:29:31 -08:00
Matt Bell
2363cb63e6 core/commands: Fixed 'add' progress bar sometimes not clearing progress bar output line 2015-01-23 18:29:31 -08:00
Matt Bell
c3ea164f64 core/commands: Added progress bars for 'add'
squash! core/commands: Added progress bars for 'add'

Use vendored progress bar lib in 'add'
2015-01-23 18:29:30 -08:00
Matt Bell
487ef33e67 core/commands: Added progress bar to 'cat'
squash! core/commands: Added progress bar to 'cat'

Vendored progress bar lib
2015-01-23 18:29:30 -08:00
Matt Bell
7b4de230eb commands: Refactored Command#Run function signature to (req Request, res Response) 2015-01-23 18:29:29 -08:00
Juan Batiz-Benet
c4f9a92e55 Merge pull request #628 from jbenet/feat/more-bootstraps
Add Bootstrap Peers: Mercury, Earth, Venus, Jupiter
2015-01-23 17:08:56 -08:00
Juan Batiz-Benet
bb2d81ace2 Merge pull request #622 from jbenet/webui-commands
Webui Commands
2015-01-23 16:51:11 -08:00
Brian Tiger Chow
bbc282bfab more bootstrap nodes 2015-01-23 16:19:50 -08:00
Matt Bell
68b2a3f15c core/commands: Renamed 'log read' to 'log tail' 2015-01-23 15:08:20 -08:00
Juan Batiz-Benet
95d58b2a4a core: cleaned up bootstrap process 2015-01-23 05:25:31 -08:00
Juan Batiz-Benet
dd9c1b6243 core/bootstrap: CR comments 2015-01-23 02:08:30 -08:00
Juan Batiz-Benet
d6ce837d72 core/bootstrap: cleaned up bootstrapping
Moved it to its own package to isolate scope.
2015-01-23 02:08:29 -08:00
Juan Batiz-Benet
010cedf0a9 ipfs swarm peers: sort output 2015-01-23 02:08:29 -08:00
Juan Batiz-Benet
ec848c486b core: call dht bootstrap 2015-01-23 02:08:28 -08:00
Juan Batiz-Benet
898b9696ca diag/net: add timeout param to cmd 2015-01-23 02:08:28 -08:00
Juan Batiz-Benet
82d38a2692 routing/dht: periodic bootstrapping #572 2015-01-23 02:08:28 -08:00
Jeromy
eb6afd3edc fix interface for coreunix.Cat, now takes a path 2015-01-23 06:39:20 +00:00
Matt Bell
81d17e0843 cmd/ipfs: gatewayHandler: Fixed directory listing getting appended to index.html pages 2015-01-22 16:29:00 -08:00
Matt Bell
926b96463d core/commands: Added 'log read' command
squash! core/commands: Added 'log read' command

core/commands: Use a unidirectional channel for 'log read' output
2015-01-22 16:28:59 -08:00
Matt Bell
8d412e48cf core/commands: Added an 'ipfs config replace' command 2015-01-22 16:28:59 -08:00
Brian Tiger Chow
fadede6cb2 separate concerns 2015-01-22 01:28:40 -08:00
Brian Tiger Chow
fadedf9e68 refactor(core) extract corehttp package
PACKAGE DOCUMENTATION

package corehttp

    FUNCTIONS

    func GatewayOption(n *core.IpfsNode, mux *http.ServeMux) error

    func ListenAndServe(n *core.IpfsNode, addr ma.Multiaddr, options
    ...ServeOption) error

    func WebUIOption(n *core.IpfsNode, mux *http.ServeMux) error

    TYPES

    type ServeOption func(*core.IpfsNode, *http.ServeMux) error

    func DaemonOption(cctx commands.Context) ServeOption
2015-01-22 01:08:59 -08:00
Juan Batiz-Benet
f6111d82fe Merge pull request #558 from jbenet/feat/gc
initial implementation of repo-gc command
2015-01-21 16:48:28 -08:00
Jeromy
8e7d984751 updates from PR, tests tests tests! 2015-01-21 08:55:50 +00:00
Brian Tiger Chow
721ff57263 fix(blockservice) fully async exchange.HasBlock 2015-01-20 23:43:21 -08:00
Jeromy
4de881a185 move GC code into core/repo, and add sharness test 2015-01-21 04:28:02 +00:00
Matt Bell
31ae178078 commands: Support outputting <-chan interface{} 2015-01-21 04:28:02 +00:00
Jeromy
9adcfe7bc2 address concerns from PR 2015-01-21 04:28:02 +00:00
Jeromy
ccb36277dd fix pinning UX, and add tests to match 2015-01-21 04:28:01 +00:00
Jeromy
b91db68056 update pinning to new semantics, and fix a couple bugs 2015-01-21 04:28:01 +00:00
Jeromy
3601a93d17 fix pin command output 2015-01-21 04:28:01 +00:00
Jeromy
f0781d8119 initial implementation of repo-gc command 2015-01-21 04:28:01 +00:00
Juan Batiz-Benet
56ae2fd0a8 routing: record validation into record/
This commit moves the record validation/verification
from dht/ into the new record/ packaage. Validator object
-- which is merely a map of ValidatorFuncs -- with a
VerifyRecord

cc @whyrusleeping
2015-01-19 08:10:37 +00:00
Jeromy
a5233faeae some comments 2015-01-19 08:06:51 +00:00
Jeromy
feeada0d90 fix fuse mounting issues
this time, without loading the private key on every startup
2015-01-19 08:05:52 +00:00
Brian Tiger Chow
797aad9137 refactor(core) extract const 2015-01-18 14:41:43 -08:00
Brian Tiger Chow
b0596cd4ff rename coreio to coreunix 2015-01-18 14:41:43 -08:00
Brian Tiger Chow
a025fc9adf refactor(core) switch style to type assertions
@jbenet cool with this?
2015-01-18 14:41:43 -08:00
Brian Tiger Chow
c1ff2149f1 doc(core) add TODO 2015-01-18 14:41:43 -08:00
Brian Tiger Chow
15a6237ffc fix(core) improve documentation and describe behavior of function 2015-01-18 14:41:43 -08:00
Brian Tiger Chow
19c2c6556f fix(core) don't assume Repo won't be nil 2015-01-18 14:41:43 -08:00
Brian Tiger Chow
de45277883 doc(core, main) 2015-01-18 14:41:43 -08:00
Brian Tiger Chow
1edc5c0a65 refactor(core) Close in teardown
This declarative style is simpler to compose than the imperative wiring
up of objects.

+ pass context to StartOnlineServices as parameter. one by one, trying
to remove dependencies on node state so these initialization steps can
be broken down.
2015-01-18 14:41:43 -08:00
Brian Tiger Chow
ffe6f9a949 doc(core_io/Add)
@jbenet wasn't sure about the terminology here. I'm certain what I wrote
is not entirely correct. Feel free to edit.
2015-01-18 14:41:42 -08:00
Brian Tiger Chow
3dd68ba5c5 fix(core_io/Add): by default, use pinner
@whyrusleeping @jbenet does passing this argument effectively instruct
the dagbuilder to pin recursively?
2015-01-18 14:41:42 -08:00
Brian Tiger Chow
4b5ff960c9 feat(core): use repo.Repo in core constructor 2015-01-18 14:41:42 -08:00
Brian Tiger Chow
884143bf9c move generic packages to thirdparty (see thirdparty/README.md) 2015-01-18 14:04:45 -08:00
Juan Batiz-Benet
132add2ffd core/mount: make non-darwin archs see fuseversion
See the note:

// this file is only here to prevent go src tools (like godep) from
// thinking fuseversion is not a required package by non-darwin archs.
2015-01-18 12:38:18 -08:00
Juan Batiz-Benet
2963f48f62 Merge pull request #554 from jbenet/feat/reprovide
basic reprovider implementation
2015-01-17 03:03:01 -08:00
Juan Batiz-Benet
00b099c71f core/cmds: fix go-fuse-version path 2015-01-17 02:45:17 -08:00
Jeromy
acfc35212e add backoff retry to reprovider 2015-01-17 04:31:50 +00:00
Jeromy
a7650b259d add test for reprovider and slight refactor 2015-01-14 22:14:52 +00:00
Juan Batiz-Benet
01283b92f7 Merge pull request #556 from jbenet/net-diag-viewer
diag/net: visualizing in d3 and dot
2015-01-14 10:32:56 -08:00
Brian Tiger Chow
40e41d24f7 feat(fsrepo): protect with a repo lockfile
NB: daemon is one spot the repo lock is typically acquired
2015-01-14 03:02:23 -08:00
Juan Batiz-Benet
b8757d18ef diag/net: visualizing in d3 and dot
Try it out:

```
ipfs net diag --vis=d3 | diagnostics/d3/d3view
```

Notes: this is not the best way to do it, because it
breaks `--encoding=json`. Not sure what the best way is, and
right now this provides more utility than the other.
2015-01-13 23:49:35 -08:00
Juan Batiz-Benet
920ddc7fc3 Merge pull request #553 from jbenet/serial-file
Serial File Opening
2015-01-13 23:30:08 -08:00
Matt Bell
86bb8ca7a7 core/commands: Enabled stdin for various command arguments 2015-01-13 22:51:11 -08:00
Matt Bell
70adc21d08 core/commands: Enable stdin arguments for 'add' and 'cat', resolves #542 2015-01-13 22:51:10 -08:00
Matt Bell
7a579bbf79 commands: Moved files code into 'commands/files' subpackage 2015-01-13 22:50:53 -08:00
Juan Batiz-Benet
f068c89147 reprovide: move core's reprovider into online services 2015-01-13 22:12:37 -08:00
Jeromy
3269986e42 basic reprovider implementation
make vendor
2015-01-13 22:12:37 -08:00
Brian Tiger Chow
3eafb3e5ab style(repo): repo.Interface -> repo.Repo
The pkg.Interface style is modeled after heap.Interface. Generally, I
find it helpful for interfaces that have many implementations. It
provides clear distinction between the generic interface and the |n|
implementations that implement it (which may be interface types
themselves).

For clients who cannot keep the repo name, one can imagine that the most
likely rename is `ipfsrepo`. In that case, `ipfsrepo.Interface` remains
meaningful.

This is low-pri so it doesn't matter than much. But for the record, the
repo.Interface feels appropriate in this use-case.
2015-01-13 03:09:33 -08:00
Brian Tiger Chow
86258face6 refactor(config, repo): use repo.Interface to (Get|Set)ConfigKey 2015-01-13 03:09:32 -08:00
Brian Tiger Chow
1b700864f9 refactor(repo): all config writes must go through repo 2015-01-13 03:09:31 -08:00
Brian Tiger Chow
405afd2a02 refactor(config, repo): all writes go through FSRepo. next: privatize these 2015-01-13 03:09:31 -08:00
Brian Tiger Chow
e28a235f77 it's unclear what this test case is meant to protect, but passing an empty datastore value no longer has bearing on node construction. Datastore setup now occurs in repo. 2015-01-13 03:09:31 -08:00
Brian Tiger Chow
6e730f4c73 bad datastore type won't cause failure 2015-01-13 03:09:31 -08:00
Brian Tiger Chow
20e1610075 nil will no longer be a valid argument 2015-01-13 03:09:31 -08:00
Brian Tiger Chow
5b3164de5c refactor(repo/config) move config under repo 2015-01-13 03:09:30 -08:00
Juan Batiz-Benet
7aa4a83f2e addr: proper filter + subtract 2015-01-12 20:49:06 -08:00
Juan Batiz-Benet
ceadfbe791 core: some logging for addresses 2015-01-12 19:15:02 -08:00
Juan Batiz-Benet
0cb0f27b68 bootstrap: print error when failed 2015-01-12 19:15:02 -08:00
Juan Batiz-Benet
7ec1a674e3 p2p/net/swarm: do not usre link local addrs 2015-01-12 19:15:02 -08:00
Jeromy
a768e841bc update printout for net diag 2015-01-12 02:55:15 -08:00
Juan Batiz-Benet
7867e01c90 ipfs ping wording 2015-01-11 20:52:34 -08:00
Juan Batiz-Benet
f7941e9841 ping: use context 2015-01-11 20:52:34 -08:00
Juan Batiz-Benet
374a75b612 refs: tie the contexts together 2015-01-11 20:52:33 -08:00
Juan Batiz-Benet
92e8a7bcd5 updated datastore for proper query handling
Queries now can be cancelled and the resources collected
2015-01-11 20:52:33 -08:00
Juan Batiz-Benet
708e47fcbc ipfs blocks local command
ipfs blocks local returns _all_ local refs. For now this is one
long op. future commits will make it async.
2015-01-11 16:59:22 -08:00
Brian Tiger Chow
63c0d41614 fix(core): perform sophisticated boostrap operation 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
033e33dadf feat(core): expose IpfsNode.Resolve 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
223ee4df1a refactor(core): move Add, Cat to core/io 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
ddf14bee78 refactor(core): replace online bool with mode type 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
130532c532 rm errTODO 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
b0f7143250 refactor(core): distinguish repo.Repo components 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
9d438843bd refactor(core): distinguish Online services 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
ca8190a889 refactor(core): isolate complex DHT initialization 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
eb6c40d5dd refactor(core): isolate the complex initialization of PeerHost construction 2015-01-11 01:23:27 -08:00
Brian Tiger Chow
8e42e86d87 hack(core): instantiate peerstore at the end if it hasn't already been instantiated
this is a dirty hack
2015-01-11 01:23:26 -08:00
Brian Tiger Chow
707874c3a5 refactor(core): init node.Blocks in shared NewIPFSNode constructor 2015-01-11 01:23:26 -08:00
Brian Tiger Chow
34e8f3ee26 refactor(core): init DAG and its dependents in shared constructor
fix: remove merkledag import

may need to squash this commit into the merkledag move commit
2015-01-11 01:23:26 -08:00
Brian Tiger Chow
7fa5d81093 refactor(core): rename 2015-01-11 01:23:26 -08:00
Brian Tiger Chow
efb75ee5ba refactor: move add and cat to the core 2015-01-11 01:23:25 -08:00
Brian Tiger Chow
2c3fb43350 feat: expose IpfsNode.Bootstrap() method 2015-01-11 01:23:25 -08:00
Brian Tiger Chow
4c2eda2123 refactor: remove deprecated function 2015-01-11 01:23:25 -08:00
Brian Tiger Chow
57b3ffa533 feat: new core constructor + config options (Standard, Online, Offline) 2015-01-11 01:23:25 -08:00
Juan Batiz-Benet
456719ede7 Merge pull request #523 from jbenet/feat/ping
Implement ipfs ping
2015-01-10 08:11:03 -08:00
Juan Batiz-Benet
1bd69b19ac core: make sure to call swarm.FilterAddrs
also move network setup into its own self-contained func
2015-01-10 08:07:19 -08:00
Juan Batiz-Benet
538550f8f8 fix osx mounting version checks 2015-01-10 01:07:43 -08:00
Jeromy
0f4f91c2f3 restore ability to ping by ID alone 2015-01-10 08:31:17 +00:00
Jeromy
1561291d61 improve UI of ping 2015-01-10 07:27:49 +00:00
Jeromy
9fc0f86a3a cleanup from PR 2015-01-10 07:27:49 +00:00
Jeromy
50c8561bdd add peer info after FindPeer RPC
fix ping test
2015-01-10 07:27:49 +00:00
Jeromy
566a86f5d4 Address PR comments and add in more user feedback 2015-01-10 07:27:48 +00:00
Jeromy
0794d5b46a a little cleanup 2015-01-10 07:27:48 +00:00
Brian Tiger Chow
069966d55a ping WIP
License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>

Conflicts:
	core/commands/root.go

begin ping command, WIP

finish initial ping implementation
2015-01-10 07:27:45 +00:00
Juan Batiz-Benet
d1bff333a5 refs: log writer error 2015-01-07 13:49:13 -08:00
Juan Batiz-Benet
180b9b32d3 refs: added --format option 2015-01-07 13:42:06 -08:00
Juan Batiz-Benet
f46120b194 refs edges + stream fix 2015-01-07 12:56:14 -08:00
Juan Batiz-Benet
8307572777 ipfs block stat bugfix: cast 2015-01-07 06:26:34 -08:00
Juan Batiz-Benet
6b2795338f ipfs object has learned stat
'ipfs object stat' is a plumbing command to print DAG
node statistics. <key> is a base58 encoded multihash.
It outputs to stdout:

  NumLinks        int number of links in link table
  BlockSize       int size of the raw, encoded data
  LinksSize       int size of the links segment
  DataSize        int size of the data segment
  CumulativeSize  int cumulative size of object and references
2015-01-07 02:31:29 -08:00