Commit Graph

94 Commits

Author SHA1 Message Date
Jeromy
bc79ae17a1 refactor importer package with trickle and balanced dag generation 2015-02-04 21:59:51 +00:00
Juan Batiz-Benet
58f39687cf logs: removed all log.Errors unhelpful to users
Let's save log.Error for things the user can take action on.
Moved all our diagnostics to log.Debug. We can ideally reduce them
even further.
2015-02-03 01:06:07 -08:00
Mildred Ki'Lya
d221d55d85 HTTP: add handlers to allow object creation and modification 2015-01-31 20:47:34 +01:00
Jeromy
e959626029 comment NodeGetter 2015-01-27 03:29:10 +00:00
Jeromy
ba4ea139b9 address concerns from PR 2015-01-27 01:33:09 +00:00
Jeromy
0023cb3097 refactor and clean up dagreader 2015-01-27 01:33:09 +00:00
Jeromy
26826bd55e implement seeking in the dagreader 2015-01-27 01:33:09 +00:00
Juan Batiz-Benet
16690d4af2 race fix: pinner loads with a threadsafe datastore
All the datastores used by pinners and so on should be mutex
wrapped. One issue with changing all of them from
ds.Datastore -> ds.ThreadSafeDatastore is that we wrap the
incoming ds.ThreadSafeDatastore with other datastores, which
do not implement the interface. Re-wrapping again causes
double locking. (which may be ok..., but...) any ideas?
2015-01-14 16:15:38 -08:00
Juan Batiz-Benet
bcce9ef088 merkledag traversal 2015-01-07 11:04:35 -08:00
Juan Batiz-Benet
6b2795338f ipfs object has learned stat
'ipfs object stat' is a plumbing command to print DAG
node statistics. <key> is a base58 encoded multihash.
It outputs to stdout:

  NumLinks        int number of links in link table
  BlockSize       int size of the raw, encoded data
  LinksSize       int size of the links segment
  DataSize        int size of the data segment
  CumulativeSize  int cumulative size of object and references
2015-01-07 02:31:29 -08:00
Juan Batiz-Benet
f63d45ca56 merkledag: split off node.go 2015-01-07 02:15:53 -08:00
Juan Batiz-Benet
13e79a05e5 merkledag: add NodeStat object 2015-01-07 02:13:44 -08:00
Juan Batiz-Benet
cd65ec614b merkledag: keep links sorted by name
May not be necessary to sort when adding each link--
doing so would be unnecessarily expensive O(n^2) when
constructing nodes -- though n wont be big.
2015-01-06 13:12:22 -08:00
Jeromy
e3cf893616 implement recursive indirect blocks
improve efficiency of multilayered indirect blocks

clean up tests

panic cleanup

clean up logic, improve readability

add final root node to the dagservice upon creation

importer: simplified dag generation

test: updated hashes using latest code

@whyrusleeping this is why the sharness tests
were failing: the hashes are added manually to
make sure our generation doesn't change.

cleanup after CR

fix merkledag tests

fix small block generation (no subblocks!)
2015-01-06 19:43:56 +00:00
Juan Batiz-Benet
bb8886f3af merkledag: LONG timeout on Get
we shouldn't use an arbitrary timeout here. since Get
doesnt take in a context yet, we give a large upper bound.
think of an http request. we want it to go on as long as
the client requests it.
2015-01-05 00:16:53 -08:00
Brian Tiger Chow
14990bb556 fix(merkledag/test) panic!
https://travis-ci.org/jbenet/go-ipfs/jobs/45000756

cc @whyrusleeping @jbenet

lol this is starting to happen pretty often
2014-12-24 09:31:18 -05:00
Brian Tiger Chow
b19a931d2f remote low SnR debug statement
cc @jbenet @whyrusleeping

License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
2014-12-23 08:56:07 -08:00
Jeromy
2240272d85 change Provide RPC to not wait for an ACK, improves performance of 'Add' operations 2014-12-17 23:44:41 -08:00
Jeromy
7b0a68031d cleanup from CR 2014-12-15 05:35:53 +00:00
Jeromy
d54c6eb46b fix FindLinks comment 2014-12-15 05:35:53 +00:00
Jeromy
70283151f2 some cleanup, use WaitGroup over channel ugliness 2014-12-15 05:35:53 +00:00
Jeromy
5b0be85b6b change FindLink to FindLinks
cc @maybebtc
2014-12-15 05:35:52 +00:00
Brian Tiger Chow
930e0cc728 Update merkledag.go 2014-12-15 05:35:52 +00:00
Brian Tiger Chow
9420200a4e fix(merkle) use defer 2014-12-15 05:35:52 +00:00
Brian Tiger Chow
e720a6a11c style(merkle): move var dec closer to use 2014-12-15 05:35:52 +00:00
Jeromy
79efd424d1 fix bug where a file containing duplicate blocks would fail to be read properly 2014-12-15 05:35:52 +00:00
Brian Tiger Chow
8e0c8a7a7e refactor(mdag, bserv, bs) mocks, etc.
License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
2014-12-13 05:17:16 -08:00
Jeromy
3a6b6c6974 cleanup, use a workgroup over channels 2014-12-05 20:53:32 +00:00
Jeromy
f0a4fdad59 some bitswap cleanup 2014-12-05 20:53:32 +00:00
Jeromy
d06343083e add a test in merkledag to exercise GetBlocks 2014-12-05 20:53:31 +00:00
Jeromy
4cc1780705 fix issues in merkledag 2014-12-05 20:53:31 +00:00
Jeromy
9120d107c3 a little more correctness on the new bitswap impl 2014-12-05 20:53:27 +00:00
Jeromy
15d4f82945 some cleanup, and fix minor bug in dagreader from previous commit 2014-12-05 20:53:26 +00:00
Jeromy
d53deebada wire GetBlocks into blockservice 2014-12-05 20:53:26 +00:00
Jeromy
0ce6071fea revamp BatchFetch a bit 2014-12-05 20:53:25 +00:00
Jeromy
b1b42a5609 change BatchFetch to return indices 2014-12-05 20:53:23 +00:00
Jeromy
99ae432021 start working getBlocks up the call chain 2014-12-05 20:53:23 +00:00
Brian Tiger Chow
cc92ec3d9c fix(merkledag) missing arg
License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
2014-12-05 20:53:22 +00:00
Jeromy
19da05701d remove buffer timing in bitswap in favor of manual batching 2014-12-05 20:53:21 +00:00
Jeromy
4f083d54d6 write a few package doc strings to improve look of godoc 2014-11-08 21:42:36 -08:00
Jeromy
c3d04570c0 a few more comments 2014-11-03 03:53:16 +00:00
Jeromy
b4b26faefd make FetchGraph waitable 2014-11-01 16:07:56 -07:00
Jeromy
3ed10b1331 dagservice interface fix 2014-11-01 16:07:56 -07:00
Jeromy
07733b17b3 msgio pooling first hack 2014-11-01 16:07:56 -07:00
Brian Tiger Chow
cea398b8a7 fix(all) log.Debug -> log.Debugf 2014-10-30 06:35:29 -07:00
Juan Batiz-Benet
70e1f9b6bc make vendor
cc @whyrusleeping
2014-10-30 05:43:14 -07:00
Brian Tiger Chow
9a9dc926b5 fix(merkledag) return static error 2014-10-28 16:10:17 -07:00
Brian Tiger Chow
0bfadea036 fix(namesys, merkledag) use static error 2014-10-28 15:40:26 -07:00
Brian Tiger Chow
04e270a91e refactor(merkledag) use one-off error 2014-10-28 15:27:00 -07:00
Emery Hemingway
056699cebe convert DAGService to an interface 2014-10-25 22:15:19 -04:00