Commit Graph

51 Commits

Author SHA1 Message Date
Juan Batiz-Benet
16690d4af2 race fix: pinner loads with a threadsafe datastore
All the datastores used by pinners and so on should be mutex
wrapped. One issue with changing all of them from
ds.Datastore -> ds.ThreadSafeDatastore is that we wrap the
incoming ds.ThreadSafeDatastore with other datastores, which
do not implement the interface. Re-wrapping again causes
double locking. (which may be ok..., but...) any ideas?
2015-01-14 16:15:38 -08:00
Juan Batiz-Benet
136ef70f00 calc_test for picking link block size 2015-01-10 01:22:45 -08:00
Jeromy
e3cf893616 implement recursive indirect blocks
improve efficiency of multilayered indirect blocks

clean up tests

panic cleanup

clean up logic, improve readability

add final root node to the dagservice upon creation

importer: simplified dag generation

test: updated hashes using latest code

@whyrusleeping this is why the sharness tests
were failing: the hashes are added manually to
make sure our generation doesn't change.

cleanup after CR

fix merkledag tests

fix small block generation (no subblocks!)
2015-01-06 19:43:56 +00:00
Brian Tiger Chow
8e0c8a7a7e refactor(mdag, bserv, bs) mocks, etc.
License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
2014-12-13 05:17:16 -08:00
Brian Tiger Chow
74eb03231d fix(core, peer) helpers to testutil, err handling
License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
2014-12-08 14:32:52 -08:00
Jeromy
d53deebada wire GetBlocks into blockservice 2014-12-05 20:53:26 +00:00
Juan Batiz-Benet
f6235c5cc6 importer: simplified splitter
The splitter is simplified using io.ReadFull, as this function
does exactly what we wanted.

I believe io.ErrUnexpectedEOF should be handled as an EOF here,
but please correct me if I'm wrong.
2014-11-25 06:12:35 -08:00
Juan Batiz-Benet
9ae420abb8 SizeSplitter fix: keep-reading until chunk full
if the underlying reader is buffered with a smaller buffer
it would force the chunk sizes to come out smaller than
intended.

cc @whyrusleeping @mappum
2014-11-18 06:13:07 -08:00
Brian Tiger Chow
ed4a8eb782 chore(tests) add Short() -> SkipNow() to slowest tests
vanilla:
    21.57 real        45.14 user         8.51 sys

short:
    14.40 real        31.13 user         5.56 sys

License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
2014-11-15 02:10:53 -08:00
Jeromy
4f083d54d6 write a few package doc strings to improve look of godoc 2014-11-08 21:42:36 -08:00
Jeromy
88bf39118c comment comment comment comment 2014-11-03 03:02:56 +00:00
Jeromy
027920540f more memory tweaks 2014-11-01 16:07:56 -07:00
Jeromy
317ca2f865 benchmark secure channel 2014-11-01 16:07:56 -07:00
Jeromy
e9779b1c7f address comments from PR 2014-10-31 05:57:47 +00:00
Jeromy
ae339a0320 remove dagwriter in favor of new importer function 2014-10-31 05:03:42 +00:00
Juan Batiz-Benet
37ce1863c0 test splitting is deterministic. (it is) 2014-10-30 02:49:42 -07:00
Jeromy
71ac117546 Address concerns in PR 2014-10-30 06:23:31 +00:00
Jeromy
18ada93ec3 rewrite add command to use dagwriter, moved a pinner into the dagwriter for inline pinning 2014-10-30 04:40:48 +00:00
Juan Batiz-Benet
184c25430b go-vet friendly codebase
- distinguish log.Error and log.Errorf functions
- Initialize structs with field names
- A bit of unreachable code (defers)
2014-10-25 03:46:39 -07:00
Jeromy
093c8fb04d Rework package structure for unixfs and subpackage
cc @jbenet
2014-10-08 21:14:18 +00:00
Jeromy
916fc54633 add more comments! 2014-10-08 16:51:53 +00:00
Juan Batiz-Benet
dc2dbdbb02 vendor things
cc @whyrusleeping
2014-10-08 04:17:52 -07:00
Jeromy
6e0cfb3273 removed error from return type of blocks.NewBlock() 2014-10-07 20:46:01 +00:00
Jeromy
98cde1578d integrate dagmodifier into ipns 2014-10-07 07:23:30 +00:00
Jeromy
5c802ae852 add more tests and rework a lot of utility structures 2014-10-07 05:55:28 +00:00
Jeromy
3591e10b2e implement dagmodifier and tests. 2014-10-06 23:49:45 +00:00
Jeromy
af1ce6ee50 Merge branch 'ipns' of github.com:jbenet/go-ipfs into ipns 2014-10-06 03:43:10 +00:00
Jeromy
5592030ed3 working on dag modification structures, factored out the data format into an importer subpackage and added more ipns tests 2014-10-06 03:42:59 +00:00
Jeromy
a13baff33d fixed data size reporting 2014-10-05 01:22:01 +00:00
Jeromy
11332fc73b make the tests pass! 2014-10-04 06:34:06 +00:00
Jeromy
dc66b699b0 fix writes zeroing files 2014-10-03 21:36:29 +00:00
Jeromy
6080944af9 writing files inside ipns works now! also implemented resolve cli command 2014-10-01 00:41:29 -07:00
Jeromy
006b68b558 WIP: getting closer to being able to write in ipns dirs 2014-10-01 00:41:29 -07:00
verokarhu
0beff4bb4a return the read bytes when EOF is reached 2014-09-30 22:59:56 +03:00
Jeromy
fdcd015eed move first data block into top level dag node 2014-09-15 05:35:31 +00:00
Jeromy
78454884db clean up code, make it have a nicer interface 2014-09-15 04:17:29 +00:00
Jeromy
1a7c083850 implement something like rabin fingerprinting 2014-09-15 02:04:55 +00:00
Siraj Ravel
94b8f1d22b build fixed 2014-09-12 09:30:47 -07:00
Siraj Ravel
02deb3cccb last golint 2014-09-11 13:00:56 -07:00
Jeromy
1fa7c07dc7 clean up merge of bren2010's crypto branch and merge into master 2014-09-08 18:17:57 +00:00
Jeromy
275b03f814 rework dagreader to have a dagservice for node resolution 2014-09-06 22:11:44 +00:00
Jeromy
dad9751754 implement a basic data format for data inside dag nodes 2014-09-05 20:47:55 +00:00
Jeromy
e6498b3733 fix issue with blocks not being trimmed properly and being too large to be sent over the network 2014-09-05 02:58:31 +00:00
Jeromy
eeab5f9bd9 fix issue with blocks not actually being stored via dagservice 2014-09-04 03:37:29 +00:00
Jeromy
9338caa9d8 working on making importer not break on large files 2014-08-31 10:10:34 -07:00
Jeromy
f4eb242a4e Merge branch 'bitswap' 2014-08-30 12:31:01 -07:00
Jeromy
1f309b72d0 implement basic rabin fingerprint file splitting 2014-08-30 10:53:26 -07:00
Jeromy
678db4fa40 more work on bitswap and other code cleanup 2014-08-25 09:44:42 -07:00
Juan Batiz-Benet
f718bd6a92 go lint
link errors left:
- protocol buffers output is not lint-friendly
2014-07-22 02:20:08 -07:00
Juan Batiz-Benet
5abf3c2ae9 added ls + recusrive directory adding 2014-07-05 18:19:38 -07:00