coosld/kubo
1
0
Fork 0
mirror of https://github.com/ipfs/kubo.git synced 2026-02-27 05:17:49 +08:00
Code Issues Actions 13 Packages Projects Releases Wiki Activity
11,097 Commits 160 Branches 213 Tags 122 MiB
10194de133
Commit Graph

221 Commits

Author SHA1 Message Date
Jeromy Johnson
b0a613fd71 Merge pull request #1892 from MichaelMure/blockstore_log 
Add log events when blocks are added/removed to/from the blockstore
 2016-04-12 18:59:20 -07:00
Michael Muré
c88e46cb52 clean deprecated Key.Pretty() 
License: MIT
Signed-off-by: Michael Muré <batolettre@gmail.com>
 2016-03-25 12:05:45 +01:00
Jeromy
d7dab3afea Use gx vendored go-ipfs-utils where possible 
For the rest of the packages in util, move them to thirdparty
and update the references. util is gone!

License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-02-12 17:21:40 -08:00
Jeromy
5474e15e93 blockstore locks return unlocker object now 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-02-08 14:42:07 -08:00
Michael Muré
e86c82c68d Add log events when blocks are added/removed from the blockstore 
License: MIT
Signed-off-by: Michael Muré <mure.michael@gmail.com>
 2016-01-31 19:31:39 +01:00
Jeromy
0e8a6700f9 correct go-log dep 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-01-30 09:34:10 -08:00
Jeromy
0e312f5caf initial vendoring of libp2p outside of the repo with gx 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-01-30 09:34:06 -08:00
Jeromy
4d5af93f43 vendor in new go-datastore 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-01-12 08:22:55 -08:00
Jeromy
c49dcffce2 Allow for gc during adds 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-01-12 08:22:55 -08:00
Jeromy
c6ee2058d9 comments from CR 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-01-12 08:22:55 -08:00
Jeromy
45d4b1a8bc fixup datastore interfaces 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-01-12 08:22:55 -08:00
Tommi Virtanen
b76581d6c7 fsrepo: Refactor to extract datastore internals 
License: MIT
Signed-off-by: Tommi Virtanen <tv@eagain.net>
 2016-01-12 08:22:55 -08:00
Juan Batiz-Benet
27f34b4311 renamed {R,}Lock -> {Pin,GC}Lock 
License: MIT
Signed-off-by: Juan Batiz-Benet <juan@benet.ai>
 2016-01-12 08:21:13 -08:00
Jeromy
da0d48e6c5 Add locking interface to blockstore 
The addition of a locking interface to the blockstore allows us to
perform atomic operations on the underlying datastore without having to
worry about different operations happening in the background, such as
garbage collection.

License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-01-12 08:21:13 -08:00
Tommi Virtanen
c4d2988c11 blocks/set: Remove now-unused NewDBWrapperSet 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2016-01-12 08:17:17 -08:00
Jeromy
94bdce63a7 vendor logging lib update 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2015-11-05 15:57:21 -08:00
Jeromy
c023d187b5 update code to use new logging changes 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2015-10-27 11:04:56 -07:00
Jeromy
8f0623255d replace imports with absolute path instead of using symlink 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2015-10-03 14:30:50 -07:00
Jeromy
35a5ca0ef5 update go-datastore to latest 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2015-09-15 17:15:29 -07:00
Jeromy
e5a2896c0e extract logging 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2015-09-14 17:35:50 -07:00
Jeromy
137c0ac4ac use batching transaction interface from datastore 
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
 2015-07-09 16:37:30 -07:00
Jeromy
ef294431d4 move util.Key into its own package under blocks 2015-06-01 16:10:08 -07:00
Tommi Virtanen
a743290316 blocks: Don't re-Put blocks we already have 
Commit 1192be196b tried to do this, but
had a simple mistake. Functions returning `bool, error` pretty much
never return `true, anError`, so that branch was never taken.

Also fix the partial sentence in the
 2015-04-28 16:05:52 -07:00
Tommi Virtanen
24daeec70c Use flatfs to store objects under /blocks outside of LevelDB 
WARNING: No migration performed! That needs to come in a separate
commit, perhaps amended into this one.

Migration must move keyspace "/b" from leveldb to the flatfs subdir,
while removing the "b" prefix (keys should start with just "/").
 2015-04-20 02:24:23 -07:00
Kristoffer Ström
2c3f9f2419 Add hamming distance calculation to bloom filters 2015-04-15 17:13:47 +02:00
Kristoffer Ström
3d8e96a22e Make bloom filters simpler 
These did not work before, and had some unnecessary complexity.

Now the filters use only one hashing function, no bignum arithmetic, and gets the additional bit positions by repeatedly hashing the result of prior hash.

Since we're not concerned about crypto hashing here, this should be a win.

External interfaces unchanged.
 2015-04-07 18:03:15 +02:00
Ho-Sheng Hsiao
bf22aeec0a Reorged imports from jbenet/go-ipfs to ipfs/go-ipfs 
- Modified Godeps/Godeps.json by hand
- [TEST] Updated welcome docs hash to sharness
- [TEST] Updated contact doc
- [TEST] disabled breaking test (t0080-repo refs local)
 2015-03-31 12:52:25 -07:00
Tommi Virtanen
63c25285b2 Dead code cleanup: remove AllKeys from blockstore 
Nothing uses it.
 2015-03-11 21:46:57 -07:00
Tommi Virtanen
1a48e6a91f Dead code cleanup: remove Range support from blockstore 
Nothing uses it, and offset+limit is a bad query mechanism for
mutating data.
 2015-03-11 21:46:57 -07:00
Henry
92d08db7a5 rewrote import paths of go.net/context to use golang.org/x/context 
- updated go-ctxgroup and goprocess
ctxgroup: AddChildGroup was changed to AddChild. Used in two files:
- p2p/net/mock/mock_net.go
- routing/dht/dht.go

- updated context from hg repo to git
prev. commit in hg was ad01a6fcc8a19d3a4478c836895ffe883bd2ceab. (context: make parentCancelCtx iterative)
represents commit 84f8955a887232b6308d79c68b8db44f64df455c in git repo

- updated context to master (b6fdb7d8a4ccefede406f8fe0f017fb58265054c)

Aaron Jacobs (2):
net/context: Don't accept a context in the DoSomethingSlow example.
context: Be clear that users must cancel the result of WithCancel.

Andrew Gerrand (1):
go.net: use golang.org/x/... import paths

Bryan C. Mills (1):
net/context: Don't leak goroutines in Done example.

Damien Neil (1):
context: fix removal of cancelled timer contexts from parent

David Symonds (2):
context: Fix WithValue example code.
net: add import comments.

Sameer Ajmani (1):
context: fix TestAllocs to account for ints in interfaces
 2015-02-25 11:58:19 +01:00
Jeromy
d7eb57f48f add worker to bitswap for reproviding new blocks 2015-02-19 20:07:02 -08:00
Juan Batiz-Benet
58f39687cf logs: removed all log.Errors unhelpful to users 
Let's save log.Error for things the user can take action on.
Moved all our diagnostics to log.Debug. We can ideally reduce them
even further.
 2015-02-03 01:06:07 -08:00
Brian Tiger Chow
be41444a9e provide simple wrapper methods for AllKeysRange 
@jbenet @whyrusleeping

was the 1<<16 intentional? replaced the raw methods with wrappers.
 2015-01-24 01:32:28 -08:00
Juan Batiz-Benet
0b9bef1ea9 blockstore: fixed data race 2015-01-20 09:28:14 -08:00
Brian Tiger Chow
884143bf9c move generic packages to thirdparty (see thirdparty/README.md) 2015-01-18 14:04:45 -08:00
Juan Batiz-Benet
6a8414bcfb blockstore Allkeys: ignore non multihash keys 2015-01-11 21:19:47 -08:00
Juan Batiz-Benet
0d059a3881 change block datastore prefix to "/b" 
the prefix should be as short as possible, as this is a
per-block overhead.
 2015-01-11 20:52:34 -08:00
Juan Batiz-Benet
374a75b612 refs: tie the contexts together 2015-01-11 20:52:33 -08:00
Juan Batiz-Benet
92e8a7bcd5 updated datastore for proper query handling 
Queries now can be cancelled and the resources collected
 2015-01-11 20:52:33 -08:00
Juan Batiz-Benet
da976a5f21 blocks: AllKeys + tests 2015-01-11 16:59:22 -08:00
Juan Batiz-Benet
f9ca67ef04 updated datastore (Query) 2015-01-11 16:59:22 -08:00
Jeromy
50aa37fec4 blockstore.ErrNotFound, and proper wantlist sorting 2014-12-17 23:44:40 -08:00
Brian Tiger Chow
866ef7287b misc(blockstore) comment 
License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
 2014-12-13 05:17:16 -08:00
Brian Tiger Chow
d77c4bb5e0 refactor(peer): create peer through peerstore 
for safety!

use mockpeer.WithID methods to create peers in tests

License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
 2014-12-08 02:10:42 -08:00
Juan Batiz-Benet
1192be196b blockstore: Put checks Has first. 2014-12-06 16:22:11 -08:00
Brian Tiger Chow
c40fe2af17 feat(blockstore) write cache 
vendors hashicorp/golang-lru dependency. (Mozilla Public License, version 2.0)

License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
 2014-12-05 23:31:01 -08:00
Brian Tiger Chow
7a3819a528 refactor(util) move block generator 
@whyrusleeping @jbenet

Putting the block generator in a util dir until blocks.

Can't put it in util/testutil because the util/testutil/dag-generator
imports blockservice and blockservice uses the generator.

Tough problem. This'll do for now.

License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
 2014-12-05 20:53:31 +00:00
Brian Tiger Chow
d0304def6b refactor(blockstore, blockservice) use Blockstore and offline.Exchange 
License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
 2014-12-05 20:53:24 +00:00
Brian Tiger Chow
918c8e274e refactor(blockstore) mv under blocks/ 
@jbenet @whyrusleeping

the pyramids were built one brick at a time

addresses: https://github.com/jbenet/go-ipfs/issues/370

License: MIT
Signed-off-by: Brian Tiger Chow <brian@perfmode.com>
 2014-12-05 20:53:23 +00:00
Jeromy
4f083d54d6 write a few package doc strings to improve look of godoc 2014-11-08 21:42:36 -08:00
Jeromy
c3d04570c0 a few more comments 2014-11-03 03:53:16 +00:00
Jeromy
950957240a address comments from PR 2014-11-01 16:07:56 -07:00
Jeromy
d92db12460 lots of logging 2014-10-26 00:45:40 +00:00
Juan Batiz-Benet
184c25430b go-vet friendly codebase 
- distinguish log.Error and log.Errorf functions
- Initialize structs with field names
- A bit of unreachable code (defers)
 2014-10-25 03:46:39 -07:00
Juan Batiz-Benet
4b01ad0b7c fixed pin json marshal 2014-10-22 02:55:22 -07:00
Jeromy
edb5a14f79 update datastore paths 2014-10-22 00:33:14 -07:00
Jeromy
6458ddcd32 flesh out pinning object, needs tests and cli wiring still 2014-10-22 00:28:41 -07:00
Jeromy
4d63820bbe move indirect pinning to its own structure 2014-10-22 00:26:11 -07:00
Jeromy
51879e9640 implement unpin and add a datastore backed blockset 2014-10-22 00:26:11 -07:00
Jeromy
7cbfbbc0ad add blockset and bloomfilter and beginnings of pinning service 2014-10-22 00:26:11 -07:00
Jeromy
6e0cfb3273 removed error from return type of blocks.NewBlock() 2014-10-07 20:46:01 +00:00
Juan Batiz-Benet
f3ae0e8e1b u.Hash - error 
the u.Hash error can be safely ignored (panic) because multihash
only fails from the selection of hash function. If the fn + length
are valid, it won't error.

cc @whyrusleeping
 2014-10-06 02:26:52 -07:00
Jeromy
782976f473 add basic test for blocks package #59 (actually add file) 2014-09-15 06:08:49 +00:00
Jeromy
8a21af092a add basic test for blocks package #59 2014-09-15 06:07:03 +00:00
Brian Tiger Chow
7968b45e58 vendor dependencies with godep 
dependencies are vendored into Godeps/_workspace and commit versions are
recorded in Godeps.json

update datastore to e89f0511
update go.crypto
 2014-09-09 22:39:42 -07:00
Jeromy
678db4fa40 more work on bitswap and other code cleanup 2014-08-25 09:44:42 -07:00
Jeromy
91e4675cbf basic implementation of bitswap, needs testing/verification that it works 2014-08-24 18:13:05 -07:00
Juan Batiz-Benet
f718bd6a92 go lint 
link errors left:
- protocol buffers output is not lint-friendly
 2014-07-22 02:20:08 -07:00
Juan Batiz-Benet
015398846f block get returned. 2014-07-05 15:38:17 -07:00
Juan Batiz-Benet
a5241b767b block service 2014-07-05 15:32:08 -07:00
Juan Batiz-Benet
3b570d3f82 skeleton. 2014-06-26 01:14:26 -07:00