Commit Graph

121 Commits

Author SHA1 Message Date
Jakub Sztandera
d080ff19dd
test: add test case for PutMany on bloom filter skipping add to bloom
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-06 09:56:23 +02:00
Jakub Sztandera
4c86d7a4f8
test: add test case for PutMany using cache to eliminate the call
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-06 09:56:23 +02:00
Jakub Sztandera
c4323c0bcf
blockstore: fix PutMany with cache logic
Thanks @whyrusleeping for noticing it.

Removed PutMany logic in bloom cache as it can't help with anything.
Fixed ARC cache to use filtered results instad of all blocks.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-06 09:56:23 +02:00
Jeromy
05b197df2d update deps for libp2p 3.4.0
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-08-25 19:02:55 -07:00
Jeromy Johnson
01ffc15283 Merge pull request #3086 from ipfs/feat/test-cover-blocks
test: 82% coverage on blocks
2016-08-18 16:45:18 -07:00
Jeromy Johnson
10048ceca9 Merge pull request #2962 from ipfs/kevina/block-rm
Add "ipfs block rm" command.
2016-08-18 13:27:26 -07:00
Jeromy Johnson
1a4361e71c Merge pull request #3074 from ipfs/feat/test-cover-blockstore
test: 81% coverage on blockstore
2016-08-18 11:02:42 -07:00
Jakub Sztandera
4ed8c3e5d9
test: fix typo in blockstore test
Also format imports

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-18 18:09:33 +02:00
Kevin Atkinson
bf7c5b3037 Fix bug in arccache.DeleteBlock() method.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-16 19:26:17 -04:00
Jakub Sztandera
7febd606d4
test: fixup style and add more checks to blockstore tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 18:59:36 +02:00
Jeromy Johnson
8c237ce5d2 Merge pull request #3084 from ipfs/feat/test-cover-blocks-set
test: 100% coverage on blocks/set
2016-08-16 09:31:24 -07:00
Jakub Sztandera
594c946606
docs: decapitalize error message in blocks.go
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 17:36:18 +02:00
Jakub Sztandera
21cbb90960
test: 100% coverage for blocks/blocksutil
This was easy.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 13:03:20 +02:00
Jakub Sztandera
a63b5c38b7
test: make the test bit cleaner
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 12:53:27 +02:00
Jakub Sztandera
2408f866c5
blocks: rename errWrongHash to ErrWrongHash
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 12:42:18 +02:00
Jakub Sztandera
68d5197265
test: do explicit error check
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@ipfs.io>
2016-08-15 17:23:44 +02:00
Jakub Sztandera
233a622ed0
test: 81% coverage on blockstore
Coverage report available at: https://ipfs.io/ipfs/QmTuMtwGCfHrbYyZdQ1RaGNwS2MGsmAkjA8AaB69N7Ya1g/coverage.html#file0

Part of #3053

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@ipfs.io>
2016-08-15 16:21:52 +02:00
Jakub Sztandera
fcdf52735e test: 82% coverage on blocks
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-15 12:47:50 +02:00
Jakub Sztandera
9437b3af61 test: 100% coverage on blocks/set
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-15 12:03:43 +02:00
Jakub Sztandera
61b481628a blockstore: cleanup the style removing some mess from the refactor
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-03 13:54:37 +02:00
Jakub Sztandera
9543ed6ca1 blockstore: cleanup style a bit
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-02 15:03:27 +01:00
Jakub Sztandera
4183902e46 blockstore: extract ARC cache from Bloom cache
it removes race condition that would happen during various calls

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-02 01:10:48 +01:00
Jeromy
e8addf5ee3 use batching datastore for providers storage
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-07-26 10:48:25 -07:00
Jeromy Johnson
4e67003f5a Merge pull request #2953 from ipfs/feature/blocks-bloom-no-rebuild
core: do not run bloom in case of ephemeral node
2016-07-10 13:34:44 -07:00
Kevin Atkinson
9e6cc1f112 Increase channel buffer size in blockstore.AllKeysChan().
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-07-10 15:41:58 -04:00
Jakub Sztandera
58526b25b5 blocks/blockstore: shift insertion of TODO context to tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-10 15:16:42 +02:00
Jakub Sztandera
af7778213c block/blockstore: bloomcache PutMany logic was not adding to ARC
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-08 21:17:32 +02:00
Jakub Sztandera
61a3d127e7 blocks/blockstore: improve logic a bit
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-08 21:17:32 +02:00
Jakub Sztandera
016d3d97ef blocks/blockstore: introduce context passing to blockstore
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-08 21:17:32 +02:00
Jakub Sztandera
3035aa8935 blocks/blockstore: add CacheOpts - structure of cache config
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-08 20:53:11 +02:00
Jakub Sztandera
f13506c11a blocks/blockstore: style cleanup of bloomcache
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-04 20:34:46 +02:00
Jakub Sztandera
e92e6662a7 test: fix races in bloomcache tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-04 20:34:07 +02:00
Jakub Sztandera
98f877af81 blocks/blockstorage: use automic for bloom.active
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-04 20:12:13 +02:00
Jakub Sztandera
5d83d89f36 blocks/blockstore: Add bloom filter
Replace write_cache with bloom_cache
Improve ARC caching
Fix small issue in case of AllKeysChan fails
deps: Update go-datastore
blocks/blockstore: Invalidate ARC cache before deletin block
deps: Update go-datastore

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-03 22:16:28 +02:00
Jeromy
0aafa6db8c update go-datastore changes 0.1.2
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-07-01 22:40:57 -07:00
Jeromy
0782c4dc03 encode keys to datastore with base32 standard encoding
Fixes #2601

Also bump version to 0.4.3-dev

License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-07-01 14:15:06 -07:00
Jakub Sztandera
f2686965ac tests: Add test to RuntimeHashing option of blockstore
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-06-24 22:21:01 +02:00
Jakub Sztandera
989e91b1c4 blockstore: add fetch rehashing
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-06-24 22:20:58 +02:00
Jakub Sztandera
ce8c8a7a71 Update go-log in whole dependency tree (#2898)
* Update golog in go-ipfs

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Update go-libp2p for go-log

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Update go-libp2p-secio for go-log

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Update go-libp2p-crypto for go-log

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Update go-libp2p-peer for go-log

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Import peersore, it wasn't imported

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Update peerstore

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Update peer

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Update secio

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>

* Update go-libp2p

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-06-24 09:38:07 -07:00
Jakub Sztandera
5a08e9e08a Remove failing blockstore test with context
Why is it failing:
process is started, cancel() is called,
between we satart listening to the channels
in select statemnet there is race of three things
that can happent:
 1. Task can complete
 2. Task can start closing <- expected
 3. Task already closed

This race causes failures of the test.

It is basing heavily on race of conditions where
the task not closing, nor the task is completed
before channels are being listened.

It is quite impossible to resolve without
adding bunch of timings in there, which we
want to avoid, as there is no atomic
"send message on channel and select" in Golang

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-06-15 21:06:34 +02:00
Jakub Sztandera
a14bd71749 Move golang-lru to gx
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-06-12 10:02:44 +02:00
Jakub Sztandera
cafd81c8c6 Import go-datastore to gx
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-06-12 08:47:15 +02:00
Jakub Sztandera
6217e1f141 Remove go-datastore from Godeps
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-06-12 08:23:43 +02:00
Jakub Sztandera
eaccd07505 Update go-log
https://github.com/ipfs/go-log/pull/3

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-06-09 23:37:09 +02:00
Kevin Atkinson
dbabcf9681 Rename blocks.RawBlock to blocks.BasicBlock.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-06-01 17:14:16 -04:00
Jakub Sztandera
e86bf92f31 Migrate hamming to gx from Godeps
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-05-19 06:45:19 +02:00
jbenet
0ddafe603a add error checking for nil keys
Checks in:
- blockstore
- blockservice
- dagservice
- bitswap

Do not anger the pokemans #2715

License: MIT
Signed-off-by: Juan Benet <juan@benet.ai>
2016-05-16 23:03:28 -07:00
Kevin Atkinson
b84cbec2b6 Make blocks.Block an interface.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-05-05 18:02:11 -04:00
Hector Sanjuan
57b494a70c Update go-log to 1.1.0 and fix calls to go-log.Uuid
License: MIT
Signed-off-by: Hector Sanjuan <code@hector.link>
2016-05-04 23:17:21 +02:00
Jeromy
e79e1d31e9 remove a ton of unused godeps
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2016-04-13 11:23:10 -07:00