Commit Graph

141 Commits

Author SHA1 Message Date
Jeromy
5457a85cef
Merge branch 'version/0.4.3-rc4'
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-20 19:10:10 -07:00
Jeromy Johnson
e10453b67b Merge pull request #3220 from ipfs/deps/extract-dht
routing: use extracted dht and routing code
2016-09-19 19:38:37 -07:00
Jeromy Johnson
87ecb92fce Merge pull request #3225 from ipfs/kevina/rm-block-refactor
"block rm": move core functionally into blockstore_util package
2016-09-19 19:30:46 -07:00
Jeromy
d0e0123426 Remove now unused code
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-19 18:28:00 -07:00
Kevin Atkinson
d04308240d "block rm": Document RemovedBlock. Interface tweaks.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-09-15 14:55:46 -04:00
Kevin Atkinson
6b2b976c57 "block rm": just return "error" in ProcRmOutput
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-09-15 04:15:59 -04:00
Kevin Atkinson
5901e57dfc "block rm": move core functionally into blockstore_util package
Note: this code can not go in the "blockstore" package due to a
circular dependency with the "pin" package.

License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-09-15 04:15:44 -04:00
Jakub Sztandera
c7d89662a1
metrics: do not run bloom fillrate collector when metrics are inactive
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-13 14:00:10 +02:00
Jakub Sztandera
a5899a4fb9
deps: update go-metrics-interface and -prometheus to 0.1.2
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-13 14:00:10 +02:00
Jakub Sztandera
5f0be2eaa9
blockstore: add Bloom fill ratio metric
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-13 14:00:10 +02:00
Jakub Sztandera
95dca1ecdf
blockstore: update bbloom
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-13 14:00:09 +02:00
Jakub Sztandera
d1237f1c90
blockstore: change order of newARCCachedBS parmaeters
so the context is first one

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-13 14:00:09 +02:00
Jakub Sztandera
66a031f17c
blockstore: move ARC cache below the bloom cache
ARC cache is influenced by requests and bloom isn't
This means that if bloom is able to remove some requests caching them in
ARC is pointless.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-13 14:00:09 +02:00
Jakub Sztandera
3251c29f15
metrics: add hit counter for ARC and bloom caches
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-13 14:00:09 +02:00
George Antoniadis
6859b8ccd8 Extract key and datastore
License: MIT
Signed-off-by: George Antoniadis <george@noodles.gr>
2016-09-09 15:52:25 +01:00
Jeromy Johnson
3babf40e74 Merge pull request #3187 from ipfs/feat/cidv0
Rework go-ipfs to use content IDs version 0
2016-09-09 10:14:39 -04:00
Jeromy Johnson
531b89abc9 Merge pull request #3143 from ipfs/feat/bs/rename-hashonread
blockstore: rename RuntimeHashing to HashOnRead
2016-09-08 09:30:03 -04:00
Jeromy
c8fe495934 integrate CIDv0
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-09-07 13:32:32 -07:00
Jakub Sztandera
27279cdefe
blockstore: change unit of bloom filter to byte from bits
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-06 20:20:19 +02:00
Jakub Sztandera
d080ff19dd
test: add test case for PutMany on bloom filter skipping add to bloom
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-06 09:56:23 +02:00
Jakub Sztandera
4c86d7a4f8
test: add test case for PutMany using cache to eliminate the call
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-06 09:56:23 +02:00
Jakub Sztandera
c4323c0bcf
blockstore: fix PutMany with cache logic
Thanks @whyrusleeping for noticing it.

Removed PutMany logic in bloom cache as it can't help with anything.
Fixed ARC cache to use filtered results instad of all blocks.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-09-06 09:56:23 +02:00
Jakub Sztandera
dfc58c791d
blockstore: rename RuntimeHashing to HashOnRead
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-29 21:53:40 +02:00
Jeromy
05b197df2d update deps for libp2p 3.4.0
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-08-25 19:02:55 -07:00
Jeromy Johnson
01ffc15283 Merge pull request #3086 from ipfs/feat/test-cover-blocks
test: 82% coverage on blocks
2016-08-18 16:45:18 -07:00
Jeromy Johnson
10048ceca9 Merge pull request #2962 from ipfs/kevina/block-rm
Add "ipfs block rm" command.
2016-08-18 13:27:26 -07:00
Jeromy Johnson
1a4361e71c Merge pull request #3074 from ipfs/feat/test-cover-blockstore
test: 81% coverage on blockstore
2016-08-18 11:02:42 -07:00
Jakub Sztandera
4ed8c3e5d9
test: fix typo in blockstore test
Also format imports

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-18 18:09:33 +02:00
Kevin Atkinson
bf7c5b3037 Fix bug in arccache.DeleteBlock() method.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-08-16 19:26:17 -04:00
Jakub Sztandera
7febd606d4
test: fixup style and add more checks to blockstore tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 18:59:36 +02:00
Jeromy Johnson
8c237ce5d2 Merge pull request #3084 from ipfs/feat/test-cover-blocks-set
test: 100% coverage on blocks/set
2016-08-16 09:31:24 -07:00
Jakub Sztandera
594c946606
docs: decapitalize error message in blocks.go
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 17:36:18 +02:00
Jakub Sztandera
21cbb90960
test: 100% coverage for blocks/blocksutil
This was easy.

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 13:03:20 +02:00
Jakub Sztandera
a63b5c38b7
test: make the test bit cleaner
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 12:53:27 +02:00
Jakub Sztandera
2408f866c5
blocks: rename errWrongHash to ErrWrongHash
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-16 12:42:18 +02:00
Jakub Sztandera
68d5197265
test: do explicit error check
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@ipfs.io>
2016-08-15 17:23:44 +02:00
Jakub Sztandera
233a622ed0
test: 81% coverage on blockstore
Coverage report available at: https://ipfs.io/ipfs/QmTuMtwGCfHrbYyZdQ1RaGNwS2MGsmAkjA8AaB69N7Ya1g/coverage.html#file0

Part of #3053

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@ipfs.io>
2016-08-15 16:21:52 +02:00
Jakub Sztandera
fcdf52735e test: 82% coverage on blocks
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-15 12:47:50 +02:00
Jakub Sztandera
9437b3af61 test: 100% coverage on blocks/set
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-15 12:03:43 +02:00
Jakub Sztandera
61b481628a blockstore: cleanup the style removing some mess from the refactor
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-03 13:54:37 +02:00
Jakub Sztandera
9543ed6ca1 blockstore: cleanup style a bit
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-02 15:03:27 +01:00
Jakub Sztandera
4183902e46 blockstore: extract ARC cache from Bloom cache
it removes race condition that would happen during various calls

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-08-02 01:10:48 +01:00
Jeromy
e8addf5ee3 use batching datastore for providers storage
License: MIT
Signed-off-by: Jeromy <why@ipfs.io>
2016-07-26 10:48:25 -07:00
Jeromy Johnson
4e67003f5a Merge pull request #2953 from ipfs/feature/blocks-bloom-no-rebuild
core: do not run bloom in case of ephemeral node
2016-07-10 13:34:44 -07:00
Kevin Atkinson
9e6cc1f112 Increase channel buffer size in blockstore.AllKeysChan().
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2016-07-10 15:41:58 -04:00
Jakub Sztandera
58526b25b5 blocks/blockstore: shift insertion of TODO context to tests
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-10 15:16:42 +02:00
Jakub Sztandera
af7778213c block/blockstore: bloomcache PutMany logic was not adding to ARC
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-08 21:17:32 +02:00
Jakub Sztandera
61a3d127e7 blocks/blockstore: improve logic a bit
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-08 21:17:32 +02:00
Jakub Sztandera
016d3d97ef blocks/blockstore: introduce context passing to blockstore
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-08 21:17:32 +02:00
Jakub Sztandera
3035aa8935 blocks/blockstore: add CacheOpts - structure of cache config
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2016-07-08 20:53:11 +02:00