Commit Graph

47 Commits

Author SHA1 Message Date
Steven Allen
a10a14fc06 feat(peerlog): add a bit of backoff logic 2020-04-27 20:26:39 -07:00
Steven Allen
bdbb79d30f fix: non-blocking peerlog logging
Avoid ever blocking new connections in the peer logger. Instead:

1. Send all new peers to a highly buffered channel.
2. Emit "dropped event" errors whenever we detect that we're dropping events and falling behind.
3. Don't log protocols, they're too large.
4. Don't log disconnects, we don't need them.
2020-04-27 19:15:25 -07:00
Dimitris Apostolou
1e437c7e97
Fix typos and cleanup 2020-04-20 22:00:01 +03:00
Steven Allen
255fefb2aa feat(peerlog): log protocols/versions 2020-03-10 09:33:11 -07:00
Oli Evans
aa3ca14197
feat: pass IPFS_PLUGINS to docker build
- allow IPFS_PLUGINS build-arg to be passed to docker build command
- remove annoying logging from peerlog plugin that appears multiple times in docker logs

usage:

  docker build --build-arg IPFS_PLUGINS="foo bar baz"

License: MIT
Signed-off-by: Oli Evans <oli@tableflip.io>
2020-02-13 14:39:58 +00:00
Steven Allen
15085fd1a3 fix(plugin): check log error 2020-02-10 13:09:00 -08:00
Oli Evans
edfe9c5efd
feat: add peerlog plugin
adds a plugin to log just peerIDs for nodes we connect to, to allow us to see how many unique peers a node connects to over time.

It's set up a preloaded plugin, so it would be enabled by default. We may want to extract it to a seperate repo so we can make it an optional add on.

**Usage**

```console
$ GOLOG_FILE=~/peer.log IPFS_LOGGING_FMT=json ipfs daemon
```

**output**

```json
{"level":"info","ts":"2020-02-10T13:54:26.639Z","logger":"plugin/peerlog","caller":"peerlog/peerlog.go:51","msg":"connected","peer":"QmS2H72gdrekXJggGdE9SunXPntBqdkJdkXQJjuxcH8Cbt"}
{"level":"info","ts":"2020-02-10T13:54:59.095Z","logger":"plugin/peerlog","caller":"peerlog/peerlog.go:56","msg":"disconnected","peer":"QmS2H72gdrekXJggGdE9SunXPntBqdkJdkXQJjuxcH8Cbt"}
```

License: MIT
Signed-off-by: Oli Evans <oli@tableflip.io>
2020-02-10 14:05:16 +00:00
Oli Evans
d83e07ea90
wip: minimal plugin works
License: MIT
Signed-off-by: Oli Evans <oli@tableflip.io>
2020-02-10 11:29:51 +00:00
Steven Allen
4e4d5aa742 fix(badgerds): turn off sync writes by default
We already do this in the datastore _profile_, but we should do this in the
plugin as well. I'm pretty sure this makes absolutely no difference.
2020-01-09 09:55:39 +01:00
Steven Allen
150b6dd1bd plugins: add support for plugin configs
For now, configs specified in `daemon --init-config` and `init CONFIG` are not
available. We should fix this eventually but isn't necessary for now (and
supporting this will be annoying).
2019-08-29 17:17:23 -07:00
Steven Allen
2b84b2ba13 chore: fix linter nits and tests that don't compile 2019-05-21 11:09:57 -07:00
Jakub Sztandera
42e191c017 gx: unrewrite
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-03-05 18:33:56 +01:00
Steven Allen
3fa1bfe1bc gx: update cmds and flatfs
fixes #6028, fixes crash when writing after closing on flatfs.

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2019-03-01 12:17:49 -08:00
Steven Allen
fea7ae727f gx: update go-cid
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2019-02-20 20:29:06 -08:00
Steven Allen
2f17b951c2 gx: update deps
* Updates go-ipfs-cmds to try to get the tests to pass on travis.
* While we're at it, fix duplicate gx deps.

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2019-02-19 13:12:21 -08:00
Jakub Sztandera
28cf3de0f9 Update protobuf
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2019-02-18 20:46:22 +01:00
Łukasz Magiera
53e55e3314 gx: update go-unixfs to 1.2.14 and go-bitswap to 1.1.21
(and everything else...)

License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2019-01-23 11:01:38 -08:00
Steven Allen
0c14f866f1 gx: update pubsub, connmgr, and flatfs
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-12-18 21:44:28 -08:00
Steven Allen
fffa3ec9d7
Merge pull request #5625 from schomatis/feat/badger/add-truncate-option
badger: add truncate flag
2018-11-27 20:40:22 -08:00
Lucas Molas
200df850cc badger: add truncate flag
License: MIT
Signed-off-by: Lucas Molas <schomatis@gmail.com>
2018-11-27 22:08:02 -03:00
hannahhoward
0963c9cdcb Update go-ipfs-delay and assoc deps
License: MIT
Signed-off-by: hannahhoward <hannah@hannahhoward.net>
2018-11-15 18:53:45 -08:00
Łukasz Magiera
c154f7f01e Move datastores to plugins
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-11-05 15:40:23 +01:00
Steven Allen
0d80fc54c3 gx: update go-log and sha256
fixes #5709

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-11-02 21:17:20 -07:00
Hector Sanjuan
ef7234d269 Bubble deps
License: MIT
Signed-off-by: Hector Sanjuan <hector@protocol.ai>
2018-10-29 18:49:37 +01:00
Kevin Atkinson
d3174f4bd9 gx update and fix code to use new Cid type
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-09-11 22:21:04 -04:00
Steven Allen
656d7cc1a6 gx: update go-cid, go-libp2p-peer, go-ipfs-cmds, go-ipfs-cmdkit
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-08-21 17:39:56 -07:00
Steven Allen
2450ddde81 gx: update go-cid
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-08-15 08:30:22 -07:00
Kevin Atkinson
075ecb09d0 Gx updates and fixes to use new cid.Builder interface.
License: MIT
Signed-off-by: Kevin Atkinson <k@kevina.org>
2018-08-12 19:15:07 -04:00
Steven Allen
9a9979b193 update go-cid
alternative to #5243 that updates go-cid and all packages that depend on it

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-07-16 15:16:49 -07:00
Steven Allen
85acad9a01 gx update go-log, sys, go-crypto
* go-log
* sys
* go-crypto

License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-06-08 22:36:24 -07:00
Łukasz Magiera
115f63a657 gx: update go-ipld-git to fix mergetag resolving
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2018-04-30 02:31:41 +02:00
Steven Allen
fe8846fcd7 gx: mass update
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2018-01-24 15:58:44 -08:00
Steven Allen
dfe7ef4fcf gx: update go-multihash
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2017-12-14 13:09:51 -08:00
Jeromy
c956ff2492 small typo in git plugin
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-11-05 06:50:46 -08:00
Łukasz Magiera
e8f05e7334 Fix freebsd build issues
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2017-10-03 23:46:44 +02:00
Steven Allen
70d6629940 gx: update go-cid, go-multibase, base32
License: MIT
Signed-off-by: Steven Allen <steven@stebalien.com>
2017-09-01 17:46:49 -07:00
Łukasz Magiera
00590fd293 mk: option to pass custom go executable
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2017-08-22 20:04:08 +02:00
Łukasz Magiera
7f208ce043 dag: fix git plugin
License: MIT
Signed-off-by: Łukasz Magiera <magik6k@gmail.com>
2017-08-12 21:49:07 +02:00
Jakub Sztandera
c59fdccd9f
plugins: generate dummy main function for plugins to fix go#20312
https://github.com/golang/go/issues/20312

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-07-26 17:09:27 +02:00
Jakub Sztandera
1cc387976b
make: add generated plugin-main shims to CLEAN
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-07-26 17:07:54 +02:00
Jakub Sztandera
b135a1fa86
misc: add go fmt to main packages of plugins
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-07-13 22:05:31 +02:00
Jakub Sztandera
314d2c3113
misc: make codecov really happy
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-07-13 21:59:01 +02:00
Jakub Sztandera
c569b0be8a
plugin: make the plugin preload work again
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-07-13 21:16:04 +02:00
Jakub Sztandera
42b0ba345f
fixup plugin loading
they have to be a main package

License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-07-13 08:42:21 +02:00
Jakub Sztandera
cfad460827
git: make gitPlugin struct private
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-07-12 23:03:15 +02:00
Jakub Sztandera
04b26fe089
make: fix buildmode=plugin and pkgdir problems
License: MIT
Signed-off-by: Jakub Sztandera <kubuxu@protonmail.ch>
2017-07-12 23:01:45 +02:00
Jeromy
7203c43b60
plugin: create plugin API and loader, add ipld-git plugin
License: MIT
Signed-off-by: Jeromy <jeromyj@gmail.com>
2017-07-12 21:53:59 +02:00