8c8a38711b
Replace sync with lib/sync for deadlock detection with deadlock build tag
2021-11-22 18:15:07 +00:00
386deb3633
lib/sync: a wrapper for inserting go-deadlock into the rclone build
2021-11-22 18:08:12 +00:00
a351484997
sftp: fix timeout on hashing large files by sending keepalives
...
Before this fix the SFTP sessions could timeout when doing hashes if
they took longer than the --timeout parameter.
This patch sends keepalive packets every minute while a shell command
is running to keep the connection open.
See: https://forum.rclone.org/t/rclone-check-over-sftp-failure-to-calculate-md5-hash-for-large-files/27487
2021-11-22 15:26:29 +00:00
099eff8891
sftp: refactor so we only have one way of running remote commands
...
This also returns errors from running ssh Hash commands which we
didn't do before.
2021-11-22 15:26:29 +00:00
c4cb167d4a
Add rsapkf and Will Holtz to contributors
2021-11-21 19:26:05 +01:00
38e100ab19
docs/config: more explicit doc for config create --all with params
2021-11-21 19:22:19 +01:00
db95a0d6c3
docs/pcloud: fix typo
2021-11-21 19:16:19 +01:00
df07964db3
azureblob: raise --azureblob-upload-concurrency to 16 by default
...
After speed testing it was discovered that upload speed goes up pretty
much linearly with upload concurrency. This patch changes the default
from 4 to 16 which means that rclone will use 16 * 4M = 64M per
transfer which is OK even for low memory devices.
This adds a note that performance may be increased by increasing
upload concurrency.
See: https://forum.rclone.org/t/performance-of-rclone-vs-azcopy/27437/9
2021-11-18 16:09:02 +00:00
fbc4c4ad9a
azureblob: remove 100MB upper limit on chunk_size as it is no longer needed
2021-11-18 16:09:02 +00:00
4454b3e1ae
azureblob: implement --azureblob-upload-concurrency parameter to speed uploads
...
See: https://forum.rclone.org/t/performance-of-rclone-vs-azcopy/27437
2021-11-18 16:08:57 +00:00
f9321fccbb
Add deinferno to contributors
2021-11-18 15:51:45 +00:00
3c2252b7c0
fs/operations: add server-side moves to stats
...
Fixes #5430
2021-11-18 12:20:56 +00:00
51c952654c
fstests: treat accountUpgradeRequired as success for OneDrive PublicLink
2021-11-17 17:35:17 +00:00
80e47be65f
yandex: add permanent deletion support
2021-11-17 16:57:41 +00:00
38dc3e93ee
fshttp: add prometheus metrics for HTTP status code
...
This patch adds rclone_http_status_code counter vector labeled by
* host,
* method,
* code.
It allows to see HTTP errors, backoffs etc.
The Metrics struct is designed for extensibility.
Adding new metrics is a matter of adding them to Metrics struct and including them in the response handling.
This feature has been discussed in the forum [1].
[1] https://forum.rclone.org/t/prometheus-metrics/14484
2021-11-17 18:38:12 +03:00
ba6730720d
Fix repeated error messages after pkg/errors removal
2021-11-15 17:58:40 +00:00
7735b5c694
Add Sinan Tan to contributors
2021-11-15 17:58:40 +00:00
d45b3479ee
Add Andy Jackson to contributors
2021-11-15 17:58:40 +00:00
4c5df0a765
Add Fredric Arklid to contributors
2021-11-15 17:58:40 +00:00
8c61a09be2
crypt: add test cases and documentation for base64 and base32768 filename encoding #5801
2021-11-15 17:57:02 +00:00
c217145cae
crypt: add base64 and base32768 filename encoding options #5801
2021-11-15 17:57:02 +00:00
4c93378f0e
serve sftp: update docs on --stdio
2021-11-12 10:49:35 +00:00
f9e54f96c3
docs/sftp: fix typo
2021-11-11 19:20:15 +01:00
af0fcd03cb
hdfs: add file and directory move/rename support
2021-11-11 16:41:43 +00:00
00aafc957e
sftp: add rclone to list of supported md5sum/sha1sum commands to look for
...
See #5781
2021-11-11 15:16:45 +01:00
29abbd2032
hashsum: support creating hash from data received on stdin
...
See #5781
2021-11-11 15:16:45 +01:00
663b2d9c46
jottacloud: Add support for Tele2 Cloud
2021-11-11 12:32:23 +00:00
f36d6d01b5
rc: fix operations/publiclink default for expires parameter
...
Before this change the expires parameter was defaulting to 0 if not
provided.
This change makes it default to fs.DurationOff which is the same as
the `rclone link` command.
See: https://forum.rclone.org/t/operations-publiclink-from-dropbox-error-not-autorized/27374
2021-11-11 11:14:22 +00:00
0c03aa3a8b
dropbox: speed up directory listings by specifying 1000 items in a chunk
2021-11-11 11:14:22 +00:00
caa2b8bf40
dropbox: save an API request when at the root
...
Before this change, rclone always emitted an API request to discover
what type of thing the root is.
This is unecessary as it is always a directory.
2021-11-11 11:14:22 +00:00
421e840e37
Add Borna Butkovic to contributors
2021-11-11 11:14:22 +00:00
9b57d27be4
Add David to contributors
2021-11-11 11:14:22 +00:00
627ac1b2d9
ftp: add --ftp-ask-password to prompt for password when needed
2021-11-10 17:34:14 +00:00
ae395d8cf0
rc: error on web GUI update won't be fatal - fixes #5385
2021-11-10 17:05:13 +00:00
f04520a6e3
operations: fix goroutine leak in case of copy retry
...
Whenever transfer.Account() is called, a new goroutine acc.averageLoop()
is started. This goroutine exits only when the channel acc.exit is closed.
acc.exit is closed when acc.Done() is called, which happens during tr.Done().
However, if tr.Reset is called during a copy low level retry, it replaces
the tr.acc, without calling acc.Done(), which results in the goroutine
mentioned above never exiting.
This commit calls acc.Done() during a tr.Reset()
2021-11-10 16:44:29 +00:00
c968c3e41c
build: raise minimum go version to go1.15
...
This was necessary because go1.14 seems to have a modules related bug
which means it tries to build modules even though the uses of them are
all disabled with build constraints. This seems to be fixed in go1.15.
2021-11-10 16:11:12 +00:00
3661791e82
serve restic: disable for go1.16 and earlier after update
2021-11-10 15:42:50 +00:00
4198763c35
build: update all dependencies
2021-11-10 10:34:56 +00:00
3de47b8ed4
build: upgrade go.mod file to go1.17
2021-11-10 10:34:56 +00:00
71b8e1e80b
build: more docs on upgrading dependencies
2021-11-10 10:34:56 +00:00
7366e97dfc
mega: fix error handling broken by removal of github.com/pkg/errors
...
There were instances of errors.Wrap being called with a nil error
which the conversion didn't deal with correctly.
2021-11-09 13:43:45 +00:00
21ba4d9a18
onedrive: fix error handling broken by removal of github.com/pkg/errors
...
There were instances of errors.Wrap being called with a nil error
which the conversion didn't deal with correctly.
2021-11-09 13:43:45 +00:00
96e099d8e7
union: fix error handling broken by removal of github.com/pkg/errors
...
There were instances of errors.Wrap being called with a nil error
which the conversion didn't deal with correctly.
2021-11-09 13:43:45 +00:00
2a31b5bdd6
Add bbabich to contributors
2021-11-09 13:43:45 +00:00
9bdfe4c36f
Add Vitor Arruda to contributors
2021-11-09 13:43:45 +00:00
e3a2f539fe
Add Chris Lu to contributors
2021-11-09 13:43:45 +00:00
ffa943e31f
Add Carlo Mion to contributors
2021-11-09 13:43:45 +00:00
b16f603c51
s3: Add RackCorp object storage to providers
2021-11-09 11:46:58 +00:00
a7a8372976
🧪 fstest: fix time tests on Windows and add convenience methods to check local and remote fs with precision
...
Previously only the fs being checked on gets passed to
GetModifyWindow(). However, in most tests, the test files are
generated in the local fs and transferred to the remote fs. So the
local fs time precision has to be taken into account.
This meant that on Windows the time tests failed because the
local fs has a time precision of 100ns. Checking remote items uploaded
from local fs on Windows also requires a modify window of 100ns.
2021-11-09 11:43:36 +00:00
9beb0677e4
backend: Fix union eplus policy returned nil
2021-11-08 11:55:27 +00:00
