5702b7578c
serve sftp: add serve rc interface
2025-04-09 11:12:07 +01:00
703788b40e
serve restic: add serve rc interface
2025-04-09 11:12:07 +01:00
aef9c2117e
serve s3: add serve rc interface
2025-04-09 11:12:07 +01:00
2a42d95385
serve dlna: add serve rc interface
2025-04-09 11:12:07 +01:00
e37775bb41
serve webdav: add serve rc interface - fixes #4505
2025-04-09 11:12:07 +01:00
780f4040ea
serve http: add serve rc interface
2025-04-09 11:12:07 +01:00
0b7be6ffb9
serve nfs: add serve rc interface
2025-04-09 11:12:07 +01:00
4d9a165e56
serve: Add rc control for serve commands #4505
...
This adds the framework for serving. The individual servers will be
added in separate commits.
2025-04-09 11:12:07 +01:00
21e5fa192a
configstruct: add SetAny to parse config from the rc
...
Now that we have unified the config, we can make a much more
convenient rc interface which mirrors the command line exactly, rather
than using the structure of the internal Go structs.
2025-04-09 11:12:07 +01:00
cf571ad661
rc: In options/info make FieldName contain a "." if it should be nested
...
Before this would have Output "FieldName": "ListenAddr" where it
actually needs to be set in a sub object "HTTP".
After this fix it outputs "FieldName": "HTTP.ListenAddr" to indicate
"ListenAddr" needs to be set in the object "HTTP".
2025-04-09 11:12:07 +01:00
b1456835d8
serve restic: convert options to new style
2025-04-09 11:12:07 +01:00
b930c4b437
serve s3: convert options to new style
2025-04-09 11:12:07 +01:00
cebd588092
serve http: convert options to new style
2025-04-09 11:12:07 +01:00
3c981e6c2c
serve webdav: convert options to new style
2025-04-09 11:12:07 +01:00
6054c4e49d
auth proxy: convert options to new style
2025-04-09 11:12:07 +01:00
028316ba5d
auth proxy: add VFS options parameter for use for default VFS
...
This is for use from the RC API.
2025-04-09 11:12:07 +01:00
df457f5802
serve: make the servers self registering
...
This is so that they can import cmd/serve without causing an import
loop.
The active servers can now be configured by commenting lines out in
cmd/all/all.go like all the other commands.
2025-04-09 11:12:07 +01:00
084e35c49d
lib/http: fix race between Serve() and Shutdown()
...
This was discovered by the race detector.
2025-04-09 11:12:07 +01:00
90ea4a73ad
lib/http: add Addr() method to return the first configured server address
2025-04-09 11:12:07 +01:00
efe8ac8f35
Add Danny Garside to contributors
2025-04-09 11:12:06 +01:00
894ef3b375
docs: fix minor typo in box docs
build / linux_386 (push) Waiting to run
build / lint (push) Waiting to run
build / android-all (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/386 (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Waiting to run
Build & Push Docker Images / Merge & Push Final Docker Image (push) Blocked by required conditions
build / windows (push) Waiting to run
build / other_os (push) Waiting to run
build / mac_amd64 (push) Waiting to run
build / mac_arm64 (push) Waiting to run
build / linux (push) Waiting to run
build / go1.23 (push) Waiting to run
2025-04-08 20:51:22 +01:00
385465bfa9
sync: implement --list-cutoff to allow on disk sorting for reduced memory use
...
Before this change, rclone had to load an entire directory into RAM in
order to sort it so it could be synced.
With directories with millions of entries, this used too much memory.
This fixes the probem by using an on disk sort when there are more
than --list-cutoff entries in a directory.
Fixes #7974
2025-04-08 18:02:24 +01:00
0148bd4668
march: Implement callback based syncing
...
This changes the syncing method to take callbacks for directory
listings rather than being passed the entire directory listing at
once.
This will enable out of memory syncing.
2025-04-08 18:02:24 +01:00
0f7ecf6f06
list: add ListDirSortedFn for callback oriented directory listing
...
This will be used for the out of memory sync
2025-04-08 15:14:09 +01:00
08e81f8420
list: Implement Sorter to sort directory entries
...
Later this will be extended to do out of memory sorts
2025-04-08 15:14:09 +01:00
0ac2d2f50f
cache: mark ListP as not supported yet
2025-04-08 15:14:09 +01:00
42fcb0a6fc
hasher: implement ListP interface
2025-04-08 15:14:09 +01:00
490dd14bc5
compress: implement ListP interface
2025-04-08 15:14:09 +01:00
943ea0acae
chunker: mark ListP as not supported yet
2025-04-08 15:14:09 +01:00
d64a97f973
union: mark ListP as not supported yet
2025-04-08 15:14:09 +01:00
5d8f1d4b88
crypt: implement ListP interface
2025-04-08 15:14:09 +01:00
b1d774c2e3
combine: implement ListP interface
2025-04-08 15:14:09 +01:00
fad579c4a2
s3: Implement paged listing interface ListP
2025-04-08 15:14:09 +01:00
37120ef7bd
list: add WithListP helper to implement List for ListP backends
2025-04-08 15:14:09 +01:00
cba653d502
walk: move NewListRHelper into list.Helper to avoid circular dependency
...
It turns out that the list helpers were at the wrong level and needed
to be pushed down into the fs/list for future work.
2025-04-08 15:14:00 +01:00
2a90de9502
fs: define ListP interface for paged listing #4788
2025-04-08 15:12:53 +01:00
bff229713a
accounting: Add listed stat for number of directory entries listed
2025-04-08 15:12:53 +01:00
117f583ebe
walk: factor Listing helpers into their own file and add tests
2025-04-08 15:12:53 +01:00
205667143c
serve nfs: make metadata files have special file handles
...
build / linux_386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/386 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Has been cancelled
build / windows (push) Has been cancelled
build / other_os (push) Has been cancelled
build / mac_amd64 (push) Has been cancelled
build / mac_arm64 (push) Has been cancelled
build / linux (push) Has been cancelled
build / go1.23 (push) Has been cancelled
build / lint (push) Has been cancelled
build / android-all (push) Has been cancelled
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Has been cancelled
Build & Push Docker Images / Merge & Push Final Docker Image (push) Has been cancelled
Metadata files have the file handle of their source file with
0x00000001 suffixed in big endian so we can look them up directly from
their file handles.
2025-04-07 13:41:29 +01:00
fe84cbdc9d
serve nfs: change the format of --nfs-cache-type symlink file handles
...
This is an backwards incompatible change which will invalidate the
current handles.
This change adds a 4 byte big endian length prefix to the handles so
we can in future suffix extra info on the handles. This needed to be 4
bytes as Linux does not like File handles which aren't multiples of 4
bytes long.
2025-04-07 13:41:29 +01:00
533c6438f3
vfs: add --vfs-metadata-extension to expose metadata sidecar files
...
This adds --vfs-metadata-extension which can be used to expose sidecar
files with file metadata in. These files don't exist in the listings
until they are accessed.
2025-04-07 13:41:29 +01:00
b587b094c9
docs: Add rcloneui.com as Silver Sponsor
2025-04-07 13:41:29 +01:00
525798e1a5
Add Klaas Freitag to contributors
2025-04-07 13:41:29 +01:00
ea63052d36
Add eccoisle to contributors
2025-04-07 13:41:29 +01:00
b5a99c5011
Add Fernando Fernández to contributors
2025-04-07 13:41:29 +01:00
56b7015675
Add alingse to contributors
2025-04-07 13:41:29 +01:00
4ff970ebab
Add Jörn Friedrich Dreyer to contributors
2025-04-07 13:41:29 +01:00
dccb5144c3
docs: replace option --auto-filename-header with --header-filename
build / mac_arm64 (push) Waiting to run
build / linux (push) Waiting to run
build / go1.23 (push) Waiting to run
build / linux_386 (push) Waiting to run
build / lint (push) Waiting to run
build / android-all (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/386 (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/amd64 (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/arm/v6 (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/arm/v7 (push) Waiting to run
Build & Push Docker Images / Build Docker Image for linux/arm64 (push) Waiting to run
build / windows (push) Waiting to run
build / other_os (push) Waiting to run
build / mac_amd64 (push) Waiting to run
Build & Push Docker Images / Merge & Push Final Docker Image (push) Blocked by required conditions
2025-04-06 14:28:34 +02:00
33b087171a
build: update github.com/golang-jwt/jwt/v5 from 5.2.1 to 5.2.2 to fix CVE-2025-30204
...
Bumps [github.com/golang-jwt/jwt/v5](https://github.com/golang-jwt/jwt ) from 5.2.1 to 5.2.2.
- [Release notes](https://github.com/golang-jwt/jwt/releases )
- [Changelog](https://github.com/golang-jwt/jwt/blob/main/VERSION_HISTORY.md )
- [Commits](https://github.com/golang-jwt/jwt/compare/v5.2.1...v5.2.2 )
See: https://github.com/golang-jwt/jwt/security/advisories/GHSA-mh63-6h87-95cp
See: https://www.cve.org/CVERecord?id=CVE-2025-30204
Signed-off-by: dependabot[bot] <support@github.com >
2025-04-06 11:46:13 +01:00
58d9ae1c60
docs/googlephotos: fix typos
2025-04-06 10:49:02 +02:00
