2237 Commits

Author	SHA1	Message	Date
Nick Craig-Wood	7b2f779334	archive backend - WIP FIXME ... - Tests all passing. - Zip and squashfs archivers working. - Lazily loads and caches squashfs Squashfs - see archive.go for more FIXMEs	2025-06-24 12:29:06 +01:00
Nick Craig-Wood	abb8fc24f3	backend: Split backends which use the vfs into a seperate file ... This is so that the VFS tests can use the backends but not cause an import loop.	2025-06-24 12:25:59 +01:00
Nick Craig-Wood	559ef2eba8	combine: fix directory not found errors with ListP interface - Fixes #8627 ... In b1d774c2e3caab23 combine: implement ListP interface We introduced the ListP interface to the combine backend. This was passing the wrong remote to the upstreams. This was picked up by the integration tests but was ignored by accident.	2025-06-23 17:43:52 +01:00
Nick Craig-Wood	17b25d7ce2	local: fix --skip-links on Windows when skipping Junction points ... Due to a change in Go which was enabled by the `go 1.22` in `go.mod` rclone has stopped skipping junction points ("My Documents" in particular) if `--skip-links` is set on Windows. This is because the output from os.Lstat has changed and junction points are no longer marked with os.ModeSymlink but with os.ModeIrregular instead. This fix now skips os.ModeIrregular objects if --skip-links is set on Windows only. Fixes #8561 See: https://github.com/golang/go/issues/73827	2025-06-23 16:39:14 +01:00
necaran	beffef2882	mega: fix tls handshake failure - fixes #8565 ... The cipher suites used by Mega's storage endpoints: https://github.com/meganz/webclient/issues/103 are no longer supported by default since Go 1.22: https://tip.golang.org/doc/go1.22#minor_library_changes This therefore assigns the cipher suites explicitly to include the one Mega needs.	2025-06-19 18:05:00 +01:00
jinjingroad	16f1e08b73	chore: fix function name ... Signed-off-by: jinjingroad <jinjingroad@sina.com>	2025-06-19 08:02:51 +02:00
Nick Craig-Wood	92fea7eb1b	ftp: add --ftp-http-proxy to connect via HTTP CONNECT proxy	2025-06-17 17:53:11 +01:00
Nick Craig-Wood	f226d12a2f	pcloud: fix "Access denied. You do not have permissions to perform this operation" on large uploads ... The API we use for OpenWriterAt seems to have been disabled at pcloud PUT /file_open?flags=XXX&folderid=XXX&name=XXX HTTP/1.1 gives { "result": 2003, "error": "Access denied. You do not have permissions to perform this operation." } So disable OpenWriterAt and hence multipart uploads for the moment.	2025-06-17 12:46:35 +01:00
Nick Craig-Wood	81fccd9c39	googlecloudstorage: fix directory marker after // changes in #5858 ... Before this change we were creating the directory markers with double slashes on.	2025-06-16 17:33:40 +01:00
Nick Craig-Wood	1dc3421c7f	s3: fix directory marker after // changes in #5858 ... Before this change we were creating the directory markers with double slashes on.	2025-06-16 17:33:40 +01:00
Nick Craig-Wood	073184132e	azureblob: fix directory marker after // changes in #5858 ... Before this change we were creating the directory markers with double slashes on.	2025-06-16 17:33:40 +01:00
Nick Craig-Wood	2847412433	googlephotos: fix typo in error message - Fixes #8600	2025-06-13 14:59:08 +01:00
Nick Craig-Wood	5c81132da0	s3: MEGA S4 support	2025-06-13 11:47:21 +01:00
nielash	e469c8974c	chunker: fix double-transform ... Before this change, chunker could double-transform a file under certain conditions, when --name-transform was in use. This change fixes the issue by ensuring that --name-transform is disabled during internal file moves.	2025-06-12 18:31:01 +01:00
Nick Craig-Wood	dda6a863e9	build: update all dependencies ... This updates all direct and indirect dependencies It stops the linter complaining about deprecated azidentiy APIs also.	2025-06-09 14:19:53 +01:00
Nick Craig-Wood	99358cee88	onedrive: fix crash if no metadata was updated ... Before this change, rclone would crash if no metadata was updated. This could happen if the --onedrive-metadata-permissions read was supplied but metadata to write was supplied. Fixes #8586	2025-06-06 17:40:25 +01:00
kingston125	4a1b5b864c	Add FileLu cloud storage backend	2025-06-06 15:15:07 +01:00
Flora Thiebaut	3b3096c940	doi: add new doi backend ... Add a new backend to support mounting datasets published with a digital object identifier (DOI).	2025-06-05 16:40:54 +01:00
Nick Craig-Wood	6c36615efe	s3: add Exaba provider	2025-06-04 17:42:48 +01:00
ahxxm	e2d6872745	b2: use file id from listing when not presented in headers - fixes #8113	2025-06-04 16:23:58 +01:00
PrathameshLakawade	3c66d9ccb1	backend/s3: require custom endpoint for Lyve Cloud v2 support ... Lyve Cloud v2 no longer provides a shared S3 endpoint like v1 did. Instead, each customer receives a unique, reseller-specific endpoint. To reflect this change, the S3 backend now requires users to manually enter their endpoint when selecting Lyve Cloud as a provider. Previously, users selected from a list of hardcoded Lyve Cloud v1 endpoints. This was not compatible with Lyve Cloud v2 accounts and could cause confusion or misconfiguration. This change: - Removes outdated pre-defined endpoint selection for Lyve Cloud - Requires users to provide their own endpoint - Adds a format example to guide correct usage Before: Users selected a fixed endpoint from a list (v1 only) After: Users must input their own endpoint (v2-compatible)	2025-06-03 16:19:41 +01:00
Oleksiy Stashok	badf16cc34	backend: skip hash calculation when the hashType is None - fixes #8518 ... When hashType is None `local` backend still runs expensive logic that reads the entire file content to produce an empty string.	2025-06-03 15:40:50 +01:00
Nick Craig-Wood	0ee7cd80f2	azureblob: fix multipart server side copies of 0 sized files ... Before this fix multipart server side copies would fail. This problem was due to an incorrect calculation of the number of parts to transfer - it calculated 1 part to transfer rather than 0.	2025-06-02 17:22:37 +01:00
Jeremy Daer	4fd5a3d0a2	s3: add Pure Storage FlashBlade provider support (#8575) ... Pure Storage FlashBlade is an enterprise object storage platform that provides S3-compatible APIs. This change adds FlashBlade as a new provider option in the S3 backend. Before this change, FlashBlade users had to use the "Other" provider with manual configuration of various compatibility flags. This often resulted in suboptimal performance due to conservative default settings. After this change, users can select the "FlashBlade" S3 provider and get an optimal configuration: - ListObjectsV2 enabled for better performance - AWS-compatible multipart ETags for reliable transfers - Proper handling of "AlreadyOwnedByYou" bucket creation responses - Path-style URLs by default (virtual-host style with DNS setup) - Unsigned payloads to ensure compatibility with all rclone features FlashBlade supports modern S3 features including trailer checksum algorithms (SHA256, CRC32, CRC32C), object versioning, and lifecycle management. Provider settings were verified by testing against a FlashBlade//E system running Purity//FB 4.5.7. Documentation and test configurations are included. Integration test results: ``` go test -v -fast-list -remote TestS3FlashBlade: PASS ok github.com/rclone/rclone/backend/s3 232.444s ```	2025-05-30 12:35:13 +01:00
wbulot	3594330177	backend/gofile: update to use new direct upload endpoint ... Update the Gofile backend to use the new direct upload endpoint based on the latest API changes. The previous implementation used dynamic server selection, but Gofile has simplified their API to use a single upload endpoint at https://upload.gofile.io/uploadfile. This change: - Removes server selection logic and related code - Simplifies the Fs struct by removing server-related fields - Updates the upload process to use the direct upload URL	2025-05-27 14:28:25 +01:00
Nick Craig-Wood	c37fe733df	onedrive: re-add --onedrive-upload-cutoff flag ... This was removed as part of #1716 to fix rclone uploads taking double the space. 7f744033d8eae0fa onedrive: Removed upload cutoff and always do session uploads As far as I can see, two revisions are still being created for single part uploads so the default for this flag is set to -1, off. However it may be useful for experimentation. See: #8545	2025-05-15 15:25:10 +01:00
Nick Craig-Wood	b31659904f	onedrive: fix "The upload session was not found" errors ... Before this change, sometimes, perhaps on heavily loaded sharepoint servers, uploads would sometimes fail with the error: {"error":{"code":"itemNotFound","message":"The upload session was not found"}} This retries the upload after a 5 second delay up to --low-level-retries times. Fixes #8545	2025-05-15 15:25:10 +01:00
Germán Casares	d4fd93e7f3	googlephotos: update read only and read write scopes to meet Google's requirements. ... As part of changes to the Google Photos APIs the scopes rclone used for accessing Google photos have been removed. This commit replaces the scopes with updated ones. These aren't as powerful as the old scopes - this means rclone will only be able to download photos it uploaded from March 31, 2025. To use these new scopes do `rclone reconnect yourgooglephotosremote:` Fixes #8434 Co-authored-by: Nick Craig-Wood <nick@craig-wood.com>	2025-05-12 16:43:23 +01:00
Clément Wehrung	9d55b2411f	iclouddrive: fix panic and files potentially downloaded twice ... - Fixing SIGSEGV Fixes #8211 - Removed files potentially downloaded twice	2025-05-07 18:00:33 +01:00
Nick Craig-Wood	2404831725	sftp: add --sftp-http-proxy to connect via HTTP CONNECT proxy	2025-04-29 14:16:17 +01:00
Nick Craig-Wood	1f8373fae8	drive: metadata: fix error when setting copy-requires-writer-permission on a folder ... This appears not to be allowed, so this fixes the problem by ignoring that metadata for a folder. Fixes #8517	2025-04-25 12:15:37 +01:00
Klaas Freitag	0b9671313b	webdav: add an ownCloud Infinite Scale vendor that enables tus chunked upload support ... This change adds a new vendor called "infinitescale" to the webdav backend. It enables the ownCloud Infinite Scale https://github.com/owncloud/ocis project and implements its specific chunked uploader following the tus protocol https://tus.io Signed-off-by: Christian Richter <crichter@owncloud.com> Co-authored-by: Klaas Freitag <klaas.freitag@kiteworks.com> Co-authored-by: Christian Richter <crichter@owncloud.com> Co-authored-by: Christian Richter <1058116+dragonchaser@users.noreply.github.com> Co-authored-by: Ralf Haferkamp <r.haferkamp@opencloud.eu>	2025-04-11 12:23:55 +01:00
Nick Craig-Wood	e0c99d6203	onedrive: fix metadata ordering in permissions ... Before this change, due to a quirk in Graph, User permissions could be lost when applying permissions. Fixes #8465	2025-04-11 10:38:51 +01:00
Ben Alex	4f1fc1a84e	iclouddrive: fix so created files are writable ... At present any created file (eg through the touch command, copy, mount etc) is read-only in iCloud. This has been reported by users at https://forum.rclone.org/t/icloud-and-file-editing-permissions/50659.	2025-04-10 11:38:38 +01:00
yuval-cloudinary	52ff407116	cloudinary: var naming convention - #8416	2025-04-09 15:03:59 +01:00
yuval-cloudinary	078d202f39	cloudinary: automatically add/remove known media files extensions #8416	2025-04-09 15:03:59 +01:00
Markus Gerstel	48802b0a3b	s3: documentation regression - fixes #8438 ... We lost a previous documentation fix (#7077) detailing how to restore single objects from AWS S3 Glacier. Also make clearer that rclone provides restore functionality natively. Co-authored-by: danielkrajnik <dan94kra@gmail.com>	2025-04-09 14:18:18 +01:00
Nick Craig-Wood	0ac2d2f50f	cache: mark ListP as not supported yet	2025-04-08 15:14:09 +01:00
Nick Craig-Wood	42fcb0a6fc	hasher: implement ListP interface	2025-04-08 15:14:09 +01:00
Nick Craig-Wood	490dd14bc5	compress: implement ListP interface	2025-04-08 15:14:09 +01:00
Nick Craig-Wood	943ea0acae	chunker: mark ListP as not supported yet	2025-04-08 15:14:09 +01:00
Nick Craig-Wood	d64a97f973	union: mark ListP as not supported yet	2025-04-08 15:14:09 +01:00
Nick Craig-Wood	5d8f1d4b88	crypt: implement ListP interface	2025-04-08 15:14:09 +01:00
Nick Craig-Wood	b1d774c2e3	combine: implement ListP interface	2025-04-08 15:14:09 +01:00
Nick Craig-Wood	fad579c4a2	s3: Implement paged listing interface ListP	2025-04-08 15:14:09 +01:00
Nick Craig-Wood	cba653d502	walk: move NewListRHelper into list.Helper to avoid circular dependency ... It turns out that the list helpers were at the wrong level and needed to be pushed down into the fs/list for future work.	2025-04-08 15:14:00 +01:00
Fernando Fernández	58d9ae1c60	docs/googlephotos: fix typos	2025-04-06 10:49:02 +02:00
Jörn Friedrich Dreyer	839eef0db2	webdav: retry propfind on 425 status ... This retries propfind on 425 status In ownCloud Infinite Scale, files might be in that state if postprocessing is still ongoing. All metadata are available anyway Allow item status 425 "too early" for items when changing metadata Fixes the upload behavior with ownCloud Infinite Scale Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de> Co-authored-by: Klaas Freitag <kraft@freisturz.de>	2025-03-26 12:51:04 +00:00
nielash	44e83d77d7	http: correct root if definitely pointing to a file - fixes #8428 ... This was formalized in c69eb84573 But it appears that we forgot to update `http`, and the `FsRoot` test didn't catch it because we don't currently have an http integration test.	2025-03-17 18:05:23 +00:00
Nick Craig-Wood	401cf81034	build: modernize Go usage ... This commit modernizes Go usage. This was done with: go run golang.org/x/tools/gopls/internal/analysis/modernize/cmd/modernize@latest -fix -test ./... Then files needed to be `go fmt`ed and a few comments needed to be restored. The modernizations include replacing - if/else conditional assignment by a call to the built-in min or max functions added in go1.21 - sort.Slice(x, func(i, j int) bool) { return s[i] < s[j] } by a call to slices.Sort(s), added in go1.21 - interface{} by the 'any' type added in go1.18 - append([]T(nil), s...) by slices.Clone(s) or slices.Concat(s), added in go1.21 - loop around an m[k]=v map update by a call to one of the Collect, Copy, Clone, or Insert functions from the maps package, added in go1.21 - []byte(fmt.Sprintf...) by fmt.Appendf(nil, ...), added in go1.19 - append(s[:i], s[i+1]...) by slices.Delete(s, i, i+1), added in go1.21 - a 3-clause for i := 0; i < n; i++ {} loop by for i := range n {}, added in go1.22	2025-02-28 11:31:14 +00:00