Skip to content

Do not escape the object name in the fs backend - #1017

Merged
fsouza merged 3 commits into
fsouza:mainfrom
gaul:fs/do-not-escape-object-name
Dec 28, 2022
Merged

Do not escape the object name in the fs backend#1017
fsouza merged 3 commits into
fsouza:mainfrom
gaul:fs/do-not-escape-object-name

Conversation

@gaul

@gaul gaul commented Dec 23, 2022

Copy link
Copy Markdown
Contributor

Now fake-gcs-server implicitly creates parent directories when creating an object /foo/bar/baz. This allows creating paths longer than NAME_MAX (256) and interoperating with existing filesystems. This approach does not allow some kinds of objects to exist, e.g., /foo/ with a non-zero object size, although these should be rare.

@gaul
gaul force-pushed the fs/do-not-escape-object-name branch 2 times, most recently from 2e2c612 to 07dc6ed Compare December 23, 2022 09:33
Now fake-gcs-server implicitly creates parent directories when creating an
object /foo/bar/baz.  This allows creating paths longer than NAME_MAX (256) and
interoperating with existing filesystems.  This approach does not allow some
kinds of objects to exist, e.g., /foo/ with a non-zero object size, although
these should be rare.
@gaul
gaul force-pushed the fs/do-not-escape-object-name branch from 07dc6ed to a0e528e Compare December 23, 2022 09:35
@gaul

gaul commented Dec 23, 2022

Copy link
Copy Markdown
Contributor Author

Sorry had some trouble with Windows.

@fsouza fsouza left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for contributing and apologies for the delayed response!

Comment thread internal/backend/fs.go Outdated
@fsouza
fsouza merged commit 041da75 into fsouza:main Dec 28, 2022
@gaul
gaul deleted the fs/do-not-escape-object-name branch January 9, 2023 14:29
robklg added a commit to bolcom/libunftp that referenced this pull request Dec 16, 2024
This PR re-enables the GCS tests. By pinning to an older version of the
fsouza/fake-gcs-server, which [stopped
supporting](fsouza/fake-gcs-server#1017) files
ending with / in
[v1.43.0](https://github.com/fsouza/fake-gcs-server/releases/tag/v1.43.0)

We should replace this docker-dependent setup with something more
robust.

Also reintroducing root_dir setting, which serves as a regression test
for #508
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants