Xrdceph otf checksums #38
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
merged in upstream xrootd
Noscript checksum
…appen. gateways with 100 reported load would still add and take 1 slot in the selection, preventing the algorithm from focussing on the first gateway in the list
Noscript checksum
V5.5.4patched
V5.5.4fix
null ptr fix
V5.7.3patched
It is already used for path-based redirects, so we should not introduce conflicts.
Add redirection
It was noticed that for reads there may be some inefficiencies when xcache is involved. For writes, however, the buffering layer improved pefromance significantly. So, it make sense to introduce the write-only mode.
…hecksum. Settings for streamed checksum allow calculation only, calc+log, and calc+log+store as extended attribute. Record streamed and readback checksums in a central checksums.log file.
on XrdCmsCluster, replace the more verbose file not found response on dfs systems with a simpler 'file not found'. This is because the error message caused confusion for users and the additional info is not relevant at RAL due to having a shared storage backend
…tialised checksum value when client reads file. Move recording of readback checksum value into XrdCephPosix instead of Set() method in XrdCephXAttr.cc. More checks for writable checksum record file
…ing zlib directly Move from using zlib adler32() function to XrdCks/XrdCksCalcadler32. The superclass, XrdCksCalc, provides a uniform interface to all supported checksum algorithms, and is the preferred method in XRootD. Remove an unneccessary guard condition in the ceph_posix_*write() methods.
Make XrdCeph plugin approach to calculating streamed checksums more acceptable by using the more generic XrdCksCalc class, subclass XrdCksCalcadler32, rather than calling the zlib adler32 function directly.
The XrdCksCalc object in the CephFileRef structure needs a matching delete in ceph_posix_close()
Without the patch, Mac OS X is missing the macros for the json-c library.
This commit adds a new configuration directive: 'http.redirtoken'. When this new directive is enabled, a valid SciToken in the URL as an `authz` argument will be replaced on redirection with a sufficient Macaroon instead. The redirected Macaroon will have a short lifetime and be specific to the path being accessed.
V5.7.3patched
V5.7.3patched
redirtoken
V5.8.2patched
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
merge XrdCeph streamed checksums