Add S3 storage and multi-hop transfer tutorial with resource files#744
Closed
alessio94 wants to merge 5 commits into
Closed
Add S3 storage and multi-hop transfer tutorial with resource files#744alessio94 wants to merge 5 commits into
alessio94 wants to merge 5 commits into
Conversation
This tutorial provides a comprehensive guide for setting up a Rucio test environment using Docker Compose, detailing prerequisites, environment management, configuration, and data management scripts for effective data replication and multi-hop transfers.
for more information, see https://pre-commit.ci
Contributor
|
A few notes:
|
alessio94
added a commit
to alessio94/documentation-rucio
that referenced
this pull request
Mar 23, 2026
Addresses feedback from PR rucio#744: - Remove Jupyter notebook - Inline script content directly as code blocks - Replace inline script comments with prose descriptions - Remove docker exec wrapping; assume reader is in a Rucio admin environment - Narrow scope to S3 RSE setup only; remove environment initialization steps
Contributor
|
Closing because this is superseded by #766 |
alessio94
added a commit
to alessio94/documentation-rucio
that referenced
this pull request
May 13, 2026
Added detailed instructions for configuring S3 storage and multi-hop transfers in Rucio, including setting up MinIO instances, registering RSEs, and verifying the setup. This PR supersedes rucio#744, rucio#739, and rucio#766. Addresses feedback from PR rucio#766. Thanks for the review, @voetberg. I have implemented the requested documentation changes: - Updated the introduction to reflect that `rucio` and `rucio-admin` have been merged since Rucio 38, and that admin access is now handled through permission policies. - Reduced the duplicated MinIO RSE registration commands to a loop over `MINIO1` and `MINIO2`. - Added explanatory comments for the RSE attributes used in the S3 protocol configuration. - Reworked the `rse-accounts.cfg` section to separate the commands used to generate the file from the rendered configuration output, using a `console` block for the inspected file content. - Simplified the explanation of RSE distances and added a Mermaid diagram to make the multi-hop topology clearer. - Removed the Jupyter notebook material from the documentation, keeping the demo setup focused on the operator workflow.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR supersedes #739 and addresses the feedback:
docs/operator/_resources/rucio-playground/(as .txt since it was suggested that "the .sh could be rather nefarious looking")Thanks for the feedback
@voetberg @rdimaio