Скачать или смотреть How to Fix ClearML SSH Port Forwarding Issues for Fileserver Accessibility in the Web UI

Discover how to resolve `ClearML SSH port forwarding` challenges when using the Fileserver with the Web App, and ensure your debug samples are visible.
---
This video is based on the question https://stackoverflow.com/q/65671395/ asked by the user 'Daniel Andres' ( https://stackoverflow.com/u/14569139/ ) and on the answer https://stackoverflow.com/a/65672709/ provided by the user 'Martin.B' ( https://stackoverflow.com/u/11682840/ ) at 'Stack Overflow' website. Thanks to these great users and Stackexchange community for their contributions.

Visit these links for original content and any more details, such as alternate solutions, latest updates/developments on topic, comments, revision history etc. For example, the original title of the Question was: ClearML SSH port forwarding fileserver not available in WEB Ui

Also, Content (except music) licensed under CC BY-SA https://meta.stackexchange.com/help/l...
The original Question post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license, and the original Answer post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license.

If anything seems off to you, please feel free to write me at vlogize [AT] gmail [DOT] com.
---
How to Fix ClearML SSH Port Forwarding Issues for Fileserver Accessibility in the Web UI

If you're working with ClearML on Ubuntu and trying to ensure that your debug samples are displayed in the Web UI, you may encounter a frustrating issue: the Fileserver is not accessible through your SSH port forwarding settings. This guide aims to help you troubleshoot this problem effectively.

The Problem: Fileserver Not Available in the Web UI

You may find yourself in a situation where you’re unable to see your debug images in ClearML's Web UI, even while successfully accessing the server through an SSH tunnel. Here’s a brief snapshot of what you might be facing:

You have a ClearML server set up on a remote host (hostA).

You are connecting to this server using SSH tunnels, redirecting your local machine’s ports to the remote server.

Despite properly setting this up, debug images are still referenced with the default port (localhost:8081) instead of your configured local tunnel port (localhost:18081).

This misconfiguration can be a common stumbling block, but there are straightforward solutions to address it.

Understanding ClearML's File Server Configuration

Before we delve into potential solutions, it's critical to understand how ClearML manages URLs for debug images:

The URLs for debug images are established when they are uploaded to the Fileserver.

The Web App retrieves these URLs from the server, meaning it doesn’t define them itself. This feature allows flexibility in choosing the storage targets.

By default, ClearML looks for debug images on localhost:8008, which may not align with your SSH port forwarding setup.

Validating Current Port Forwarding Configuration

SSH Tunnel for Web App:
Your current command to access the Web App may look like this:

[[See Video to Reveal this Text or Code Snippet]]

SSH Tunnel for Fileserver:
If you have set up similarly for your Fileserver, it will look like this:

[[See Video to Reveal this Text or Code Snippet]]

Solution: Modify Your Port Forwarding for File Access

To resolve the issue of missing debug samples, consider implementing these solutions:

Method 1: Add a New SSH Tunnel

You can create an additional SSH tunnel specifically for the debug samples by redirecting your local port (8081) to the Fileserver. Execute the following command:

[[See Video to Reveal this Text or Code Snippet]]

Method 2: Adjust Configuration in clearml.conf

For future experiments, you can change the default Fileserver URL to point to your configured local port (18081). Here's how you do it:

Locate the clearml.conf file in your home directory.

Edit the Fileserver URL to direct to localhost:18081.

This step is particularly useful if you frequently run experiments from the same machine where the port tunnel exists.

Conclusion

In summary, resolving the issue of the Fileserver not being available on the ClearML Web UI requires careful configuration of your SSH tunnels and possibly making adjustments to configuration files. By setting up an additional SSH tunnel and modifying the Fileserver URL in your clearml.conf, you can regain access to your debug images without hassle.

Keep these tips handy, and you’ll ensure smooth sailing in your ClearML project management endeavors.