Improve naming files uploaded via the URL paste method

[martenson]

originally implemented in #3674
reverted in #3996 because of unwanted side effects

We need a better implementation, some ideas are listed in the [comments here] (#3695 (comment))

[chambm]

I think the easiest fix using the old implementation is to add a checkbox to the paste upload box like Rename datasets to last path segment. I agree that using the filename header from the server is even better, but that method wouldn't have worked for my situation. I was using a very simple Apache2 index to host my files, and that doesn't set the filename header. Thank goodness for Stack Overflow (er, Server Fault): https://serverfault.com/a/101966/302991

<Location /textfiles>
    SetEnvIf Request_URI "^.*/([^/]*)$" FILENAME=$1
    Header set "Content-disposition" "attachment; filename=%{FILENAME}e"
    UnsetEnv FILENAME
</Location>

So maybe a combo box instead of a checkbox, with options like:
Full URL (default)
Last path segment
Filename header

[hexylena]

Agreed with @chambm, would love to see this re-reverted with a checkbox so users can opt-in :)

[mtekman]

I was just thinking about this today

[hexylena]

Here's a video from @foellmelanie where she spends like 5-10 minutes renaming files. https://youtu.be/ad3E4VaTp7M?t=510

We really need a checkbox like @mtekman suggested. #4005 (comment), I know that galaxy-to-galaxy transfers lose information but, that doesn't affect the other many, many URLs. If you don't want to do it automatically at least have a checkbox.

I've tagged this papercut so hopefully this gets more eyes, but this is one of those missing features that regularly is an annoyance for users. #11371 is related. ping @shiltemann

the best laid plans.. #3996 (comment)

[assuntad23]

@hexylena Now that pasted URLs use the datafetch tool (#11276) , is this resolved?

It looks like it's in good shape now. I uploaded three of the files from that video, and they were renamed in a way that matched what the user was doing.

https://zenodo.org/record/4544529/files/Evidence.tabular
https://zenodo.org/record/4544529/files/protein_groups.tabular
https://zenodo.org/record/4544529/files/PTXQC_report.pdf

Feel free to try those (and/or whatever URLs you'd like) and let me know if it seems this issue is resolved for you.

[hexylena]

It looks like it's currently broken on main but test looks good!

This is so beautiful 😍 😍 😍 😍 , it's going to save so much time. @shiltemann it finally happened!!! No more mothur tutorial naming issues because people don't rename the files properly like you tell them to!

[shiltemann]

Whoo! Thanks @assuntad23! Definitely a big QOL improvement for a lot of use cases and tutorials!

[mvdbeek]

That was fixed in #12861, that's why it works on test and not main.
That was the renaming issue that was fixed in there, not the default name from url thing.

[hexylena]

is that specific failure expected though @mvdbeek ? unsupported media type for two pasted URLs?

[mvdbeek]

No, but that also works for me. Can you check what endpoint returned this reponse, and which browser are you using ?

?

[hexylena]

It works now, I cannot reproduce. :(