I approve!

Yay, awesome. I can ssh in now - thanks @Majavah!

I made a PR! https://github.com/toolforge/paws/pull/76

I just saw @Bstorm's awesome response to earlier comments, and am very happy with the way things have gone. THANK YOU!

PAWS now supports rstudio: https://hub.paws.wmcloud.org/hub/user-redirect/rstudio

I'm fine letting it wait for a week :)

I'm fine letting it wait for a week :)

Not sure what phab etiquette is anymore - should this have a PAWS tag now? Or?

There's a 3G memory limit per user on PAWS with a guarantee of 1G. I hope that's enough for most openrefine - although it's possible we need to explicitly tell OpenRefine how much RAM it can use. JVM apps can be a bit picky like that.

Users need to authenticate with their SUL accounts to login to PAWS, and this actually generates authentication that can be accessed from inside the apps that run inside it! The following environment variables are set:

Yeah, so far I can primarily think of GitHub and quay.io access. And SSH / kubectl as well?

Closed via https://github.com/toolforge/paws/pull/69. Thanks for the merge, @Bstorm

What happened to this?

In T283443#7105597, @bd808 wrote:

I'm pretty sure that this request from the inventor of PAWS would be hard to say no to.

@yuvipanda do you remember if you signed the volunteer NDA when you were off-boarding from your tenure as a Foundation employee?

https://github.com/toolforge/paws/pull/66 adds nbgitpuller, which is heavily used outside for distributing tutorial content. Will be very helpful here I think :)

https://github.com/toolforge/paws/pull/62 bumps it to 4.0, and https://github.com/toolforge/paws/pull/64 adds RStudio! You can check out RStudio from https://hub.paws.wmcloud.org/hub/user-redirect/rstudio

With https://github.com/yuvipanda/jupyterhub-ssh, you can get 'real' ssh access to your JupyterHub instance, via your JupyterHub access token. This means anyone with a SUL login can then login to PAWS, get a token that'll let them *ssh* in. SFTP is also supported.

Solved by https://github.com/toolforge/paws/pull/62

Pretty well supported with github.com/jupyterhub/jupyter-rsession-proxy/, although you need to be running inside a container (or something with network namespace isolation) for it to work.

In T224658#7053302, @Ottomata wrote:

There are still some child tasks of this Newpyter parent task, but as of today I think we can call the 'Newpyter' project done.

tools-paws-worker-1019 is currently in a broken state due to this (journalctl -u docker)

Am now mostly convinced this is because of hairpin mode problems - a pod trying to talk to a service IP for itself runs into issues reaching itself, causing the 599 issues.

on a personal note, at some point in the debugging I was ready to give up and let PAWS die - thankfully with some encouragement from @bd808 and @chasemp it did not happen. However, without stronger institutional support, I'm unsure how much longer PAWS can survive. @bd808, @chasemp and @madhuvishy need more help & resources if PAWS is to continue to thrive.

From my experience with uptimerobot, it's quite flaky - we got one or two false positive alerts each day from it. I've switched to using Pingdom for that reason.

is this still the case?

It would be great if someone could make a PR on https://github.com/yuvipanda/paws fixing it :) If not I'll try to fix this next week.

Is this still the case with paws.wmflabs.org now? It's running on a completely different backend!

It's possible that you just ran out of RAM and the kernel died? I think we have a 1G memory limit...

I've switched the backend of paws completely as of today, and that should help fix most of these!

I'm going to say 'too late' and close this, unfortunately.

Heya! This should be fixed now, since I deployed a new backend for paws.wmflabs.org. Let me know if it isn't!

I deployed new backend for paws.wmflabs.org now, and it should allow you to download PDFs. Please re-open if it doesn't!

What browser are you on?

Fixed and deployed. paws.wmflabs.org should have it in about 20 minutes or so.

Done now! \o/

I've shut it down.

Feel free to junk the mattermost repo.

I don't think anyone is using this project, and I've no time, so am happy to just shut the tool :)

Here's what I want to do:

@Halfak should be all sorted out now!

I'm trying to set up auto deploys to PAWS, so I'll wait till I'm done with that.

@Halfak that's strange. I totally do see an 'R' in the new dropdown menu....

@MarcoAurelio - is that showing up at paws.tools.wmflabs.org and not at paws.wmflabs.org? Or is it showing up at both?

can you try https://paws.tools.wmflabs.org? It's a new installation of PAWS (you get to keep all your old files!). I'll switch out the URL in a couple days if it goes well :)

Heya! https://paws.tools.wmflabs.org is the newer version of PAWS (URLs will switch shortly!). It does have an R kernel! Can you check it out and confirm?

@MisterSynergy can you (and others!) try out a new install at https://paws.tools.wmflabs.org? All your old files will still be here, but the authentication (and other code) is vastly improved and stable. I'll point paws.wmflabs.org to this in the next few days. Try it out and see if that solves your problem?

@Ebraminio cool! I'm going to upgrade Python to 3.6 as well (it's currently 3.5 I think) :) npm will also be available by default.

@Ebramino can you try https://paws.tools.wmflabs.org? It's going to replace paws.wmflabs.org shortly. Same everything, just a different underlying base.

Since labs in general hates it when I try to create new instances, it took me almost 20 tries with lots of instances failing, but I now have ten nodes! Hopefully I'll not have to touch instance creation again for a long time. It's quite frustrating... :(

It's at 5 nodes now, and I've run out of quota in tools now.

Not worth it.

Going to close this for now!

Closing, since the modle of pasting won't really ever work with remote kernels like PAWS :)

Heya! Thanks for filing this!

To be clear, I don't actually care too much about the size of Tools' k8s cluster :) I only want about 8-10 nodes for the PAWS cluster :) Am happy to let toolforge admins decide if they wanna down size tools' cluster

Things seem to be working now! Thank you very much, everyone involved! I'll leave it to someone else to close this ticket :)

Nah, don't care for now. Can move whenever other stuff moves :)

Yup, new cluster!

Note that I'm now running into errors like: