Question

Bioconductor code browser time out

2

Entering edit mode

Marek Gierlinski ▴ 30

@mgierlinski-7369

Last seen 12 weeks ago

United Kingdom

Bioconductor code browser has been unresponsive for a while (at least since yesterday). When you try, for example,

https://code.bioconductor.org/browse/limma/RELEASE_3_18/

it munches through it for a while and returns "Bad gateway".

Bioconductor • 332 views

ADD COMMENT • link updated 3 months ago by Mike Smith ★ 6.5k • written 3 months ago by Marek Gierlinski ▴ 30

1

Entering edit mode

Thanks for the report. The site seems to being hit by a huge number of access attempts from a single IP and overloading it. I'm investigating the issue now.

ADD REPLY • link 3 months ago Mike Smith ★ 6.5k

0

Entering edit mode

It is back to normal now. Thank you.

ADD REPLY • link 3 months ago Marek Gierlinski ▴ 30

score 1 · Answer 1 · 2024-01-10

The site was being overwhelmed by various webcrawler bots, which were trying to index everything including all commits across all branches etc. There's potientially hundred of thousands of pages if you consider that, and I think the cumulative effect of those bots brought the site down.

I've now implemented a robots.txt which hopefully most of them will respect to try and limit what they access.