Astraweb Error Compilation

I posted (through Astra/US) a test file today, with JBinUp (100% confirmation), then retrieved it from the following:

1+ hour later:

Astra/US - 1 Block Error (out of 2914, .0004%)
Astra/EU - 14 Block Errors (out of 2914, .005%)
Astra/US+EU as fills - 100% (obviously, the errors between the two were not identical)
Blocknews/US - 100%
Binsearch - 100% cataloged/indexed
NZBIndex - 100% cataloged/indexed

Obviously, Astra/US accepted and propagated all the blocks which allowed Blocknews, Binsearch, and NZBIndex to get full completion. They just simply don't have all the blocks they accepted and propagated any more, after 1 hour.

Retrieval will be re-run at daily intervals from this point forward, to see how Astra continues to corrupt itself.

Day 1/24 hours:

Astra/US - 100%
Astra/EU - 2 Block errors (out of 2914, .0006%)
Astra/US+EU as fills - 100%

Things have improved, particularly Astra/EU. My ticket is still open, and not responded to as of yet.

Day 2/48 hours:

Astra/US - 100%
Astra/EU - 2 Block errors (out of 2914, .0006%)
Astra/US+EU as fills - 100%

NO change from 1 day/24 hours. Looked back a few weeks/couple months, and no real change (still the number of errors ramps up the further back).

Day 3/72 hours:

Astra/US - 100%
Astra/EU - 55 Block errors (out of 2914, .02%) 3.9% by Multipar
Astra/US+EU as fills - 100%

Astra/EU errors increased, needs (as shown) 3.9% pars to fix if another server is not used for fills.

Sill no errors on Astra/US.

Day 4/96 hours:

Astra/US - 100%
Astra/EU - 8/127 (.7%) damaged
Astra/US+EU as fills - 100%

Last nights run was probably extra-poor due to typical Sunday PM problems on Astra

Day 5/120 hours:

Astra/US - 8/127 (.6% damaged)
Astra/EU - 17/127 (2.3%) damaged
Astra/US+EU as fills - 7/127 (.5% damaged)

Getting some block errors on Astra/US, will have to see tomorrow (and further) if that stays, increases, or was just some transmission error.

Well, re-ran the Astra/US about 2 hours later and came up with the same damage.

Day 6/144 hours:

Astra/US - 12/127 (1.0% damaged)
Astra/EU - 17/127 (2.8%) damaged
Astra/US+EU as fills - 11/127 (.9% damaged)

Damaged parts continue to increase, particularly if one is using Astra/EU as primary w/o Astra/US as secondary fills, at least 2.8% pars would be required to 'fix' the archive.

It appears that the 'slope' of damage is, in fact, far steeper than original thought (or it's simply getting worse). Meanwhile, my original ticket is still open, but still not responded to.

Day 7/168 hours:

Astra/US - 13/127 (1.1% damaged)
Astra/EU - 18/127 (2.9%) damaged
Astra/US+EU as fills - 13/127 (1.1% damaged)

Both servers continue a downward trend; I had to run the AstraUS/EU twice, the first time it really came back bad, 78/127 (8.9% damaged). Don't know why, perhaps just hit it the US server at a bad time.

Ticket still open, no response.

Damn..it's really disappointing.

Please, send these results to astraweb...

I wonder what' going on with AW.. as in general.. have they run out of money to pay for a proper infrastructure\hardware\software support etc.

Day 7/192 hours:

Astra/US - 13/127 (1.1% damaged)
Astra/EU - 19/127 (3.3%) damaged
Astra/US+EU as fills - 13/127 (1.1% damaged)

Both servers continue to slowly degrade, still no reply to the ticket I opened a week ago.

Day 8/216 hours:

Astra/US - 13/127 (1.1% damaged)
Astra/EU - 18/127 (2.9%) damaged
Astra/US+EU as fills - 13/127 (1.1% damaged)

EU slightly improved, first time that happened, perhaps it's because the Atlantic trans-oceanic link was slightly less loaded due to it being the weekend. We'll see if it increases error rate again in the coming days.

Finally got a response to the ticket I opened on Astraweb, they are investigating. Will continue to check the test file I uploaded over a week ago, and the several nzb's going back 6 months or so to see if I see any change, once I see any change to the test file.

Wee shall see when/if things change.

Day 9/240 hours:

Astra/US - 13/127 (1.1% damaged)
Astra/EU - 55/127 (10.9%) damaged
Astra/US+EU as fills - 13/127 (1.1% damaged)

EU errors jumped, maybe because of usual Sunday PM problems; it will be interesting (as usual) to see what the next day yields.

At this time, don't see any improvements in Astra/US as of yet.

Day 10/264 hours:

Astra/US - 16/127 (1.9% damaged)
Astra/EU - 23/127 (3.4% damaged)
Astra/US+EU as fills - 15/127 (1.8% damaged)

Both servers continue the downward trend; I ran a few nzb's upwards of 8+ months previous, and saw no change in the amount/number of damaged parts, so nothing seems to have changed as of yet.

Day 11/288 hours:

Astra/US - 116/127 (20.0% damaged)
Astra/EU - 121/127 (33.1% damaged)
Astra/US+EU as fills - 116/127 (20.0% damaged)

Well, somethings going on; at first, I thought (and it's still somewhat possible) that there is some problem with the transmission system (I'm on Comcast, and 30-60 days ago they were having tons of problems in my area, so much so they gave everyone a $20-30 rebate two months in a row (and anyone who's dealt with them knows this is really something out of the ordinary) but I use a vpn so can route things around and head into either the US/San Jose server or the EU/Amsterdam server by several different routes, and they all came up the same, although some speed/throughput differences, but the same error rate.

Will have to see what happens tomorrow.

Did more testing of my system/transmission links, and found that everything is working 100% (downloaded and tested my test files from Blocknews). There is either something serious going on with the tier one inputs to Astra/US (but would have to be mirrored by Astra/EU) which would mean either Level3/Cogentco, or something in the front-end of both Astra/US and EU. I'd tend to thing it's the front-end of both plants.

Astra is obviously doing something (at both plants); I'll continue monitoring it until things 'settle down' and give some reasonable data, but I'll continue to post daily updates as to the 'situation'.

No change on either plant of the time/date stamp on this message; both are experiencing massive error rates on my test files, will test some of the older files in a bit; the automerge function on this board is set WAY to loosely, it shouldn't be merging messages 4.5 hours apart.

Things still looking pretty sorry, getting lots of connection errors, resets, you name it.

Other servers (Giganews/Blocknews) both operating without any problems at all, despite being 2-400 miles further from me (in the case of Giganews/US in LA) or 2000+ miles (in the case of Blocknews/US in Virginia); if one watches the connection speed, you can see the connections to Astra are showing intermittent speeds and such while Giganews/Blocknews are running full speed ahead without any slowdowns at all.

There may be some problems with Level3 around the SF/SJ/SC area, I can't 100% confirm this, but it could be contributing to the connection problems with Astra/US. Those who follow (or try to) these kinds of problems will remember that less than a year ago, Level3 ran into problems with it's tier1 Cisco routers when they attempted a f/w upgrade, that caused nothing but tons of problems for a couple weeks. All we need is to have two major problems beating their heads against one another.

As far as Astra is concerned, folks need to remember that the last time (2-3 years ago) that massive retention failures happened, it took at least 2-3 weeks to fix things, and it did get worse, much worse, before it started getting better. If, of course, it does get better this time; we'll just have to wait and see.

Still watching this thread... and yes I hope they figure what is wrong out too. :unsure:

The test file I posted some 15+ days ago has been coming up >30% corrupted parts for the last week+, on both US and EU servers.

No real change on the 'older' (1-6 months) stuff that I can see (upwards of 10-20% corrupted), I haven't gone back to the really old stuff (3+ years) to see of that has changed any, but will in the next few days if I get the time.

Again, it may take upwards of a month to see any real improvements, but I'd say that without a doubt, this is the worst failure I've seen in Astraweb in 15+ years of use.

"Houston. We're getting our first look at the service module now. One whole side of the spacecraft is missing. Right by the high gain antennae a whole panel is blown out, right up. Right up to our heat shield."

Quote:

---

Originally Posted by megabyteme

"Houston. We're getting our first look at the service module now. One whole side of the spacecraft is missing. Right by the high gain antennae a whole panel is blown out, right up. Right up to our heat shield."

---

My god, it's full of stars.


EDIT: Astra is still borked.

Quote:

---

Originally Posted by Beck38

Things still looking pretty sorry, getting lots of connection errors, resets, you name it.

---

Juice boxes. Are you getting lots of juice boxes? While you're out, can you pick up a roll of aluminum foil? Oh, and some plastic bags. Wait, no, I'm picky about bags. Fuck it, just the aluminum foil. You know what, I could use some juice.

At over 25 days, I don't see any improvement whatsoever in any of either the 'test' file posted or on any previous files posted in the last 6+ months. Astra sent me an update on my ticket saying that they've 'fixed' everything. I don't see it at all.

Just for 'fun' I re-posted the exact same test file (but in a different newsgroup) but through Giganews. We'll see how that fares on either US or EU Astra.

UPDATE: Came through 100% on Astra/US and EU (So Giganews propagated and Astraweb received just fine). Now we'll see (once again) how the files degrade over time (most probably).

No change after 24 hours on the new posting (still 100% on both US and EU).

File posted 30 days ago still pathetic yielding around 30% corruption on both US and EU.

I gave the Astraweb folks a fair piece of advice on how to track server corruption, maybe they'll take it or maybe not.

I get better completion rate these last days.

Quote:

---

Originally Posted by MrBogus

I get better completion rate these last days.

---

Which nzb, how old, which server? Virtually nothing I d/l from about 2+ weeks old to 6+ months is pretty hosed, same from either Giganews or Blocknews are 100% complete.

Quote:

---

Originally Posted by Beck38

Quote:

---

Originally Posted by MrBogus

I get better completion rate these last days.

---

Which nzb, how old, which server? Virtually nothing I d/l from about 2+ weeks old to 6+ months is pretty hosed, same from either Giganews or Blocknews are 100% complete.

---

elementary s03 DVDRip from a couple of days ago was 100% complete. In astra EU.

You just answered the question; if the file was posted only 'a couple of days ago' then of course it's 'ok'. Keep that nzb and give it a try 2-3 weeks from now, you'll see distinct errors creeping in. Give it a month or two, and unless it has a huge amount of pars, unrecoverable.

UPDATE:

The Giganews posted test tiles took their first errors, right at 5 days in. .1% (both US and EU), but there nonetheless.

If it follows the previous tests, it'll start getting really bad (>10% errors) around 10 days, and drop off a cliff around 20 days (>20% errors).

Those earlier test files are getting really bad, exceeding 45% errors at the 30 day level.

NO response from Astra as to my latest update (4 days ago) to the ticket I originally opened.

I understand now what the problem is. I will try those nzbs in a few weeks.

Exactly how the retention degrades is, to me, a really good question. It's been 20+ years since I ran a usenet plant (either did so or provided technical assistance to folks going back to the mid-80's), and it appears that the Highwinds group got tired of whatever they were using several years ago, and spent the money to develop their own NNTP software, which I gather they transitioned all of those plants they bought up to that 'standard'.

Giganews in particular is proud of their own 'in-house' software development team; I don't think they have it available on the open market for any other provider.

Don't know what Astra uses, there's no information as to what they run (on their website), although there are copious 'upgrade' messages abounding ever few months going back years, so they may have either some software they developed themselves, took an older package (that's no longer actively supported), and are keeping it running by making 'improvements' (my guess), and what is causing these degradations (that keep happening at pretty regular intervals) may be something buried somewhere in the original code they haven't yet figured out.

If so, they need to have a very rigorous error checking program to catch when things begin to go 'off the rails', and quite obviously they don't. What's interesting to me is that as things go south after a few days/weeks, it stays pretty bad for several months, then going back further things 'magically' get better, at least the things posted 6+ months ago do.

It may be that their plant s/w transitions posted articles from 'near-term' storage to 'long-term' after a few days, then to even 'longer-term' after a month or more, and that's where the errors creep into the 'system'.

Whether or not things posted right now will get better (after getting very much worse), is probably a crap-shoot, and probably (!) they'll figure out what's causing the degradation before we hit that point. I have, upon occasion, done reviews of 'cloud' systems that were being run for large corporations, and found that the checking programs they had in place had holes one could drive a Mac truck through, and from what I see with Astra, it's about the same.

I've been reading your reports with interest Beck38. I'm sure you don't need any 'atta boys' but I do appreciate what you are doing and the time you have spent monitoring astraweb. Thanks for posting your findings.

Beck38, I suffer from Astraweb's mediocre performance as well and I appreciate all your efforts very much! Thanks a lot.

Beck38...

It is really appreciated on all the hard work and spare time you have to do this study on Astraweb, but if anybody is not locked into a long term deal (which is nuts to do it the way UseNet is today and hope you agree??), why the heck would you even stay with the provider??
I am and always will stick with Giganews , and yes after so many days things start do degrade or disappear(in some cases), but Usenet today, you really have to budget to have 2 providers (one in the US and one offshore), if you look back and want something posted lets say 1 year ago. And that would also depend on what binary group it was posted in, plus or if it was removed, which I am still skeptical of , considering that one provider it is gone or downloading with lots of errors, and the same NZB used with another UseNet provider it is all there and have no problems downloading. But the automatic response is it is gone and someone requested it DMCA.
You really do have to budget today to use Usenet, I really don't think there is any way around that unless you choose to move to Torrents.
And the big problem with any of these Usenet providers is..... They really don't give a shit!!!
Giganews may answer you and see if there is a connection problem but really do they have anything to do with what is being posted or taken down (I mean the operator you speak to)?? I would think not...
I went back and forth with Astraweb for a while, and finally said I had enough, and to save what ever to be locked into a long term with anyone in this Usenet business is just ridiculous...And you do have to raise your budget for using Usenet today as well.....
Again what you are reporting is very interesting and appreciated, but in reality anyone who stays with a provider that they are not getting there needs or wants from the service.... Cancel there Ass and try a new one. It is not like there is a shortage of them right??

The next question is what alternative would you suggest?? Us or Offshore??
That to me would be better information, plus I am always willing to try out new providers.....

PS. Some private NZB sites also re upload files(members rename them plus do some of there own re encodes) to other binary groups as well, to try to hide them and still give you access(as long as your Usenet provider has/gives access to that binary group (another issue with some providers) before they are found and either removed or blocked access (like I said I am still skeptical on the full removal of the files or just blocked access).

The basic problem is, despite what a lot of folks (even IN the US think) a large majority of the US population lives not on the east coast (where many usenet plants, huddled around 'telecom row' in east Virginia/DC are), but on the west coast. If one watched US television news, for example, and where the political 'centers' are, one would come away with the idea that Iowa, New Hampshire, and South Carolina have huge populations and the majority of electoral college votes, yet nothing would be further from the truth. (I'm old enough to remember 50 years ago before all the gerrymandering, and states like Washington, Oregon, and California were the last primary states, and made a difference; I might add those states have more electoral votes and larger populations than ANY of the so-called 'primary' states that run the parties now).

So as it stands, there are two major providers on the west coast, Giganews (LA) and Astraweb (San Jose). Pricing wise, one is 3-4 times as expensive as the other. Yes, one can use one of those Virginia-based plants, but one's 'bits' need to travel 4000 miles cross-continent; when the ISP speeds were 'slow', it probably didn't make much difference, but with 50-100Mb/s being the 'standard' these days, getting that performance is hard to impossible; if one was thinking that getting things from Europe (Amsterdam) was any better, forget it: I get, on average, around 20Mb/s yanking bits 'across the pond' and then across the continent.

So, it comes down to how much time (and effort) one want's to go through to (perhaps) grab what one wants to.

Astra is cheap, pure and simple. It would be nice if Supernews was still on the west coast, like it was 20 years ago (Mountain View, CA). But it's now in Virginia as well. Again, too much is 'eastern centric'.

Just for fun, I just re-ran a d/l from Blocknews (hq in Virginia) and the speed to the west coast (San Jose/Santa Clara) was 40Mb/s at best, where Astra easily swamps out my ISP bandwidth at 100+Mb/s. So things would take over twice as long traveling across the continent.

So, even forgetting about the price differential, that 1/3rd of the US really can't use those eastern centric plants.

Beck38....

Why are we now talking about speeds?? I am in Canada and I never come close to maxing out my ISP (250Mbps and get 80-120 on average, but that could be because of my older pc to process the downloads even know it is a gigabit Ethernet connection), who really cares?? it is still faster than Torrents....

Yes speeds do matter in a small part (how many connections are you testing??), but the retention far out ways the speed, if you cant find the best of both worlds right??

And doesn't Giganews have junction or port locations all over the place/world (may be wording that wrong my apologies), and to be honest I really don't care.....
To me some information is really not needed, I use them, they fill my needs, and I stick with them(tried a bunch and always go back to them and I pay $19.99 US a month with all the unlimited crap. I didn't know astraweb has that much cheaper price??)
As the Usenet providers out of the Amsterdam and Netherlands there is a speed difference but not a huge difference (Maybe in Canada it is different giving you the benefit of the doubt). But the retention can be day and night for older files in certain Binary Groups that I can tell you, especially being in this game just as long as you, and seeing the changes over the years..
Again if you are a regular user and you do most of your downloading daily, and I would think most people do that are heavy users of Usenet. Any big provider is pretty much the same, but your testing and weeks later without pars in the Big Binary Groups you do see depletion on files and it seems the offshore providers do get access or better retention, Why?? I have no bloody Clue nor do I care. My purpose is to get what I want in the easiest way possible, and I am now seeing a bigger cost to do that, that's all!!.
Now if a friend asked me to see if I could get something, and it was not re uploaded and it is posted a while back, and can tell you without a doubt depending on the Binary Group it was posted in, Giganews doesn't always grab the files, but my offshore account does, hence the extra cost...
Now my comment that if I Send a ticket into Giganews and yes they do respond fast (live chat access!!), if my speeds are good and the connection is strong, that is as far as it goes with them, they don't give a crap what is in the Binary Groups nor if you can get the files or not.
For you worrying about East Coast and West Coast means nothing to me... Someone uploads the files to the Binary Group, and I want a provider that will give me the ease to get them without doing more work (getting lazier from the old days loading headers and jamming up my PC with Xnews), if the speed is a little slower, oh well, that I will live with, but loading all the par files to fix the broken ones all the time or not able to get the files at all, that is a pain in the Ass!!!!.

Again Supernews is part of Giganews and I used them for a while, the speeds were good but the reliability is still much better with Giganews....and why or technical crap means nothing to me I used them both and Giganews was better for me...

I know you are a smart guy, but I am going to ask you when you do the speed tests you are actually downloading something and not just testing the connection right?? I do know in my experience that downloading from different Binary Groups do change the download speeds as well, and I assume it is the same for you right??
I did subscribe to a offshore account and it offered a 50Mbps deal, and I felt that was enough for me at the time for my backup provider, and that maxed out on most of the Binary Group downloads, and sometimes went over, so I don't really know how accurate Downloader I use really is...

Do you have any other offshore Usenet providers you would recommend?? Again speed is second to retention....

-

Quote:

---

Stevie: Trevor, I'm worried about you.
Trevor Reznik: Don't worry. No one ever died of insomnia.
Stevie: [giggles] I hope not. You're my best client. Can't afford to lose you.
Trevor Reznik: Gee, thanks.

---

-

Quote:

---

Originally Posted by shaina

Beck38....

I do know in my experience that downloading from different Binary Groups do change the download speeds as well, and I assume it is the same for you right??

---

All modern usenet s/w has no differentiation between newsgroups, they are all handled the same. Way back 15+ years ago that was true, not now unless that plant is running a VERY old s/w.

I've never seen any plant where there is much of any difference in d/l speeds due to the newsgroup, in at least that 15+ years. In fact, I don't believe I've seen much difference at all in the AGE of the files, I d/l things in the 5+ years range all the time, and have no problem swamping my link.

Quote:

---

Originally Posted by Beck38

Quote:

---

Originally Posted by shaina

Beck38....

I do know in my experience that downloading from different Binary Groups do change the download speeds as well, and I assume it is the same for you right??

---

All modern usenet s/w has no differentiation between newsgroups, they are all handled the same. Way back 15+ years ago that was true, not now unless that plant is running a VERY old s/w.
I've never seen any plant where there is much of any difference in d/l speeds due to the newsgroup, in at least that 15+ years. In fact, I don't believe I've seen much difference at all in the AGE of the files, I d/l things in the 5+ years range all the time, and have no problem swamping my link.

---

In your wording I can assume you mean a Binary Group(example alt.binaries.triballs), I have in Canada especially the bigger more popular ones the people frequently upload too.. and when the files are uploaded to a lesser one used I see a slight increase in speed (a difference of maybe a minute or so on a bigger file to be completed)
And to be honest I have never seen the plant or server farms where the files are actually stored.. and nor do I care...

Now you mention going back 5 years and the retention is still good??(you say d/l things I assume you mean upload right??) What binary group are you downloading the files from that they are still whole and not degrading?? is it text files or actually binary files??
and What Usenet provider are you using to get them?? Is it a US or Offshore provider??

Simple Questions .... I would appreciate simple answers not technical jargon that is not necessary to know

Thanks

Virtually all providers list the retention level, most right on the front page of their web sites. For instance, Astra 'claims' 2572, Giganews 2367, Blocknews 2400(+) days; that all generally works out to March 2009 or earlier (Astra works out to August, 2008, which is actually when most plants issued press releases saying they weren't going to let any binaries 'roll off'. Most plants have text retention about double that, so we're talking about 16+ years back.

As I've said on many occasions, this amount of retention is not matched by the public search engines (NZBIndex/Binsearch) out there (3+ years at best) so one has to use other means to grab the nzb's. Many Newsreaders have built-in searchers, which are linked to one provider or another usually (example: Newsrover uses Giganews, but if one has a GN account, their 'MIMO' can be used to do the same).

Use the Google to find the specs on usenet plant s/w, it will give you information on how it works.

I grab nzb's that are several years old all the time, and well within the retention of all the premium providers, all the time. That's the beauty of Usenet, as opposed to torrents. Of course, if all you are interested in is the latest low-quality TV shows and Hollywood junk, then going that route will probably work better in the short term.

Beck38....

I agree with you, but private NZB sites do offer NZB's or call them links to access files further back, but using Giganews and going back even 2 years, there are times that the files are just not accessible, but a offshore account seems to download them fine, and that is using the same NZB Link, why or how it works again, I don't care, all i care about, that it does work.

As for torrents... To me they seem to get the pirated shit faster than Usenet does, the only advantages to Usenet for me is, if it is a older movie or tv show, game etc. I am looking for, if there is no seeders on Torrents, you are screwed, with Usenet you have more direct access and don't have to rely on anybody once it is uploaded to a server, and that does add extra costs.
But your comment on retrieving Usenet files I do agree the best way to search or access Is by a Header or File name using Newsrover type programs, but I have just become lazy and use/rely more on the NZB way to get what I am looking for, plus some of the ways the uploaders are naming these files are not as easy to spot or know what they are unless a NFO is attached with them. I now leave it to people that have the patience to do the raw searches for me and it is much appreciated.

And you do know that Torrents also have 1080 versions of everything as well right?? Anything you get on Usenet is all available on Torrents plus more(remember my first choice is Usenet).. Now downloading at speeds I like, well Usenet just blows it away...

Now I noticed you mentioned Astra, Giganews and Blocknews ....Have you tried any others you may want to share or recommend??

Quote:

---

Originally Posted by shaina

And you do know that Torrents also have 1080 versions of everything as well right??

---

They absolutely DO NOT. Of everything I d/l, maybe, at best, 1 out of 1000 is available in 1080P on torrents (notice I said 1080P, NOT 1080i), most are in 720P.

There are a fair number of folks who 'cross-post' things from torrents to usenet, but again, usually are all 720P resolution. I post around 2-4 1080P/HDaudio movies per week to usenet, when I'm in 'full production' (everything I've ever processed is on a RAID array), and in the last 6+ years I've yet to see any of them show up on any torrents (when I look for them); now, I could easily miss them, I'll grant you that, but as they are all 1080P/HDaudio, torrent folks (who have, again, apparently the hots for 720P video) they are probably simply passed over.

Of all that I have, zero have been 'taken down' over the past 6-7 years (the way they are hidden is extremely simple yet effective). I re-test the nzb's all the time, randomly, and that's how I find 'gaps' and 'fades' in poorly run server plants (unfortunately, like Astra), but have over the years identified such even on Giganews (but is extremely rare, and when I do, they have jumped on it and repaired the problem quickly).

I've used other plants than Astra, Giga, and Blocknews 'back in the day', but they are the only ones I use consistently these days, although I do have some blocks left on Usenet-News as well as others, that once in a while I'll check just for fun.

I came to the conclusion long ago that folks who get things taken down (quickly or slowly) simply don't do two things, they don't sit down and figure out good schemes to hide things efficiently, and don't check their postings to see when/if they get taken down, and change their hiding scheme and re-post. Most simply get into this 'wack a mole' routine where they figure folks have a 'quick d/l' setup that will grab the files quickly before it gets pulled down, and if you don't run a machine 24/7 you're just simply out of luck because it will never be re-posted. Which means that all this huge amount of retention means zero.