i'm writing a usenet server in go from scratch and v0.1-p1 is online
speed is limited and reading articles via msgnum (in groups) is quite
slow because it scans the overview to find the msgid&hash needed to
fetch data from storage.
speed is limited and reading articles via msgnum (in groups) is quiteIs that to be changed?
slow because it scans the overview to find the msgid&hash needed to
fetch data from storage.
I tried it, it took ~10 minutes to receive 300 articles.
Hello World!
i'm writing a usenet server in go from scratch and v0.1-p1 is online =)
got it more or less stable running many weeks, testing and importing. performance is brutally good and very low to no cpu usage.
I've hidden groups with only 1 article
results in 289k groups now.
Thunderbird has issues receiving the LIST, sometimes.
Takes forever... maybe size problem?
LIST is 14MB at the moment.
Was >20MB unfiltered (442k groups).
On 2023-09-04, Billy G. (go-while) <[email protected]> wrote:
Hello World!
i'm writing a usenet server in go from scratch and v0.1-p1 is online =)
Very cool, please let us know when you upload it to a git repo or
something so we can check and try it out and maybe submit code.
ReK2
Happy Hacking
On 18.09.23 15:48, Jon Ribbens wrote:
Have you created the newsgroups list by just assuming that everything
mentioned in any article's Newsgroups: line is a valid group, or
something? 442k is an order of magnitude higher than the actual number
of newsgroups.
yes. catch all. we can filter later.
That's not a reasonable way of managing the newsgroups list.
Have you created the newsgroups list by just assuming that everything mentioned in any article's Newsgroups: line is a valid group, or
something? 442k is an order of magnitude higher than the actual number
of newsgroups.
On 18.09.23 16:56, Jon Ribbens wrote:
That's not a reasonable way of managing the newsgroups list.
what is reasonable if you just want to import all backups from earth?
On 2023-09-18, Billy G. (go-while) <[email protected]> wrote:
On 18.09.23 16:56, Jon Ribbens wrote:
That's not a reasonable way of managing the newsgroups list.
what is reasonable if you just want to import all backups from earth?
To get an active file from an existing well-run full-feed server
and use that I suppose, and have some code to validate and process
rmgroups, newgroups, and checkgroups. Making it so every typo ever
made creates a new newsgroup just completely destroys the concept
of the well-organised and managed hierarchical newsgroup structure.
Jon Ribbens wrote:
On 2023-09-18, Billy G. (go-while) <[email protected]> wrote:
On 18.09.23 16:56, Jon Ribbens wrote:
That's not a reasonable way of managing the newsgroups list.
what is reasonable if you just want to import all backups from earth?
To get an active file from an existing well-run full-feed server
and use that I suppose, and have some code to validate and process
rmgroups, newgroups, and checkgroups. Making it so every typo ever
made creates a new newsgroup just completely destroys the concept
of the well-organised and managed hierarchical newsgroup structure.
That's a great way to do it, but it won't work if trying to import old articles.
There were a lot of newsgroup names that no longer exist that are used
in the old articles, and won't be in the active file of most modern
servers.
If you have an archive of old messages you're importing, you might be
lucky enough for it to include the old control messages, enabling you
to construct a timeline of newsgroup creation and deletion...
What's reasonable may differ of course depending on whether the
purpose is "a read-only historical archive of past newsgroups",
or "a live news server for reading and posting new articles".
If it's a hybrid of the two then perhaps a hybrid approach is
required.
On 18.09.23 18:46, Jon Ribbens wrote:
If you have an archive of old messages you're importing, you might be
lucky enough for it to include the old control messages, enabling you
to construct a timeline of newsgroup creation and deletion...
what's the point in importing old messages only to delete their groups
later? this doesn't make sense.
On 18.09.23 18:46, Jon Ribbens wrote:
If you have an archive of old messages you're importing, you might be
lucky enough for it to include the old control messages, enabling you
to construct a timeline of newsgroup creation and deletion...
what's the point in importing old messages only to delete their groups
later? this doesn't make sense.
| Sysop: | Keyop |
|---|---|
| Location: | Huddersfield, West Yorkshire, UK |
| Users: | 715 |
| Nodes: | 16 (2 / 14) |
| Uptime: | 155:00:55 |
| Calls: | 12,092 |
| Files: | 15,000 |
| Messages: | 6,517,690 |