Forum Services Upgrades & Problems (Updated 2006-03-10)

[Spec8472]

This will be an ongoing thread to let you know about what's planned and has happened around sennadar.plebian.net and the forums.

To start off, there's been some trouble recently with the Database side of things.
I've logged a fault with the host, and they've said that there's been a series of problems with the database. Things appear to be working most of the time, with the exception of the two database outages.

There's some planned upgrades as far as forum niceties go, but nothing major in the near future.

I'm looking for a bit of software (PHP or Perl coding, with MySQL backend) which will make accessing and uploading books/chapters a lot easier.
Kind of a CMS (Content Management System), but more oriented around a Universe/Series/Book/Chapter type of structure.

Bonus points if it can also do conversion from DOC/RTF to HTML (linking to a specific CSS, and use SSI or something similar to allow standardised navigation), PDF, and other types of eBook formats.
This is a longer-term project, I imagine - and if nothing exists which does the job, I'll see if I can get someone to write it.

[Shadowhawk]

I'm looking for a bit of software (PHP or Perl coding, with MySQL backend) which will make accessing and uploading books/chapters a lot easier.

Kind of a CMS (Content Management System), but more oriented around a Universe/Series/Book/Chapter type of structure.

Bonus points if it can also do conversion from DOC/RTF to HTML (linking to a specific CSS, and use SSI or something similar to allow standardised navigation), PDF, and other types of eBook formats.
This is a longer-term project, I imagine - and if nothing exists which does the job, I'll see if I can get someone to write it.

On my backup site http://193.0.122.19:8010/sennadar/ I try to make HTML version of FelBooks like the Baen Library layout (for now only "Demon's Bane", and it is work in progress). I have not it all automated, but I think I will when I do decide what parts are to be done in HTML (paragraph numbering?) and what in JavaScript (in frame version?). There will be shell or Perl script for cleaning HTML, creating the head, header and footer etc.

I use koconverter from KOffice from KDE, but it is not completely CLI tool: it needs some clicking on the koconverter dialog. Nevertheless it gives quite nice, clean HTML in it's "light" version (HTML, light, UTF-8).

Some time ago I have tried some Linux CLI tools for converting DOC/RTF files to HTML, LaTeX -> PDF, PostScript and plain text (not all tools included all formats). The tools included <tt>laola</tt>, <tt>antiword</tt>, <tt>word2x</tt>, <tt>catdoc</tt> and <tt>wvWare</tt>. I have found <tt>Docvert</tt> lately, which is PHP service to convert DOC files using OpenOffice.org.

<hr>
BTW. there is problem with my Website field: it keeps vanishing from my profile. Perhaps phpBB doesn't like numeric URLs; I hope that it can be configured away (or somebody will point me to free service which will make my IP address into ordinary name)..

[Shadowhawk]

To admins: perhaps we should create separate Forum and/or separate Category for discussions and announcements related to Sennadar Books site, Sennadar Backups, Sennadar Forum and forum software, Sennadar Wiki etc. Perhaps Category should be named "Sennadar sites" or "Sennadar on the Web" or "Sennadar WWW" or simply "Web" (if there would be separate category) and Forums "Sennadar Files", "Sennadar Forums", "Sennadar Backups" (with locked/moderated threads for each backup site, and one announcement thread for new backup sites, moving etc.), "Other Sennadar" (for Wiki, scripts, photos, avatar recommendations, photo hosting recommendations). In some cases it could be better to use "FelBooks" instead of "Sennadar".

Alternatively the Forum (one) could be in General Category and named as the propositions for Category, or there could be the Category and single Forum both named the same.

Perhaps a separate "Announcements" Forum in General category...

The threads which should/could be moved include:

• New Anti-Spam Measures (or to "Announcements" forum)
• Forum Guidelines - Read before Posting (might be left in General forum)
• Sennadar Wiki; Central Repository of Knowledge (e.g. updates, calls to write)
• Forum Services Upgrades & Problems (for engine updates and problems)
• Changes & Updates to Forums (for all mods added, and mods added discussion)
• Forum niceties: the wish list! (wishlist, mods to add etc.)
• Attn Webmasters: Links to the Sennadar Forums (or to "Announcements" forum)
• In what format do you read FelBooks (poll)? (perhaps yes, perhaps not)
• Forum conversion - done! (historical)
• Migration to New Board Software (historical, also some ideas)
• Finished new backup site (or extract only relevant info)

Have I missed anything?

[Spec8472]

I try to make HTML version of FelBooks like the Baen Library layout (for now only "Demon's Bane", and it is work in progress). I have not it all automated, but I think I will when I do decide what parts are to be done in HTML (paragraph numbering?) and what in JavaScript (in frame version?). There will be shell or Perl script for cleaning HTML, creating the head, header and footer etc.

My preference would be, as much as possible - keep Javascript in a seperate .js file, which is linked in a standard header, and binds to named events. It makes it a lot easier to update the functions if you can do it in one place.
Also, header/footers like 'Next Chapter', etc can all be kept in a seperate area, and only have the book content itself in the HTML, and the server can do SSI to bring those standard headers in.

Also, Frames arn't great - they don't work on handhelds too well (any space you use is almost always going to be too much, when you only have a few hundred pixels in width and height to work with)
Though, I do like Baen's paragraph numbering - very good for 'bookmarking'.

I use koconverter from KOffice from KDE, but it is not completely CLI tool: it needs some clicking on the koconverter dialog. Nevertheless it gives quite nice, clean HTML in it's "light" version (HTML, light, UTF-8).

Some time ago I have tried some Linux CLI tools for converting DOC/RTF files to HTML, LaTeX -> PDF, PostScript and plain text (not all tools included all formats). The tools included <tt>laola</tt>, <tt>antiword</tt>, <tt>word2x</tt>, <tt>catdoc</tt> and <tt>wvWare</tt>. I have found <tt>Docvert</tt> lately, which is PHP service to convert DOC files using OpenOffice.org.

I'll keep that in mind, thanks.

BTW. there is problem with my Website field: it keeps vanishing from my profile. Perhaps phpBB doesn't like numeric URLs; I hope that it can be configured away (or somebody will point me to free service which will make my IP address into ordinary name)..

DynDNS is good, and free (no spam either) for a Dynamic or Static DNS hostname.
And yeah - it seems PHPbb doesn't like IPs as the hostname part of the URL.

[Shadowhawk]

I try to make HTML version of FelBooks like the Baen Library layout (for now only "Demon's Bane", and it is work in progress). (...)

My preference would be, as much as possible - keep Javascript in a seperate .js file, which is linked in a standard header, and binds to named events. It makes it a lot easier to update the functions if you can do it in one place.

Also, header/footers like 'Next Chapter', etc can all be kept in a seperate area, and only have the book content itself in the HTML, and the server can do SSI to bring those standard headers in.

Also, Frames aren't great - they don't work on handhelds too well (any space you use is almost always going to be too much, when you only have a few hundred pixels in width and height to work with).

Though, I do like Baen's paragraph numbering - very good for 'bookmarking'.

The abovementioned link points to my work in progress. I moved what I could to separate JavaScript *.js files; it helps also with debugging using JavaScript Debugger like Mozilla's Venkman, or Konqueror own.

The idea is that it should work equally well in frames, and without them: including remembering the paragraph you are in using cookies, and paragraph bookmarks using hash URLs/named anchor URLs. I'm not sure if this thread is good place to present my wishlist featurelist... I'd make the "Baen" more mature, and then announce it on Sennadar Forum for comments on design.

I guess that headers and footers could be inserted by server; but I'm more familar with PHP than with Apache's SSI.

[Shadowhawk]

To admins: perhaps we should create separate Forum and/or separate Category for discussions and announcements related to Sennadar Books site, Sennadar Backups, Sennadar Forum and forum software, Sennadar Wiki etc.

Perhaps a separate "Announcements" Forum in General category...

Thanks for taking this suggestion. I haven't though however that the whole forum to be locked. Separate threads locked, yes, perhaps even as far as making it default for those who can do it when creating new thread, but not the whole forum. Some threads here really could use some feedback. And there would be no feedback with locked forum.

I really think that locking the thread/forum should be really rare...

Update: Spec8472 said on IRC that locking the whole Forum is done because it is work in progress, and he is only part way through doing it... I'm sorry for jumping to conclusions...

[Shadowhawk]

Some time ago I have tried some Linux CLI tools for converting DOC/RTF files to HTML, LaTeX -> PDF, PostScript and plain text (not all tools included all formats). The tools included <tt>laola</tt>, <tt>antiword</tt>, <tt>word2x</tt>, <tt>catdoc</tt> and <tt>wvWare</tt>. I have found <tt>Docvert</tt> lately, which is PHP service to convert DOC files using OpenOffice.org

<tt>wvWare</tt> (wvHtml to be more precise) has online demo: wvHtml Online Demonstration (original version by wvWare at SourceForge "temporarily disabled due to security concerns"). Oops, it doesn't work.

[Spec8472]

Doing an upgrade at the moment.

Upgraded PHPbb to Version 2.0.18 (Security Update) (done)

Installed "File Attachment Mod" (done)

Slight Modification to RSS Feed (done)
- Now includes username of poster in title. Allows better integration with Google Personalised Home.

Note: Those found abusing* the File Attatchment Mod will have their access rights removed.

* = Uploading Porn, Hack-attempts, etc.

[Spec8472]

Howdy,

There's a planned outage soon affecting all plebian.net services (including the forums and wiki) lasting about 15 minutes sometime between the times specified below.

Times in various timezones:
USA - PST: On 2005-12-01 between 22:00 (10PM) and 23:00 (11PM)
England - GMT: On 2005-12-02 between 06:00 (6AM) and 07:00 (7AM)
Australia - AEST (QLD): On 2005-12-02 between 16:00 (4PM) and 17:00 (5PM)
Australia - AEDST (NSW/VIC/TAS): On 2005-12-02 between 17:00 (5PM) and 18:00 (6PM)

This outage is due to an upgrade being performed by the Webhost to the power supplies.

[Spec8472]

There may be periods of slow response or outage for the forums due to a DDoS (Distributed Denial of Service) attack on the web host.

Here's the message I recieved:
---
Hello Dreamhosters,

We're currently being hit by a fairly large Distributed Denial of Service
Attack.

We have things under control, for the most part, but the attack is
periodically changing and we're having to change our response along with it.

As different machines are used as targets of the attack, they may become
unstable. We're getting them back to normal as quickly as possible.

We're working with our upstream providers to keep the attackers away from
our network in first place.

Watch the Emergency Status page for future updates!

http://status.dreamhost.com/

The Happy Dreamhost Network Team!
----


(Interesting to note that the host has a Gbit link from their network)

[Spec8472]

There may be periods of slow response or outage for the forums due to a DDoS (Distributed Denial of Service) attack on the web host.

Looks like the attack is over.

[Spec8472]

Upgrade completed: PHPbb 2.0.18 -> 2.0.19

[Spec8472]

Lots more spam on the Wiki - I might just have to integrate the login systems between the Forums and Wiki.... :/

[Lochar]

That wouldn't be so bad actually, since my user/password are the same between the two.

[Spec8472]

That wouldn't be so bad actually, since my user/password are the same between the two.

Yep,

BTW: Last weekend I got bored, so I went and found the half-dozen or so places you need to edit, in order to make the "Caption" below your Avatar work.

It's sourced from the "Interests" field in your profile.