Difference between revisions of "Rewrite PageCreationBot"
Arif Iqbal (talk | contribs) (Added the schema) |
|||
Line 16: | Line 16: | ||
== [[DoneDone]] == | == [[DoneDone]] == | ||
* Creates news pages based on a template | * Creates news pages based on a template | ||
− | |||
* Monitoring and logging have been added (tests whether or not the bot succeeds) | * Monitoring and logging have been added (tests whether or not the bot succeeds) | ||
** Output to a log file. Either on each squal box (with aggregation) or an NFS volume. Have emailed Ethan and Michael about this. | ** Output to a log file. Either on each squal box (with aggregation) or an NFS volume. Have emailed Ethan and Michael about this. |
Revision as of 18:46, 11 September 2007
What (summary)
- New page-building bot
- Still relies on Java/Tomcat to do crawling (for now)
- Carefully tested
Why this is important
- We need to have control over the pages that our created on our site.
- The old bot was known to pollute the database; we need control over all the access points that could screw up our data.
- Gaining mastery over the code so that we can add new features easily.
DoneDone
- Creates news pages based on a template
- Monitoring and logging have been added (tests whether or not the bot succeeds)
- Output to a log file. Either on each squal box (with aggregation) or an NFS volume. Have emailed Ethan and Michael about this.
- Hooked in to all the old points Bot was
- Not exactly the same points, but the same end-user functionality.
- Projects:BotTest problems fixed
Bot insertion points into Mediawiki
- /wiki/skins/common/generatePage.js (and some other javascript that we should remove)
- /wiki/extensions/AboutUsDomainRedirect/SpecialRedirectToDomain.php (deprecate and point to CaseSpace)
- /wiki/extensions/CaseSpace/CaseSpace.php (Ultimately, here is where the magic will happen.)
Schema
- New schema location http://images.aboutus.org/images/b/be/Aboutusbot_new.zip. Its an sql file and not a compressed one.