Difference between revisions of "PresidentialScraper"
Brandon Bot (talk | contribs) (Refactored to use standard open task categories Category:OpenTask, Category:DevelopmentTeam) |
Brandon Bot (talk | contribs) (Refactored to use standard open task categories Category:OpenTask, Category:DevelopmentTeam) |
||
| Line 1: | Line 1: | ||
| − | <noinclude><big>[[OurWork]] < [[DevelopmentTeam]] < [[DevelopmentTeamPriorities|Priorities]] < | + | <noinclude><big>[[OurWork]] < [[DevelopmentTeam]] < [[DevelopmentTeamPriorities|Priorities]] < </noinclude>('''1''') [[PresidentialScraper]] ('''[[Who?|?]]''') {{JustTinyEditIcon|PresidentialScraper}}<noinclude></big> |
| − | |||
| − | </noinclude>('''1''') [[PresidentialScraper]] ('''[[Who?|?]]''') {{JustTinyEditIcon|PresidentialScraper}}<noinclude></big> | ||
== What is the project? == | == What is the project? == | ||
| Line 25: | Line 23: | ||
* [[Portal:2008 Presidential Election/Social Stats (experimental)]] -- page used to test spike | * [[Portal:2008 Presidential Election/Social Stats (experimental)]] -- page used to test spike | ||
| + | </noinclude> | ||
| + | [[Category:DevelopmentTeam]] | ||
[[Category:OpenTask]] | [[Category:OpenTask]] | ||
| − | |||
| − | |||
Latest revision as of 21:01, 7 February 2008
What is the project?
Convert spike to compost ... automate the retrieval of all the stats used on Portal:2008_Presidential_Election, increase the freshness of the data.
See also Quote-Back Technology
Why is it important?
- Very hot data
- Takes a lot of time to manually update stats
- Moves us towards implementing Quote-Back Technology
- Eventually people will begin to consume our data and the campaigns themselves may begin to keep track of what is happening on Portal:2008_Presidential_Election
DoneDone
- Use compost to retrieve the data instead of the hacked heuristics
- Code is well tested
- Automagically refreshes the page every day
- Calls a human when values fall out of the expected norms
- BONUS: Create a machine readable datafeed of this data that others can consume.
Notes
- Portal:2008 Presidential Election/Social Stats (experimental) -- page used to test spike
