Difference between revisions of "CleanErrorLogs"

 
(Feeds don't work)
 

(9 intermediate revisions by 3 users not shown)



Line 1: Line 1:
Make sponsor/portal unavailable for routing
+
__NOTOC__
 +
 
 +
We need to monitor our error logs from time to time and clean out the errors.  Now seems especially important because our users have been getting the owls so much.  We're organizing the work here: http://www.aboutus.org/CleanErrorLogs
 +
 
 +
Our two most important logs may be followed on the squals using the following:
 +
: tail -f /var/log/httpd/aboutus.org-error_log
 +
: tail -f /www/aboutus/compostus/compost/log/production.log
 +
 
 +
http://www.aboutus.org/au_web_services/system_information/log_counts is also a very helpful analysis tool.
  
 
== Inconsistent DB ==
 
== Inconsistent DB ==
Line 7: Line 15:
 
Full table scan of revision, find the one with the missing wikitext ... what are we going to do when we find it?
 
Full table scan of revision, find the one with the missing wikitext ... what are we going to do when we find it?
  
== PageCache Race ==
 
ActiveRecord::StatementInvalid (Mysql::Error: Duplicate entry '1278324' for key 2: INSERT INTO `page_caches`
 
  
Catch this error and reload the page cache ... perhaps try the load after the create fails and only fail if the load after fails
 
  
 
== Duplicate User gives Owls ==
 
== Duplicate User gives Owls ==
Line 16: Line 21:
 
== Account Created Race ==
 
== Account Created Race ==
 
http://www3.aboutus.org/au_web_services/system_information/log?start=1428851935
 
http://www3.aboutus.org/au_web_services/system_information/log?start=1428851935
 +
 +
* Apart from a true race condition, this should be fixed now. --[[User:Ali Aslam|Ali Aslam]] 04:41, 3 June 2008 (PDT)
  
 
== JSON Errors associated with action catchup ==
 
== JSON Errors associated with action catchup ==
Line 33: Line 40:
  
 
create logger message to tell us which pages
 
create logger message to tell us which pages
 +
 +
* logging should begin after next deploy --[[User:Ali Aslam|Ali Aslam]] 06:00, 3 June 2008 (PDT)
  
 
== No revision for page ==
 
== No revision for page ==
Line 41: Line 50:
 
== Feeds don't work ==
 
== Feeds don't work ==
 
http://www3.aboutus.org/au_web_services/system_information/log?start=1428680724
 
http://www3.aboutus.org/au_web_services/system_information/log?start=1428680724
 +
 +
* Should start working after next deploy --[[User:Ali Aslam|Ali Aslam]] 04:47, 4 June 2008 (PDT)
  
 
== Connection with MW produces unexpected results ==
 
== Connection with MW produces unexpected results ==
 
http://www3.aboutus.org/au_web_services/system_information/log?start=1427762953
 
http://www3.aboutus.org/au_web_services/system_information/log?start=1427762953
 
== Mismatched # of mongrels in apache and monitor ==
 
Means that apache continually reports proxy errors ... diminishing the value of our error logs
 

Latest revision as of 11:47, 4 June 2008


We need to monitor our error logs from time to time and clean out the errors. Now seems especially important because our users have been getting the owls so much. We're organizing the work here: http://www.aboutus.org/CleanErrorLogs

Our two most important logs may be followed on the squals using the following:

tail -f /var/log/httpd/aboutus.org-error_log
tail -f /www/aboutus/compostus/compost/log/production.log

http://www.aboutus.org/au_web_services/system_information/log_counts is also a very helpful analysis tool.

Inconsistent DB

Couldn't find Wikitext with ID=15624778 http://www3.aboutus.org/au_web_services/system_information/log?start=1427149336 Couldn't find Wikitext with ID=15624987 http://www3.aboutus.org/au_web_services/system_information/log?start=1427251164

Full table scan of revision, find the one with the missing wikitext ... what are we going to do when we find it?


Duplicate User gives Owls

Account Created Race

http://www3.aboutus.org/au_web_services/system_information/log?start=1428851935

  • Apart from a true race condition, this should be fixed now. --Ali Aslam 04:41, 3 June 2008 (PDT)

JSON Errors associated with action catchup

utf8 issue?

ignore for now

http://www3.aboutus.org/au_web_services/system_information/log?start=1428214801

Duplicate Anonymous Users

Clean up at some point in time

inconsistent AuPageLookup (no page)

http://www3.aboutus.org/au_web_services/system_information/log?start=1428651435

go through and remove all AuPageLookup that don't have pages

create logger message to tell us which pages

  • logging should begin after next deploy --Ali Aslam 06:00, 3 June 2008 (PDT)

No revision for page

http://www3.aboutus.org/au_web_services/system_information/log?start=1428696571

Does and not short-circuit like && does?

Feeds don't work

http://www3.aboutus.org/au_web_services/system_information/log?start=1428680724

  • Should start working after next deploy --Ali Aslam 04:47, 4 June 2008 (PDT)

Connection with MW produces unexpected results

http://www3.aboutus.org/au_web_services/system_information/log?start=1427762953



Retrieved from "http://aboutus.com/index.php?title=CleanErrorLogs&oldid=15646218"