2214 Creepy, crawly computer words

Wine words are prettier than "Observed Web Robot Behavior on Decaying Web Subsites" nerd words.

• Robot Behavior
  crawling patterns
  contents decay at predetermined rates
  decaying subsites
  Spidering Hacks
  populating each with HTML
  words that are often labeled "pornographic."
  tar-zipped
  lowest-common-denominator
  Googlebot
  log rotation process
  pruning and cross-checking
  percentage of crawls
  non-resolving IPs
  most frequent single crawler
  a mix of human and robotic crawls
  we ignored crawls from unknown robots
  a host containing robot, crawler, spider or some similarly identifiable robot-style title
  log-resolve and whois databases
  final arbiter
  static bar graphs
  The green portion
  deep-crawling
  Wayback Machine
  resource decay
  begin a deep plunge
  research on live systems
  the vagaries and foibles