Friday, February 24, 2006

2214 Creepy, crawly computer words

Wine words are prettier than "Observed Web Robot Behavior on Decaying Web Subsites" nerd words.
  • Robot Behavior
    crawling patterns
    contents decay at predetermined rates
    decaying subsites
    Spidering Hacks
    populating each with HTML
    words that are often labeled "pornographic."
    tar-zipped
    lowest-common-denominator
    Googlebot
    log rotation process
    pruning and cross-checking
    percentage of crawls
    non-resolving IPs
    most frequent single crawler
    a mix of human and robotic crawls
    we ignored crawls from unknown robots
    a host containing robot, crawler, spider or some similarly identifiable robot-style title
    log-resolve and whois databases
    final arbiter
    static bar graphs
    The green portion
    deep-crawling
    Wayback Machine
    resource decay
    begin a deep plunge
    research on live systems
    the vagaries and foibles

No comments: