This dissertation will realize data cleaning in SQLServer2000, and introduce method of data cleaning based on the character matching of the crawler. In the phase of user identifying, method based on Cookie, ip, and agent is used.

• 本文通过SQLServer2000实现了基于数据库的数据清洗任务,并提出了一种网络蜘蛛的字符匹配模式的清除方法。