spidering

美 　英

• 網(wǎng)絡(luò)蜘蛛；蜘蛛程式；蜘蛛爬行

例句

When spidering or scraping, always obey the robots. txt file available on the server and incorporate it into your politeness policy.

在進行這種操作時，一定要遵循服務(wù)器上提供的robots.txt文件的指示，并將其結(jié)合到您的禮貌原則當中。

This exploration is done either using an automatic spidering engine, or by observing a user manually browse the site.

這個考察要么通過使用一個自動下載網(wǎng)站內(nèi)容引擎的方法，要么通過通過監(jiān)測一個用戶手工瀏覽這個網(wǎng)站的方式進行。

Results from spidering are recorded in the search engine's index or catalog.

蜘蛛爬行得到的結(jié)果記錄在搜索引擎的索引或目錄中。

Spidering agents are notified that certain FOAF files aren't encrypted for them, and the agents can then ignore those files.

搜索代理得到沒有為它們加密某些FOAF文件的通知，于是代理可以忽略那些文件。

Newer protocols, such as SOAP, make spidering much easier and less intrusive to normal Web operations.

一些新的協(xié)議，例如SOAP，會讓爬行對于普通的Web操作來說更為容易，并且所受的干擾更小。

The spidering is supposed to do multiple searches at the same time and use anonymous proxy way.

該蜘蛛是應(yīng)該做的，同時使用多個搜索和匿名代理的方式。