Wild Spider
web pages are crawled by being loaded into browser using multiple tabs parallelly
Apa itu Wild Spider?
Wild Spider adalah ekstensi Chrome yang dikembangkan oleh Xuan Wu, dan fitur utamanya adalah "web pages are crawled by being loaded into browser using multiple tabs parallelly".
Screenshot Ekstensi
Unduh Berkas CRX Ekstensi Wild Spider
Unduh file ekstensi Wild Spider dalam format crx, pasang ekstensi Chrome secara manual di peramban, atau bagikan file crx dengan teman untuk menginstal ekstensi Chrome dengan mudah.
Petunjuk Penggunaan Ekstensi
WATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).
The "spider" works in this way:
1) The current url is used as the starting point, and it's loaded again in a new tab.
2) After this page is loaded, fetch all the links on the page.
3) Get all the links on the page, including relative urls.
4) Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
5) repeat 2-4
All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider Informasi Dasar Ekstensi
| Nama |  Wild Spider |
| ID | aanpchnfojihjddlocpgoekffmjkhbbe |
| URL Resmi | https://chromewebstore.google.com/detail/wild-spider/aanpchnfojihjddlocpgoekffmjkhbbe |
| Deskripsi | web pages are crawled by being loaded into browser using multiple tabs parallelly |
| Ukuran File | 121 KB |
| Jumlah Instalasi | 44 |
| Versi Saat Ini | 0.0.3 |
| Terakhir Diperbarui | 2019-03-08 |
| Tanggal Publikasi | 2019-03-08 |
| Penilaian | 1.00/5 Total 1 Penilaian |
| Pengembang | Xuan Wu |
| Tipe Pembayaran | free |
| Situs Ekstensi | https://github.com/nobodxbodon/ChromeCrawlerWildSpider |
| URL Halaman Bantuan | https://github.com/nobodxbodon/ChromeCrawlerWildSpider/issues |
| Bahasa yang Didukung | en-US |
| manifest.json | |
{
"update_url": "https:\/\/clients2.google.com\/service\/update2\/crx",
"name": "Wild Spider",
"short_name": "demo web crawler that's still in experimenting",
"description": "web pages are crawled by being loaded into browser using multiple tabs parallelly",
"version": "0.0.3",
"browser_action": {
"default_icon": "icon.png"
},
"permissions": [
"tabs",
"activeTab",
"webNavigation"
],
"background": {
"scripts": [
"Dexie.js",
"eventPage.js"
],
"persistent": false
},
"content_scripts": [
{
"matches": [
"*:\/\/*\/*"
],
"js": [
"htmlparser2.js",
"content.js"
]
}
],
"manifest_version": 2
} | |
