Wild Spider

web pages are crawled by being loaded into browser using multiple tabs parallelly

Hvad er Wild Spider?

Wild Spider er en Chrome-udvidelse udviklet af Xuan Wu, og dens hovedfunktion er "web pages are crawled by being loaded into browser using multiple tabs parallelly".

Udvidelsesskærmbilleder

screenshot
screenshot
screenshot

Download Wild Spider-udvidelses-CRX-fil

Download Wild Spider-udvidelsesfiler i crx-format, installer Chrome-udvidelser manuelt i browseren eller del crx-filer med venner for nemt at installere Chrome-udvidelser.

Brugsanvisning til Udvidelsen

                        WATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).

The "spider" works in this way:
1) The current url is used as the starting point, and it's loaded again in a new tab.
2) After this page is loaded, fetch all the links on the page.
3) Get all the links on the page, including relative urls.
4) Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
5) repeat 2-4

All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider                    

Grundlæggende oplysninger om udvidelsen

Navn Wild Spider Wild Spider
ID aanpchnfojihjddlocpgoekffmjkhbbe
Officiel URL https://chromewebstore.google.com/detail/wild-spider/aanpchnfojihjddlocpgoekffmjkhbbe
Beskrivelse web pages are crawled by being loaded into browser using multiple tabs parallelly
Filstørrelse 121 KB
Antal Installationer 44
Nuværende Version 0.0.3
Senest Opdateret 2019-03-08
Udgivelsesdato 2019-03-08
Bedømmelse 1.00/5 Samlet 1 Bedømmelser
Udvikler Xuan Wu
Betalingsmetode free
Udvidelseswebsted https://github.com/nobodxbodon/ChromeCrawlerWildSpider
Hjælpeside-URL https://github.com/nobodxbodon/ChromeCrawlerWildSpider/issues
Understøttede Sprog en-US
manifest.json
{
    "update_url": "https:\/\/clients2.google.com\/service\/update2\/crx",
    "name": "Wild Spider",
    "short_name": "demo web crawler that's still in experimenting",
    "description": "web pages are crawled by being loaded into browser using multiple tabs parallelly",
    "version": "0.0.3",
    "browser_action": {
        "default_icon": "icon.png"
    },
    "permissions": [
        "tabs",
        "activeTab",
        "webNavigation"
    ],
    "background": {
        "scripts": [
            "Dexie.js",
            "eventPage.js"
        ],
        "persistent": false
    },
    "content_scripts": [
        {
            "matches": [
                "*:\/\/*\/*"
            ],
            "js": [
                "htmlparser2.js",
                "content.js"
            ]
        }
    ],
    "manifest_version": 2
}