A very easy to use web spider and crawler that was developed in order to ease the life of enterprise search integrators and developers. #Web crawler #Web spider #Http colelctor #Crawler #Http #Collector
Norconex HTTP Collector is a reliable web crawler that comes in handy to all application developers.
Moreover, Norconex HTTP Collector is developed using the Java programming language and can be run on Mac OS X, Windows and Linux.
System requirements
What's new in Norconex HTTP Collector 2.6.0:
- New normalization rule for GenericURLNormalizer: removeTrailingSlash. Can now specify "notFoundStatusCodes" on GenericMetadataFetcher.
- Specifying an empty "path" tag in XML config or, setting a null or empty string array on StandardSitemapResolverFactory#setSitemapPaths(...) method will now prevent trying to locate sitemaps using default locations and will strictly rely on sitemap URLs specified as start URLs or found in robots.txt (if enabled).
- GenericLinkExtractor no longer extracts URL from HTML/XML comments by default. To re-enable this behavior a new "setCommentsEnabled(boolean)" method has been added.
- Normalization rule "addTrailingSlash" in GenericURLNormalizer has been renamed "addDirectoryTrailingSlash".
Norconex HTTP Collector 2.6.0 / 2.6.1 Snapshot
add to watchlist add to download basket send us an update REPORT- runs on:
- Mac OS X (-)
- file size:
- 66.7 MB
- filename:
- norconex-collector-http-2.6.0.zip
1 screenshot:
- main category:
- Utilities
- developer:
- visit homepage
Zoom Client
The official desktop client for Zoom, the popular video conferencing and collaboration tool used by millions of people worldwide
7-Zip
An intuitive application with a very good compression ratio that can help you not only create and extract archives, but also test them for errors
Bitdefender Antivirus Free
Feather-light and free antivirus solution from renowned developer that keeps the PC protected at all times from malware without requiring user configuration
calibre
Effortlessly keep your e-book library thoroughly organized with the help of the numerous features offered by this efficient and capable manager
4k Video Downloader
Export your favorite YouTube videos and playlists with this intuitive, lightweight program, built to facilitate downloading clips from the popular website
ShareX
Capture your screen, create GIFs, and record videos through this versatile solution that includes various other amenities: an OCR scanner, image uploader, URL shortener, and much more
Microsoft Teams
Effortlessly chat, collaborate on projects, and transfer files within a business-like environment by employing this Microsoft-vetted application
IrfanView
With support for a long list of plugins, this minimalistic utility helps you view images, as well as edit and convert them using a built-in batch mode
Windows Sandbox Launcher
Set up the Windows Sandbox parameters to your specific requirements, with this dedicated launcher that features advanced parametrization
Context Menu Manager
Customize Windows’ original right-click context menu using this free, portable and open-source utility meant to enhance your workflow
% discount
IrfanView
- IrfanView
- Windows Sandbox Launcher
- Context Menu Manager
- Zoom Client
- 7-Zip
- Bitdefender Antivirus Free
- calibre
- 4k Video Downloader
- ShareX
- Microsoft Teams
essentials
Click to load comments
This enables Disqus, Inc. to process some of your data. Disqus privacy policy