A fast deduplication engine. #Deduplication engine #Entity resolution #Record linkage #Deduplication #Engine #Resolution
Duke is a small, free, easy to use, fast and flexible deduplication (entity resolution or record linkage) engine written in Java on top of Lucene.
At the moment Duke can process 1,000,000 records in 11 minutes on a standard laptop in a single thread.
Duke can be used to find duplicate records inside a single table/data source, or it can be used to find records in different tables/sources which most likely represent the same real-world entity.
System requirements
What's new in Duke 1.2:
- New features:
- Added longest common substring comparator.
- LuceneDatabase now uses fuzzy search by default (which is much slower).
- New default Record implementation, faster and uses less memory.
Duke 1.2
add to watchlist add to download basket send us an update REPORT- runs on:
- Mac OS X (-)
- file size:
- 5.1 MB
- filename:
- duke-1.2-bin.zip
1 screenshot:
- main category:
- Developer Tools
- developer:
- visit homepage
ShareX
Capture your screen, create GIFs, and record videos through this versatile solution that includes various other amenities: an OCR scanner, image uploader, URL shortener, and much more
4k Video Downloader
Export your favorite YouTube videos and playlists with this intuitive, lightweight program, built to facilitate downloading clips from the popular website
Microsoft Teams
Effortlessly chat, collaborate on projects, and transfer files within a business-like environment by employing this Microsoft-vetted application
Zoom Client
The official desktop client for Zoom, the popular video conferencing and collaboration tool used by millions of people worldwide
7-Zip
An intuitive application with a very good compression ratio that can help you not only create and extract archives, but also test them for errors
calibre
Effortlessly keep your e-book library thoroughly organized with the help of the numerous features offered by this efficient and capable manager
IrfanView
With support for a long list of plugins, this minimalistic utility helps you view images, as well as edit and convert them using a built-in batch mode
Windows Sandbox Launcher
Set up the Windows Sandbox parameters to your specific requirements, with this dedicated launcher that features advanced parametrization
Context Menu Manager
Customize Windows’ original right-click context menu using this free, portable and open-source utility meant to enhance your workflow
Bitdefender Antivirus Free
Feather-light and free antivirus solution from renowned developer that keeps the PC protected at all times from malware without requiring user configuration
% discount
Windows Sandbox Launcher
- Windows Sandbox Launcher
- Context Menu Manager
- Bitdefender Antivirus Free
- ShareX
- 4k Video Downloader
- Microsoft Teams
- Zoom Client
- 7-Zip
- calibre
- IrfanView
essentials
User Comments
This enables Disqus, Inc. to process some of your data. Disqus privacy policy