.. -*- coding: utf-8; -*-

==============

 Duplication.

==============

.. contents::

   :local:

Search for duplicate lines.

===========================

http://en.wikipedia.org/wiki/Duplicate_code

  Wiki page.

http://students.cis.uab.edu/tairasr/clones/literature/

  Code Clones Literature.

https://moz.com/devblog/near-duplicate-detection/

  MinHash vs SimHash algorithm explanation.

Open source or free licence:

* http://duplo.sourceforge.net/

* http://clonedigger.sourceforge.net/

* http://www.ccfinder.net/ccfinderxos.html

Proprietary or restricted licence:

* http://www.txl.ca/nicaddownload.html

* http://www.harukizaemon.com/simian/index.html

* http://getatomiq.com/

* http://www.harukizaemon.com/simian/index.html

http://stackoverflow.com/questions/191614/how-to-detect-code-duplication-during-development

  How to detect code duplication during development?

https://en.wikipedia.org/wiki/List_of_tools_for_static_code_analysis

  List of tools for static code analysis.

http://askubuntu.com/questions/434545/identify-duplicate-lines-in-a-file-without-deleting-them

  Identify duplicate lines in a file without deleting them?

http://stackoverflow.com/questions/13046791/how-to-delete-the-repeat-lines-in-emacs

  How to delete the repeat lines in emacs.

http://emacs.stackexchange.com/questions/13092/how-can-i-highlight-duplicate-lines

  How can I highlight duplicate lines?

https://www.emacswiki.org/emacs/DuplicateLines

  Duplicate Lines.

Search for duplicate files.

===========================

This utilities only search for duplicate files:

http://duff.sourceforge.net/

  duff home page

http://freedup.org/

  freedup home page

http://dupedit.com/

  dupedit home page

http://rdfind.pauldreik.se/

  Rdfind home page

http://code.google.com/p/softenido/wiki/FindRepe

  FindRepe home page

fdupes

======

::

  $ sudo apt-get install fdupes

See:

http://code.google.com/p/fdupes/

  fdupes home page

http://ru.wikipedia.org/wiki/Fdupes

  fdupes wiki page

http://packages.debian.org/search?keywords=fdupes

  fdupes Debian package

freedups

========

Freedups searches through the directories you specify. When it finds two

identical files, it hard links them together. Now the two or more files still

exist in their respective directories, but only one copy of the data is stored

on disk; both directory entries point to the same data blocks.

http://www.stearns.org/freedups/

  freedups home page

dupmerge

========

Dupmerge reads a list of files from standard input (eg., as produced by "find .

-print") and looks for identical files. When it finds two or more identical

files, all but one are unlinked to reclaim the disk space and recreated as hard

links to the remaining copy.

https://sourceforge.net/projects/dupmerge/

  dupmerge home page

ssdeep

======

ssdeep is a program for computing context triggered piecewise hashes (CTPH).

Also called fuzzy hashes, CTPH can match inputs that have homologies. Such

inputs have sequences of identical bytes in the same order, although bytes in

between these sequences may be different in both content and length.

http://ssdeep.sourceforge.net/

  ssdeep home page

comparator

==========

Available under Cygwin. Find duplication in source files::

  $ comparator -s 5 $dir1 $dir2