Consilience Progress Report: June 2013
We released Consilience version .95 on June 20. New features of this version include
- Made several performance improvements to LCE calculations, including removing redundant information from similarity matrix, and running k-means on the smaller matrix
- Create a Java program for creating Term Document Matrix and Stem Data (replaces R code)
- Updated R pre-processing calcs to handle larger document sets
- Moved production instances to larger servers
With these changes, we were able to increase our document set processing to ~50,000 documents.
The major features due in our next version, .96:
- Data visualization for comparing clusterings
- Document annotation
- View original PDF document, if it exists
- Several user interface fixes
The planned release for version .96 is end of July.
