My name is Brian Whitman. I am a lapsed scientist and sound artist currently co-founder/CTO at The Echo Nest, a music intelligence company in Somerville, MA. As I work on various scaling and media search problems with detours into art projects I'll be posting details here in the hopes that I can learn from others. I'd always like to hear from you if you are working on similar things.
When something in java takes a long time, you can do jmap -histo pid to see where the memory is, kill -QUIT pid to see what it is currently doing, and this to see the % of where all the calls are. (I am currently debugging Solr commit slowness on 2 of our index shards, they are 20x as slow to commit as the others and I don’t know why. More later.)
