ElasticSearch (ES) is a distributed search engine, RESTful and based on the (famous) library Apache Lucene ; if you use indexation services in your application, you may already use it or Solr which is also based on Lucene.
Aside ElasticSearch, the company behind the product also release 3 other opensource products linked with ES :
- Kibana to produce dashboard and reports from ES and more widely to interact with data in ES.
- Logstatsh combined with ES to analyse logs & events.
- Marvel was also just released to monitor your ES cluster.
- 1.0 Release announcement : http://www.elasticsearch.org/blog/1-0-0-released/
- 1.0 Release announcement in French : http://linuxfr.org/news/sortie-d-elasticsearch-en-version-1-0
Xebia (French consulting company) published some blog posts on ES in last december which shows you how to start with ES :
- e-reputation assesment on Twitter with ElasticSearch and Kibana (in French)
- Log analysis with ElasticSearch, LogStash and Kibana (in French)
IIplayed with it a little bit and was quite impressed by its relevance. The only "issue" was to push content trough the REST Api as binary indexation is not native but there is file system river for that.
So if you need to index/retrieve content or manipulate data, I would recommend you having a look at ElasticSearch ecosystem.
ElasticSearch is also used in Graylog² and according to a colleague, on log analysis, it would be very relevant with the use of Gralylog Extended Log Format (GELF). If someone has an experience on Graylog² vs ES/Logstash/Kibana on this, I'm interested to have their opinions !