Elastic search and Logstash or Dev driven infrastrucure

In the past couple of weeks I have been working on implementing an elasticsearch solution, combined with logstash we hope to implement it to replace the existing Splunk system that exist within the infrastructure.

I have build a Chef cookbook to implement it, and with in the confines of the testing it worked,  then one of the developers “complained” that there is a newer version and as they use it in their environment we should use it too.

Suffice to say that I had to spend the entire day trying to fix it in the system we are attempting to have in production, only to eventually learn that the versions are incompatible for the method we want to use and then I had to roll back all the version and re-apply the system.

In many places I have witnessed a mentality were the developers are setting the standard policy on tools and implementation – which more often then not usually backfires when the lead developer leaves or a system admin gets “dumped” with a tool and is expected to know it from day 1, and when it breaks, no one asked the developers anything and the blame falls on the ops person.

 

So today when the developer put his input about upgrading the component that was incompatible, instead of rolling back to a version we know that works, I told him flat out – No, and only when we System decide we want to upgrade – we will do it – not on their wishes.

Chef, Git and Ruby

In the last month I have been working on building chef configuration for deployment and management of the infrastructure of the current client,it is a very complex setting for an ISP and many bespoke setting and applications so using any existing chef recipes will need to be modified heavily that we are creating them from the start.

The choice of Git as a version control system was dictated by the development team and the more I work with it the more I learn to HATE it, it is full of features to a  point that it is becoming annoying and when you want to drop a section and move to work on something else it twists your arm to act in a specific way that I find upsetting.

Chef and ruby I am getting learning to accept and  becoming competent in their use , so much so that a project I was planning to work on in Puppet initially , I am now contemplating to migrate to Chef.