tips

Comparison of Automated Code Review Tools - Codebeat, Codacy and Codeclimate

Code review makes your code stronger, reduces the risk of overlooking major bugs and supports the culture of feedback. The process constitutes an inherent part of best practices in web development, so skipping it in your projects might be a big mistake. Luckily, it can be easily and effectively conducted thanks to numerous automated code review tools that are available on the market. Don’t get overwhelmed by the number of providers! With our in-depth analysis you’ll find a solution to fit your needs.

Code review at CodeCarrot

At CodeCarrot, Code review is a crucial element in product development and it strongly supports the Test-Driven Development (TDD) process to offer the best practices available in developing Rails, CSS and JavaScript code. It helps us make the project better, faster, and more secure through making the code bulletproof. It is also an opportunity for people, especially newbies, to learn good code quickly.

Our developers used to test the correctness of our code with CodeClimate. However, with increasing needs and expectations we decided to seek a better alternative that would have more advanced features. Our Dev team conducted an in-depth research and that’s how we found Codeacy & CodeBeat, a tool nearly tailored for our business. However, we are aware that your dev team might require different features from the code review provider. Therefore, we share the results of our research, so that you can pick the solution which is right for you and save time on doing your own research.

Codebeat

Codebeat is a dynamically growing tool that covers major technologies and programming languages. It has evolved substantially within the last few months and it’s worth noting that the team is open for feedback and implementation of new features suggested by their users. However, there are still some things missing. The tool does not allow performing any security checks (perhaps a “simple” integration with Brakeman would do the job). It also does not support any open-source tools or linters (in fact, we are still using Hound) and does not support analysing CSS/SCSS.

Pros:

Cons:

Possible issues:

Codacy

Codacy has an awesome UI, lots of features and it’s very flexible thanks to dozens of options. There is also a tool (in beta) which allows you to define your own patterns and implement it to be checked automatically. Frankly, it wasn’t easy to find disadvantages of this tool or any clients’ complaints. However, there is still some area for improvement and potential to growth for Codacy.

Pros:

Cons:

Possible issues:

CodeClimate

CodeClimate is a well-developed and very stable solution with a great number of features. It has many advantages over its competitors and many big players recommend it as the best option. However, it lacked some crucial functionalities that we required for the CodeCarrot code review process, so we switched to an alternative solution.

Pros:

Cons:

Possible issues:

Code Review Tools Comparison Summary

Supported languages and technologies:

CodeClimate: Ruby/Rails, JavaScript, Python, PHP, Swift, SCSS/CSS, Go, CoffeeScript, Apex, Ember, ESLint, Haskell, Haxe, RubyMotion, Vim Script

Codebeat: Ruby, Javascript, Python, Java, Swift, Go, Typescript, Objective-C, Kotlin, Elixir

Codacy: Ruby, JavaScript, Python, PHP, Java, Swift, CSS, TypeScript, CoffeeScript, Scala, C/C++, Dockerfile, SASS, Shell Script

Measuring tools

CodeClimate: many existing, open-source tools like Rubocop, Brakeman, CSS/SCSS Lint, ESLint, Flog etc. full list here

Codebeat: their own algorithms and implementation written from scratch see how it works

Codacy: many existing, open-source tools like Rubocop, Brakeman, CSS/SCSS Lint, ESLint, Flog etc. full list here

Pricing

CodeClimate: $16,67/user/month (when billed yearly - otherwise 20$)

Codebeat: $20/user/month, but you can probably negotiate

Codacy: $15/user/month

Documentation

CodeClimate: very good and comprehensive

Codebeat: still some things missing

Codacy: not bad, not too much text and some images are not clickable so the readability is limited

API

CodeClimate: yes, still in beta version

Codebeat: yes, simple but usable

Codacy: yes, not described perfectly in their docs

Features CodeClimate Codebeat Codacy
Coverage report yes, link yes, link yes, link
Security analysis yes no yes
Team per project yes yes yes
Github PR integration yes yes yes
Slack integration yes yes yes
Jira integration yes no yes
total no. of integrations 13 6 10

Wrap up

After a deeper look at all the tools described above, Codebeat seems to be a comparable tool to CodeClimate or Codacy. In case of these three solutions, pros seem to overweigh the cons and a particular feature might clinch the final choice, which would stem from individual needs. Just like it did in case of CodeCarrot.

Which is your prefered code review tool, let us know in the comment section.

Response to “Comparison of Automated Code Review Tools - Codebeat, Codacy and Codeclimate”