As the previous post explained our system is based on Akka. Before going into more detail about our solution, I’d like to explain what Akka is about and why it is so awesome.
Akka is a toolkit and not a framework, you can simply use the bits that you need for your service. In this series we’ll focus on the core features and we won’t go through Akka Streams, Akka-Http or Akka Cluster (since they’re out of scope, not because they’re not fantastic).
Akka provides a different abstraction to deal with concurrency, paralellism and fault-tolerance. That abstraction is called Actor Model. If you have experience with the old Java ecosystem you will know how hard it is to write safe and correct multithreaded code. Providing human-friendly abstractions like Actors is a revolution comparable to Java’s memory management at the time of introduction. New challenges derived from internet scale and cloud computing requires a reactive approach to programming. Akka aligns with that philosophy and enables you to implement Event-driven architectures.
Actors all the way
Threads are an expensive resource, hence we need to use them judiciously. Blocking threads while we’re waiting for some I/O operation to respond is really inefficient. Actors use threads in a different way, as a result of which they’re pretty lightweight (several million actors per GB of heap memory)
Actors are a good blend of Object Oriented and Functional Programming principles. OOP is basically about messages as Alan Kay, one of the pioneers of OOP, stated
I’m sorry that I long ago coined the term “objects” for this topic because it gets many people to focus on the lesser idea. The big idea is “messaging”.
An actor exchanges immutable messages and keeps their own encapsulated state: every interaction needs to be done through messages.
Fault tolerance
There is not a clear and shared error handling model in Java, and you can realise that after working in a couple of projects. The origin of that is a confusing abstraction called Exception and its subtypes Checked and Unchecked Exceptions. The only real difference is that checked exceptions force us to deal with the issue in the direct caller, except for that they don’t hint at the strategy that we should apply.
I strongly recommend this post about it. One such powerful idea in the post is that bugs aren’t recoverable errors. This quote is contained in that post, original source:
I was involved in the development of a library that was written in C++. One of the developers told me that the developers are divided into the ones who like exceptions and the other ones who prefer return codes. As it seems to me, the friends of return codes won. However, I got the impression that they debated on the wrong point: Exceptions and return codes are equally expressive, they should however not be used to describe errors. Actually the return codes contained definitions like
ARRAY_INDEX_OUT_OF_RANGE. But I wondered: How shall my function react, when it gets this return code from a subroutine? Shall it send a mail to its programmer? It could return this code to its caller in turn, but it will also not know how to cope with it. Even worse, since I cannot make assumptions about the implementation of a function, I have to expect anARRAY_INDEX_OUT_OF_RANGEfrom every subroutine. My conclusion is thatARRAY_INDEX_OUT_OF_RANGEis a (programming) error. It cannot be handled or fixed at runtime, it can only be fixed by its developer. Thus there should be no according return code, but instead there should be asserts.
Akka provides a great way for dealing with failures/errors based on these tenets:
- Single responsibility principle: failure management is delegated to supervisors, creating focused business actors. We agreed some time ago that lifecycle management, e.g. object creation, should be moved to factories, therefore an object is not responsible for creating itself. Resuming or restarting an object, after some failure happened, is part of that lifecycle management and Akka enforces you to move that responsibility to supervisors. The resulting code will be loosely coupled and highly cohesive.
- Default recovery strategies: it’s important to understand which are our options after the system is under some failure condition. Is the DB temporarily down? Has some input, in combination with the existing data, created an undesired state? Is that a bug? Do we need to abandon that particular request or that part of the system is messed up until some patch is applied? Those questions will determine our response to that incident, and Akka provides some built-in strategies.
override val supervisorStrategy =
OneForOneStrategy(maxNrOfRetries = 10, withinTimeRange = 1 minute) {
case _: ArithmeticException => Resume
case _: NullPointerException => Restart
case _: IllegalArgumentException => Stop
case _: Exception => Escalate
}- Failure as first class citizen: some libraries or ecosystems hide failures through obscure APIs. Akka is usually deployed in distributed environments, therefore using unreliable resources like networks. That forces us to bring failure to the front. Even in ‘safer’ environments as monoliths, failures are all around, so using toolkits like Akka is critical to create reliable and robust software.
Concurrency and parallelism
With Akka we’re not going to deal directly with threads, they’re hidden under an abstraction layer. The backbone of an Akka app is the Actor System:
An actor system is a hierarchical group of actors which share common configuration, e.g. dispatchers, deployments, remote capabilities and addresses. It is also the entry point for creating or looking up actors.
A Dispatcher is also an Execution Context, so in the end it is where the thread pool is located. Let’s assume that your app uses a single dispatcher with 4 threads allocated. As you can see threads are a scarce resource, if we do blocking I/O or heavy CPU work in some of the actors we’ll use exclusively one of the threads, and you can see how quickly your service will run out of threads.
The solution is wrapping those operation with constructs like Scala Futures and then provide a different execution context for those tasks.
Summary
Akka is a fantastic toolkit full of well suited abstractions for modern problems. In the next post we’ll see with the help of some code how to coordinate and supervise actors with the constraints of our example application.
| Reference: | Akka basics from our JCG partner Felipe Fernandez at the Crafted Software blog. |
