Category: System Designs
How internet giants deliver their data to the world
In the course of attending the lecture “Ultra Large Scale Systems” I was intrigued by the subject of traffic load balancing in ultra-large-scale systems. Out of this large topic I decided to look at traffic distribution at the frontend in detail and held a presentation about it as part of this lecture. As this subject…
Consensus protocols – A key to cluster management?
blogpost In these times, applications require increasing robustness and scalability, since otherwise they will collapse under the burden of the vast number of users. Cluster managers like kubernetes, Nomad or Apache Marathon are a central factor of this resilience and scalability. A closer look at the insides of cluster managers reveals consensus protocols to be…
Writing High Performance Code on Modern Hardware
Today, with the use of modern hardware combined with optimized high performant code, it is an easy task to process more than 500 million images per day on a single machine. Small improvements in the underlying implementations can have extreme large impacts on the execution time and are therefore fundamentally important to handle the huge…
Apache Kafka – The one Stream Processor to rule them all?
If there is one statement that can be made about the current developments in the realm of distributed systems, it would probably be how most developers are turning away from a centralised, monolithic architecture and move towards a microservice architecture. This type of architecture proved itself as much more flexible and robust for the modern…
Reproducibility in Machine Learning
The rise of Machine Learning has led to changes across all areas of computer science. From a very abstract point of view, heuristics are replaced by black-box machine-learning algorithms providing “better results”. But how do we actually quantify better results? ML-based solutions tend to focus more on absolute performance improvements (measured by metrics) instead of…
Experiences from breaking down a monolith (3)
Written by Verena Barth, Marcel Heisler, Florian Rupp, & Tim Tenckhoff DevOps Code Sharing Building multiple services hold in separated code repositories, we headed the problem of code duplication. Multiple times a piece of code is used twice, for example data models. As the services grow larger, just copying is no option. This makes it…
Migrating to Kubernetes Part 1 – Introduction
Written by: Pirmin Gersbacher, Can Kattwinkel, Mario Sallat
Migrating to Kubernetes Part 2 – Deploy with kubectl
Written by: Pirmin Gersbacher, Can Kattwinkel, Mario Sallat
Migrating to Kubernetes Part 3 – Creating Environments with Helm
Written by: Pirmin Gersbacher, Can Kattwinkel, Mario Sallat
Migrating to Kubernetes Part 4 – Create Environments via Gitlab
Written by: Pirmin Gersbacher, Can Kattwinkel, Mario Sallat