Why did superman choose Grid Computing? Because he can save the world in parallel!<\/em><\/p>\n<\/blockquote>\n\n\n\n Grid Computing describes a network of decentral, distributed computers working together on a specific task. Instead of computing a task that would be rather difficult for a single machine, the computers combine their forces. This means, despite having different geographic locations, they work like a virtual supercomputer<\/strong>. The computers thereby contribute resources, such as processing power, memory and storage capacity, along the network. [1]<\/p>\n\n\n\n Because the virtual supercomputer is generated out of a cluster of coupled computers, Grid Computing is known as a subset of distributed computing<\/strong>. Developed to solve computationally intensive operations, it can be considered the Kryptonite of distributed computing. [1,2]<\/p>\n\n\n\n Why is it called Grid? Well, just like with electricity, the power comes \u201cout of the socket\u201d. By simply plugging the computer into the power grid<\/strong>, the computing starts. [1,3]<\/p>\n\n\n\n Foster and Kesselman postulate the following definition for Grid Computing:<\/p>\n\n\n\n A computational grid is a hardware and software infrastructure that provides dependable, consistent, pervasive, and inexpensive access to high-end computational capabilities.<\/em><\/p>\n<\/blockquote>\n\n\n\n <\/p>\n\n\n\n The Grid Computing Network generally consists of three types of computers, the so-called Nodes [1]:<\/p>\n\n\n\n These nodes have designated positions in a simple hierarchy, beginning with the (a) applications, then the (b) Middleware, the (c) available resources and the (d) computer itself that connects to the grid. Here\u2019s a simple overview:<\/p>\n\n\n\n The machines are connected via Ethernet or Internet. Instead of using a lot of CPU cores of one computer, the grid contains multiple cores that are spread across various locations in a large or even world-wide network. For controlling the network and its resources, a Middleware<\/strong> protocol is needed. This is mostly an open, standardized protocol connecting the grid\u2019s resources with high-level-applications. The Control Node is the executor of the Middleware. [3,4]<\/p>\n\n\n\n The nodes may consist of machines using the same operating system, transforming the computer collective into a homogeneous<\/strong> network. If the nodes use different operating systems in a single grid computing network, they are called heterogeneous<\/strong> networks. The fact that they are allowed to use different OS, is one of the advantages<\/strong> and distinguishing parts of grid computing, in comparison to other distributed computing architectures. The virtualization of a single-system image \u2013 also called virtual organization \u2013 granting users and applications seamless access to IT capabilities is a very powerful feature. [1,3] <\/p>\n\n\n\n Contributing <\/strong>computing power to a Grid is relatively simple. A loosely-coupled computer makes a request to the control node. Then the Control Node gives the user access to the resources available. Whenever the computer is not in direct use, it contributes its resources to the network. The computers therefore are in constant balance \/ switching<\/strong> between being a user or a provider, based on their needs. [1,3]<\/p>\n\n\n\n Grid Computing shows the clustered and balanced lifestyle by living, laughing and computing in harmony.<\/em><\/p>\n<\/blockquote>\n\n\n\n Being the control node is not that easy. Since it is responsible for administering the network and making sure a provider is not overloaded with tasks. The provider gives permission to the user to run anything on its computer, which is a potential security risk<\/strong> for the whole network. This is why another important aspect is to authorize<\/strong> any process or task which is being executed on the network. [1,2]<\/p>\n\n\n\n When the task is assigned, it gets broken into different subtasks<\/strong>. They are then divided and sent to different machines of the grid. After being solved, the results are sent back to the control node. The complete infrastructure shows the grid<\/strong> where computers interact with each other to coordinate the solving of a complex task. [2,6]<\/p>\n\n\n\n Depending on the use-case and the connected resource, one can differentiate between five different types of grid computing [3-5]: <\/p>\n\n\n\n <\/p>\n\n\n\n The idea of consuming computing power \u2013 like electricity is consumed from a power grid \u2013 is similar to what we nowadays know as Infrastructure-as-as-Service<\/strong> (IaaS) of Cloud Computing, where only these resources are used that a system currently needs. So, are Cloud and Grid Computing the same thing? [5,6]<\/p>\n\n\n\n In a nutshell: No, they are not the same. They both are similar<\/strong> in that they contribute resources, make interactions between machines possible and provide resources. Hence, they use the concept of using the power of other entities to increase efficiency.<\/p>\n\n\n\n One difference lies in the segmentation<\/strong> of tasks. Grid Computing maximizes the available resources by splitting tasks into several different subtasks and computes them via different machines. No physical data center is needed. Cloud Computing, on the other hand, usually does have a physical data center, thus offering a homogeneous network.Another difference lies in their uniformity<\/strong>. Grid Computing allocates resources in its network to the related subtasks through decentralized coupling of computers. The Grid Provider thereby owns and organizes the infrastructure as a virtual supercomputer, while Cloud Providers organize the computing centrally and uniformly in the Cloud. [5,6]<\/p>\n\n\n\n Let\u2019s take a trip down memory lane: While doing some research on this topic, I came across many recent articles which state that grid computing allegedly is dead. Just like Cloud Computing nowadays, the Grid was predicted to be the state-of-the-art of computing infrastructures<\/strong> in the early 2000s. In an article from 1999 called \u201cThe Grid: Blueprint for a new computing infrastructure\u201d, the idea of Grid Computing originally was first proposed as a concept by Ian Foster and Carl Kesselman. [1,7]<\/p>\n\n\n\n Businesses in biotech, the sciences and financial services have discovered that grids are competitive necessities.<\/em><\/p>\nNetworkWorld, 2006 [8]<\/cite><\/blockquote>\n\n\n\n In 2006, Network World USA stated that \u201cthis is the year that grid computing will move into mainstream\u201d [8]. The main advantage of fewer costs for highly computational supercomputers spiked a lot of interest. But contrary to what was expected, Grid Computing did not reach mainstream<\/strong> status. It is a fact: the Grid is getting older and we have an enormous cloud guiding us to a phenomenal future. Why would we settle for anything less? [4]<\/p>\n\n\n\n The meaning of Grid Computing has changed over the years. The former distributed computing infrastructure has morphed into a distributed collaborative network<\/strong>. It now has a much more scientific approach towards solving mathematical, analytical and physics problems in research dealing with Big Data. Years later, mainly research institutes and some brave businesses apply Grid Computing. [5]<\/p>\n\n\n\n But not everyone has replaced Grid Computing yet. <\/p>\n\n\n\n Every desktop computer can be used to add power to the grid. This is why \u201cnormal\u201d people can contribute as well. Common applications of grid computing are to be found in the sector of financial services (risk assessment), gaming (splitting tasks), entertainment (VFX), science and engineering. Computing and Data Grids are very commonly used in scientific projects <\/strong>(like genome sequence analysis during the Covid-19 pandemic), which inspire and motivate people to be part of a public collaboration across companies and networks. This is why Grid Computing falls into the category of peer-to-peer computing<\/strong>. [2,6]<\/p>\n\n\n\n The European Grid Infrastructure (EGI), the SETI@home (Search for Extraterrestrial Intelligence) by the University of Berkeley, the Scandinavian NorduGrid and the neuGRID (research on neurodegenerative diseases) are some famous examples of scientific projects using Grid Computing. The field of e-Science<\/strong> projects (scientific research collaborations for analysis) is certainly gaining popularity. This is especially interesting for natural sciences, medicine, meteorology, industry and particle physics \u2013 as further exemplified in the following section. [4,5,9] <\/p>\n\n\n\n CERN \u2013 the European Organization for Nuclear Research \u2013 is most commonly known for physicists doing fundamental research<\/strong> on what the universe is made of. But it is less commonly known that this research involves computer scientists working with Grid Computing for data analysis.<\/p>\n\n\n\n The Large Hadron Collider<\/a> (LHC) is currently the largest particle accelerator<\/strong> in the world. With a circumference of 27 kilometers, it investigates high-energy particle collisions through four main experiments: ALICE, ATLAS, CMS and LHCb. Stationed in Meyrin, Switzerland, particle physicists and computer scientists from all around the world collaborate together on something as special as fundamental research. [10,11]<\/p>\n\n\n\n Fun Fact: CERN <\/a>is not only a huge cooperation, but the research around the building blocks of the universe (the quarks, antimatter and dark matter) provide inspiration for great science-fiction movies!<\/p>\n\n\n\n The data produced by the CMS detector<\/a> at the LHC is about 15 Petabyte per year<\/strong>. To show how much data that is to the common user, here are some comparisons [11,12]:<\/p>\n\n\n\n The detector by those means can be seen as huge, high-resolution camera. You can now imagine just how enormous this dataset is. But enough background information\u2026 back to the Grid!<\/p>\n\n\n\n In order to be able to handle that huge amount of data produced by the LHC, CERN uses a Grid Infrastructure called the Worldwide LHC Computing Grid<\/strong>. In 2007, the WLCG<\/a> was one of the first Grid Computing Infrastructures \u2013 and it is still in use today. CERNs mission is to provide global computing resources for the storage, distribution and analysis of the data generated by the LHC. It is a global collaboration of around 170 computing centers in more than 40 countries. They link up national and international grid infrastructures and analyze a dataset of around 200 Petabytes of data every year. CERN itself provides about 20% of the resources of the WLCG. [9,11]<\/p>\n\n\n\n\n
What is Grid Computing?<\/h2>\n\n\n\n
![\"Meme](\"https:\/\/blog.mi.hdm-stuttgart.de\/wp-content\/uploads\/2023\/02\/supergrid_meme-300x225.jpeg\")
<\/a>\n
Is the architecture\u2026 a grid?<\/h2>\n\n\n\n
\n
![\"Graphic](\"https:\/\/blog.mi.hdm-stuttgart.de\/wp-content\/uploads\/2023\/02\/grid_architecture.png\")
<\/a>
<\/p>\n\n\n\nFrom Grid to Grid Computing<\/h2>\n\n\n\n
\n
![\"Grid](\"https:\/\/blog.mi.hdm-stuttgart.de\/wp-content\/uploads\/2023\/02\/grid_infrastructure.png\")
<\/a>\n
Grid vs. Cloud Computing<\/h2>\n\n\n\n
![\"Comparison](\"https:\/\/blog.mi.hdm-stuttgart.de\/wp-content\/uploads\/2023\/02\/grid_vs_cloud.png\")
<\/a>
<\/p>\n\n\n\n\u200cHistory-Time: Popularity of Grid Computing<\/h2>\n\n\n\n
\n
<\/p>\n\n\n\nWhen Grid Computing goes of the grid<\/h2>\n\n\n\n
<\/p>\n\n\n\nA real life example: The Worldwide LHC Computing Grid (WLCG)<\/h2>\n\n\n\n
![\"CERN](\"https:\/\/blog.mi.hdm-stuttgart.de\/wp-content\/uploads\/2023\/02\/cern_accelerator_complex_cropped.jpeg\")
<\/a>![\"Simulation](\"https:\/\/blog.mi.hdm-stuttgart.de\/wp-content\/uploads\/2023\/02\/cern-run3_13.6TeV.png\")
<\/a>\n