Distributed Systems

Distributed Systems

Client-server architecture

In a client-server architecture, clients request services or resources from servers, which fulfill these requests. This model enables scalable and efficient distribution of resources across a network.

Communication protocols (TCP/IP, RPC)

TCP/IP (Transmission Control Protocol/Internet Protocol) is a suite of communication protocols used for network communication. It provides reliable, ordered, and error-checked delivery of data over IP networks.

RPC (Remote Procedure Call) is a protocol that allows a computer program to cause a subroutine or procedure to execute in another address space without the programmer explicitly coding the details for this remote interaction. It simplifies the development of distributed applications.

Distributed file systems and consensus algorithms

Distributed file systems enable files to be shared and accessed across multiple nodes in a network. Examples include Google File System (GFS) and Hadoop Distributed File System (HDFS).

Consensus algorithms ensure agreement among distributed processes or systems. Examples include Paxos and Raft, which are used for achieving consensus in distributed systems such as databases and distributed computing frameworks like Apache Kafka.

Lab Activities

Client-Server Architecture Lab Activity

        // Sample code for creating a basic client-server application in Python using sockets
        // Server code
        import socket

        server_socket = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
        server_socket.bind(('localhost', 8080))
        server_socket.listen(1)

        while True:
            conn, addr = server_socket.accept()
            print('Connected by', addr)
            data = conn.recv(1024)
            if not data:
                break
            conn.sendall(data)
        conn.close()
    

        // Client code
        import socket

        client_socket = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
        client_socket.connect(('localhost', 8080))
        client_socket.sendall(b'Hello, server!')
        data = client_socket.recv(1024)
        print('Received', repr(data))
        client_socket.close()
    

Distributed File Systems Lab Activity

        // Sample code for using Hadoop Distributed File System (HDFS) commands
        hdfs dfs -ls /
        hdfs dfs -mkdir /user
        hdfs dfs -put localfile.txt /user/hadoop/input
        hdfs dfs -cat /user/hadoop/input/localfile.txt
    

Consensus Algorithms Lab Activity

        // Sample code for implementing the Raft consensus algorithm in Go
        // (Note: This is a simplified version for illustration purposes)
        package main

        import "fmt"

        type RaftNode struct {
            // Raft node implementation
        }

        func main() {
            // Raft consensus algorithm simulation
            fmt.Println("Raft consensus algorithm simulation")
        }