Organising Data in the Cloud is No Mean Feat
Open Source For You|July 2024
Data management is a complex process, made tougher due to the humongous amount of data being generated each day. Databases were developed to make sense of this data but these need to evolve continuously with the increasing demands being made on them. Following a few best practices will also help to manage data well.
Organising Data in the Cloud is No Mean Feat

Databases came into the limelight during the initial growth of application programming. As data grew in volume, a second generation of database architecture evolved called NoSQL databases. These offered strong support in architecting a data warehouse or data lake-based application design.

First-generation database systems (e.g., Oracle, MySQL) have a lot of flexibility in terms of developer access for querying and accessing/interpreting the data as compared to second-generation (NoSQL) database systems like Hadoop and MongoDB. On the other hand, second-generation database systems are designed to address the limitations of RDBMS in terms of handling volume and multi-branched structural data.

To cater to online transaction processing (OLTP) of first-generation databases and the structural accessibility for large volume data handled by second-generation database systems, hybrid database systems called NewSQL have emerged as third-generation database systems.

NewSQL database systems try to address the shortcomings of second-generation database systems by combining some of the advantages of first-generation systems like relation between entity models, ACID transaction handling capability, etc. Popular NewSQL database systems are VoltDB, ClusterixDB, CockroachDB and NeoDB.

Polyglot databases in cloud platforms

A data store is an integral component of any application development as it is the persistent store for handling all the data required for processing logic. Database solutions are moving towards polyglot databases, which combine multiple types of databases for an enterprise architecture. Polyglot databases are typically used in microservices architecture as they use multi-types of database systems in an integrated solution.

Bu hikaye Open Source For You dergisinin July 2024 sayısından alınmıştır.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.

Bu hikaye Open Source For You dergisinin July 2024 sayısından alınmıştır.

Start your 7-day Magzter GOLD free trial to access thousands of curated premium stories, and 9,000+ magazines and newspapers.

OPEN SOURCE FOR YOU DERGISINDEN DAHA FAZLA HIKAYETümünü görüntüle
Helgrind: Detecting Synchronisation Issues in Multithreaded Programs
Open Source For You

Helgrind: Detecting Synchronisation Issues in Multithreaded Programs

Let's explore how Helgrind can be used to detect and debug multithreading issues with the help of a multithreaded C program.

time-read
3 dak  |
November 2024
The Perfect Process of Booting a PC
Open Source For You

The Perfect Process of Booting a PC

Booting a PC seems as simple as eating a cake. But are you aware of all that goes on behind-the-scenes to bake a delicious cake or seamlessly boot a PC?

time-read
3 dak  |
November 2024
Exploring eBPF and its Integration with Kubernetes
Open Source For You

Exploring eBPF and its Integration with Kubernetes

eBPF, a game-changing technology that extends the capabilities of the Linux kernel, offers significant advantages for Kubernetes networking. It also greatly improves Kubernetes observability by capturing detailed telemetry data directly from the kernel. Read on to find out how its integration with Kubernetes has immense benefits.

time-read
5 dak  |
November 2024
Deploying Generative AI LLMs on Docker
Open Source For You

Deploying Generative AI LLMs on Docker

Built on massive datasets, large language models or LLMS are closely associated with generative Al. Integrating these models with Docker has quite a few advantages.

time-read
8 dak  |
November 2024
Containerisation: The Cornerstone of Multi-Cloud and Hybrid Cloud Success
Open Source For You

Containerisation: The Cornerstone of Multi-Cloud and Hybrid Cloud Success

Open source containerisation software provides the flexibility, cost-effectiveness, and community support needed to build and manage complex multi-cloud and hybrid cloud environments. By leveraging this software, businesses can unlock the full potential of multicloud and hybrid cloud architectures while minimising vendor lock-in risks.

time-read
3 dak  |
November 2024
From Virtual Machines to Docker Containers: The Evolution of Software Development
Open Source For You

From Virtual Machines to Docker Containers: The Evolution of Software Development

Containerisation and Kubernetes have eased software development, making it faster and better. Let's see where these are headed, looking at trends that are making life easier for developers.

time-read
10+ dak  |
November 2024
India's Leap in Supercomputing: Innovating for Tomorrow
Open Source For You

India's Leap in Supercomputing: Innovating for Tomorrow

As India strides towards self-sufficiency in supercomputing, embracing this evolution isn't just an option-it is pivotal for global competitiveness and technological leadership.

time-read
5 dak  |
November 2024
SageMath: A Quick Introduction to Cybersecurity
Open Source For You

SageMath: A Quick Introduction to Cybersecurity

In the previous articles in this SageMath series, we delved into graph theory and explored its applications using SageMath. In this seventh article in the series, it is time to shift our focus to another crucial subfield of computer science: cybersecurity and cryptography.

time-read
10+ dak  |
November 2024
Efficient Prompt Engineering: Getting the Right Answers
Open Source For You

Efficient Prompt Engineering: Getting the Right Answers

OpenAl's GPT-3 and GPT-4 are powerful tools that can generate human-like text, answer questions, and provide insights. However, the quality of these outputs depends heavily on how you frame the input, or prompt. Efficient prompt engineering ensures you get the right answers by designing inputs that guide the AI towards relevant, clear, and useful responses. Let's find out how to craft effective prompts with examples.

time-read
4 dak  |
November 2024
Analysing Linus Torvald's Critique of Docker
Open Source For You

Analysing Linus Torvald's Critique of Docker

This article looks at Docker's security flaws, particularly its shared-kernel model, and contrasts it with traditional VMs for better isolation. It discusses Linus Torvalds' concerns, explores mitigation techniques, and proposes a roadmap for building a more secure containerisation platform using hardware-assisted virtualisation, true isolation, and a robust orchestration layer.

time-read
8 dak  |
November 2024