Getting Started with Vortex EOS
What is the Vortex EOS framework and what can it do?
What is the Vortex EOS framework?
The Vortex EOS, or enterprise operating system, leverages the features of Kubernetes, Kafka, and Hadoop to handle the large volume of data being piped through our systems every day.
- Kubernetes - provides a container-centric management environment, separating services into containers and handling the management and life-cycle of those applications/services.
- Hadoop - is the backbone of our big data system. It consists of 4 modules:
-- A Distributed File-System
-- MapReduce - which reads the data coming in and maps it into usable data
-- Hadoop Common - which provides the tools needed for the user's computer systems to read data stored under the Hadoop file system.
-- YARN - which manages resources of the systems storing the data and running the analysis.- Kafka - is a distributed messaging platform, through which real-time streaming data pipelines reliably get data between our systems and applications.
Updated almost 8 years ago
