Sixth Data - Data storage and computing engine
-Table of Contents
--
-
- 1. General
+- -
- 2. Vision / goal
-- 3. Inspiration +
- 1. General
-- 4. Reasons for hypercube as a so called first class citizen
-- 5. Geometrical computation idea +
- 2. Vision / goal
+- 3. Inspiration
-- 6. Current status
-- 7. See also +
- 4. Reasons for hypercube as a so called first class citizen
+- 5. Geometrical computation idea
+- 6. Current status
1 General
+1. General
- This program is free software: released under Creative Commons Zero @@ -281,8 +252,8 @@ pre {background-color: #111; color: #ccc;}
1.1 Source code
+1.1. Source code
- Download latest snapshot in TAR GZ format @@ -302,13 +273,13 @@ git clone https://www2.svjatoslav.eu/git/sixth-data.git
2 Vision / goal
+2. Vision / goal
Provide hackable, versioned, optimized, distributed, geometrical, -arbitrary dimensional (hypercube based) data storage and computation -engine (as inspired by the brain) for general purpose visual computing +arbitrary dimensional (hypercube based) data storage and computation +engine (as inspired by the brain) for general purpose visual computing environment called Sixth.
@@ -318,15 +289,15 @@ language it would be used to provide -3 Inspiration
+3. Inspiration
- see also: OLAP cube.
3.1 Brain
+3.1. Brain
- Brain appears to be natural geometrical/parallel data storage and @@ -346,16 +317,16 @@ has dynamic/variable resolution/density:
- https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328
3.2 CM-1 Connection Machine
+3.2. CM-1 Connection Machine
https://en.wikipedia.org/wiki/Connection_Machine @@ -373,25 +344,25 @@ computational units into virtual 5D network. See:
we can pre-distribute data across computation units and perform -parallel geometrical computation. +parallel geometrical computation.
4 Reasons for hypercube as a so called first class citizen
+4. Reasons for hypercube as a so called first class citizen
- Hypercube is quite general purpose data structure that naturally encapsulates wide variety data and problems. -
- Nicely captures apparent properties of the brain. +
- Nicely captures apparent properties of the brain. -
- Naturally supports distributed and parallel geometrical data storage
+
- Naturally supports distributed and parallel geometrical data storage and computation.
-- Dedicated hardware like CM-1 can be built around hypercube concept +
- Dedicated hardware like CM-1 can be built around hypercube concept that results in data, computation process and hardware, all beautifully fitting together while complementing each other strengths.
@@ -402,12 +373,12 @@ of the parent
5 Geometrical computation idea
+5. Geometrical computation idea
5.1 Distributed computation and data storage
+5.1. Distributed computation and data storage
Lots of problems can be translated to geometry (use any shapes and as @@ -424,8 +395,8 @@ part). Question answering is making (relatively simple) lookups
5.2 Mapping hypercube to object-oriented model and relational database
+5.2. Mapping hypercube to object-oriented model and relational database
Object oriented programming is inspired by the way human mind @@ -454,8 +425,8 @@ contain instances (objects) of that class or rows of a table.
5.3 Mapping entity relations in hypercube
+5.3. Mapping entity relations in hypercube
Consider we want to create database of: @@ -483,13 +454,13 @@ between authors and the books.
6 Current status
+6. Current status
-
-
- More or less defined Vision / goal. +
- More or less defined Vision / goal. -
- Collected some inspiring ideas. +
- Collected some inspiring ideas.
- Implemented very simple persistent key-value map.
-
@@ -500,103 +471,10 @@ architecture.
7 See also
--Interesting or competing projects with good ideas: -
- --
-
- flexible user interface building for interacting with different data
-
-
-
- Glamorous Toolkit
-
-
-
- Moldable development environment. It is a live notebook. It is a -flexible search interface. It is a fancy code editor. It is a -software analysis platform. It is a data visualization engine. All -in one. -
-
- - Glamorous Toolkit
-
7.1 Computation on multi dimensional data
--
-
- Array Databases: Concepts, Standards, Implementations - -
- TileDB
-
-
-
- Analyze and share complex multi-dimensional data at scale -
-
- - CM-1 Connection Machine - -
- Lisp-Stat: An environment for Statistical Computing -
7.2 Distributed, reliable, parallel computing systems
--
-
- ChrysaLisp
-
-
-
- Assembler/C-Script/Lisp 64 bit, MIMD, multi CPU, multi threaded, -multi core, multi user Parallel OS. With GUI, Terminal, OO -Assembler, Class libraries, C-Script compiler, Lisp interpreter, -Debugger, and more… -
-
- - Gemstone/S
-
-
-
- Completely distributed smalltalk based computing -system. -
-
- - http://phantomos.org/
-
-
-
- Programs run forever. System crash or reboot does not destroy -state of running program. -
-
- - Magma
-
-
-
- Multi-user object database for Squeak -
-
- - TAOS
-
-
-
- Completely distributed operating system/virtual machine: -
-
7.3 Rules based machine reasoning
--
-
- GRAKN.AI
-
-
-
- database in the form of a knowledge graph that uses machine -reasoning to simplify data processing challenges for AI -applications. https://grakn.ai/ -
-
- - Prolog programming language -