From d2dcbfcedcc730df5f45ed3c428e6f2eae849916 Mon Sep 17 00:00:00 2001 From: Svjatoslav Agejenko Date: Tue, 16 Mar 2021 20:52:07 +0200 Subject: [PATCH] updated "see also" section --- doc/index.html | 782 +++++++++++++++++++++++++------------------------ doc/index.org | 41 +-- 2 files changed, 428 insertions(+), 395 deletions(-) diff --git a/doc/index.html b/doc/index.html index afffa32..709f4d2 100644 --- a/doc/index.html +++ b/doc/index.html @@ -1,12 +1,198 @@ - - + + + + + + Sixth Data - Data storage and computing engine - - - - - + + + @@ -14,244 +200,139 @@ footer {background-color: #111 !important;} pre {background-color: #111; color: #ccc;} - + -
-

Sixth Data - Data storage and computing engine

+
+

Sixth Data - Data storage and computing engine

+ -
-

1 General

+
+

1 General

-
  • Other software projects hosted at svjatoslav.eu -
    • +
  • Other software projects hosted at svjatoslav.eu
    • -
    -

    1.1 Source code

    +
    +

    1.1 Source code

    -
    -

    2 Vision / goal

    +
    +

    2 Vision / goal

    Provide hackable, versioned, optimized, distributed, geometrical, -arbitrary dimensional (hypercube based) data storage and computation -engine (as inspired by the brain) for general purpose visual computing +arbitrary dimensional (hypercube based) data storage and computation +engine (as inspired by the brain) for general purpose visual computing environment called Sixth.

    @@ -261,49 +342,42 @@ language it would be used to provide -

    3 Inspiration

    +
    +

    3 Inspiration

    -
    -

    3.1 Brain

    +
    +

    3.1 Brain

  • Even more awesome is that brain appears to operate and is wired as arbitrary/variable dimensional structure: -https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/ -
    • +https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/
  • On top of this, this multidimensional space that brain represents has dynamic/variable resolution/density: -
    • +
  • https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328
    • + -
  • Such properties allow parallel Geometrical computation and -beautifully fits CM-1 Connection Machine architecture (for extra -hardware accelerated solution). -
    • +
  • Such properties allow parallel Geometrical computation and +beautifully fits CM-1 Connection Machine architecture (for extra +hardware accelerated solution).
    • -
    -

    3.2 CM-1 Connection Machine

    +
    +

    3.2 CM-1 Connection Machine

    https://en.wikipedia.org/wiki/Connection_Machine @@ -321,53 +395,48 @@ computational units into virtual 5D network. See:

    we can pre-distribute data across computation units and perform -parallel geometrical computation. +parallel geometrical computation.

    -
    -

    4 Reasons for hypercube as a so called first class citizen

    +
    +

    4 Reasons for hypercube as a so called first class citizen

    • Hypercube is quite general purpose data structure that naturally -encapsulates wide variety data and problems. -
      • +encapsulates wide variety data and problems. -
    • Nicely captures apparent properties of the brain. -
      • +
    • Nicely captures apparent properties of the brain.
      • -
    • Naturally supports distributed and parallel geometrical data storage -and computation. -
      • +
    • Naturally supports distributed and parallel geometrical data storage +and computation.
      • -
    • Dedicated hardware like CM-1 can be built around hypercube concept +
    • Dedicated hardware like CM-1 can be built around hypercube concept that results in data, computation process and hardware, all beautifully fitting together while complementing each other -strengths. -
      • +strengths.
    • Hypercube stored data (and computation process) has geometry by its nature and should fit nicely with "3D first" user interface ideology -of the parent Sixth project. -
      • +of the parent Sixth project.
    -
    -

    5 Geometrical computation idea

    +
    +

    5 Geometrical computation idea

    -
    -

    5.1 Distributed computation and data storage

    +
    +

    5.1 Distributed computation and data storage

    Lots of problems can be translated to geometry (use any shapes and as many dimensions as you need). Solution(s) to such problems could be then found via geometrical search/comparison/lookup results. As a -bonus, such geometrical *data storage* AND *computation* can be -naturally made in *parallel* and *distributed*. +bonus, such geometrical data storage AND computation can be +naturally made in parallel and distributed.

    @@ -377,8 +446,8 @@ part). Question answering is making (relatively simple) lookups

    -
    -

    5.2 Mapping hypercube to object-oriented model and relational database

    +
    +

    5.2 Mapping hypercube to object-oriented model and relational database

    Object oriented programming is inspired by the way human mind @@ -399,42 +468,34 @@ class declares 4 variables for an object, then corresponding object can be stored as a single point inside 4 dimensional hypercube. Variable values translate to point coordinates in that hypercube. That is: numbers and string can be translated to linear -value that can be used as a coordinate along particular dimension. - +value that can be used as a coordinate along particular dimension.

  • Each object class or database table declares its own hypercube that -contain instances (objects) of that class or rows of a table. -
    • +contain instances (objects) of that class or rows of a table.
    -
    -

    5.3 Mapping entity relations in hypercube

    +
    +

    5.3 Mapping entity relations in hypercube

    Consider we want to create database of:

      -
    • Books. -
      • -
    • Authors. -
      • +
    • Books.
      • +
    • Authors.
    • Effort: Amount of time contributed by every author to every book -that he/she wrote. -
      • +that he/she wrote.

    Information above can be represented as 3D cube where dimensions are:

      -
    • X: Book -
      • -
    • Y: Author -
      • -
    • Z: Effort -
      • +
    • X: Book
      • +
    • Y: Author
      • +
    • Z: Effort

    @@ -444,149 +505,118 @@ between authors and the books.

    -
    -

    6 Current status

    +
    +

    6 Current status

      -
    • More or less defined Vision / goal. -
      • +
    • More or less defined Vision / goal.
      • -
    • Collected some inspiring ideas. -
      • +
    • Collected some inspiring ideas.
    • Implemented very simple persistent key-value map.
      • Long term goal is to use it as a backing storage engine and implement more advanced features on top of this via layered -architecture. -
        • -
      -
      • +architecture. +
    -
    -

    7 See also

    +
    +

    7 See also

    Interesting or competing projects with good ideas:

      -
    • ChrysaLisp +
    • flexible user interface building for interacting with different data
        -
      • Assembler/C-Script/Lisp 64 bit, MIMD, multi CPU, multi threaded, -multi core, multi user Parallel OS. With GUI, Terminal, OO -Assembler, Class libraries, C-Script compiler, Lisp interpreter, -Debugger, and more… -
        • -
      -
      • - -
    • CM-1 Connection Machine -
      • - -
    • Gemstone/S -
        -
      • Completely distributed smalltalk based computing -system. -
        • -
      -
      • -
    • Glamorous Toolkit
      • Moldable development environment. It is a live notebook. It is a flexible search interface. It is a fancy code editor. It is a software analysis platform. It is a data visualization engine. All -in one. -
        • +in one. +
      • +
    - +
    -
  • GRAKN.AI +
    +

    7.1 Computation on multi dimensional data

    +
    -
    • +
    +
    +
    +

    7.2 Distributed, reliable, parallel computing systems

    +
    +
      +
    • ChrysaLisp +
        +
      • Assembler/C-Script/Lisp 64 bit, MIMD, multi CPU, multi threaded, +multi core, multi user Parallel OS. With GUI, Terminal, OO +Assembler, Class libraries, C-Script compiler, Lisp interpreter, +Debugger, and more…
        • +
      • + +
    • Gemstone/S +
        +
      • Completely distributed smalltalk based computing +system.
        • +
    • http://phantomos.org/
      • Programs run forever. System crash or reboot does not destroy -state of running program. -
        • -
      -
      • +state of running program. +
  • Magma
      -
    • Multi-user object database for Squeak -
      • -
    -
    • - -
  • Taichi: A Language for High-Performance Computation onSpatially -Sparse Data Structures - -
    • +
  • Multi-user object database for Squeak
    • +
  • TAOS
      -
    • Completely distributed operating system/virtual machine: -
      • +
    • Completely distributed operating system/virtual machine:
      • +
    • - +
    +
    -
  • TileDB +
    +

    7.3 Rules based machine reasoning

    +
      -
    • Analyze and share complex multi-dimensional data at scale -
      • -
    -
    • +
  • GRAKN.AI +
      +
    • database in the form of a knowledge graph that uses machine +reasoning to simplify data processing challenges for AI +applications. https://grakn.ai/
      • +
    • + +
  • Prolog programming language
    • -
    -
    -
    -

    Author: Svjatoslav Agejenko

    -

    Created: 2020-06-20 Sat 03:28

    -

    Emacs 26.1 (Org-mode 9.1.9)

    -
    +
    +

    Author: Svjatoslav Agejenko

    +

    Created: 2021-03-16 Tue 20:48

    +

    Validate

    +
    diff --git a/doc/index.org b/doc/index.org index 9bd24a4..244e743 100644 --- a/doc/index.org +++ b/doc/index.org @@ -174,29 +174,31 @@ between authors and the books. * See also Interesting or competing projects with good ideas: ++ flexible user interface building for interacting with different data + + [[https://gtoolkit.com/][Glamorous Toolkit]] + + Moldable development environment. It is a live notebook. It is a + flexible search interface. It is a fancy code editor. It is a + software analysis platform. It is a data visualization engine. All + in one. + +** Computation on multi dimensional data ++ [[https://rd-alliance.org/system/files/Array-Databases_final-report.pdf][Array Databases: Concepts, Standards, Implementations]] + ++ [[https://tiledb.com/][TileDB]] + + Analyze and share complex multi-dimensional data at scale + ++ [[id:01aa65c1-3d44-44a8-9b90-58454bc6be80][CM-1 Connection Machine]] +** Distributed, reliable, parallel computing systems + [[https://github.com/vygr/ChrysaLisp][ChrysaLisp]] + Assembler/C-Script/Lisp 64 bit, MIMD, multi CPU, multi threaded, multi core, multi user Parallel OS. With GUI, Terminal, OO Assembler, Class libraries, C-Script compiler, Lisp interpreter, Debugger, and more... -+ [[id:01aa65c1-3d44-44a8-9b90-58454bc6be80][CM-1 Connection Machine]] - + [[http://esug.org/data/ESUG2015/3%20wednesday/1100-1130%20SQL%20Queries%20on%20Smalltalk%20Objects/SQL%20Queries%20in%20Smalltalk%20(James%20Foster).pdf][Gemstone/S]] + Completely distributed smalltalk based computing system. -+ [[https://gtoolkit.com/][Glamorous Toolkit]] - + Moldable development environment. It is a live notebook. It is a - flexible search interface. It is a fancy code editor. It is a - software analysis platform. It is a data visualization engine. All - in one. - -+ GRAKN.AI - + database in the form of a knowledge graph that uses machine - reasoning to simplify data processing challenges for AI - applications. https://grakn.ai/ - + http://phantomos.org/ + Programs run forever. System crash or reboot does not destroy state of running program. @@ -204,12 +206,13 @@ Interesting or competing projects with good ideas: + [[http://wiki.squeak.org/squeak/2665][Magma]] + Multi-user object database for Squeak -+ Taichi: A Language for High-Performance Computation onSpatially - Sparse Data Structures - + http://taichi.graphics/wp-content/uploads/2019/09/taichi_lang.pdf - + [[http://www.uruk.org/emu/Taos.html][TAOS]] + Completely distributed operating system/virtual machine: -+ [[https://tiledb.com/][TileDB]] - + Analyze and share complex multi-dimensional data at scale +** Rules based machine reasoning ++ GRAKN.AI + + database in the form of a knowledge graph that uses machine + reasoning to simplify data processing challenges for AI + applications. https://grakn.ai/ + ++ [[https://en.wikipedia.org/wiki/Prolog][Prolog programming language]] -- 2.20.1