X-Git-Url: http://www2.svjatoslav.eu/gitweb/?a=blobdiff_plain;f=doc%2Findex.html;h=0fc38fe52e60b059efa10e8486d947f1022c2f4f;hb=6da6d15b3291c8e14035f5f4f2bd8a2493ab0143;hp=cc7cce511bd10eec26e31452391debda615c27db;hpb=2316187f481ff4854fd93e381e6b1c802cd5bac0;p=sixth-data.git diff --git a/doc/index.html b/doc/index.html index cc7cce5..0fc38fe 100644 --- a/doc/index.html +++ b/doc/index.html @@ -2,7 +2,7 @@ Sixth - system for data storage, computation, exploration and interaction - + @@ -220,25 +220,28 @@ License or later as published by the Free Software Foundation. -
  • other applications hosted at svjatoslav.eu +
  • other applications hosted at svjatoslav.eu
    • -

    1 Vision / goal

    +

    1 Vision / goal

    -Provide versioned, clustered, flexible, object-relational database -functionality for the Sixth computation engine. +Provide versioned, clustered, flexible, distributed, multi-dimensional +data storage engine for the Sixth computation engine.

    +
    @@ -278,85 +283,70 @@ memory. - -
    -
    -
    -

    1.2 Solution (the big idea)

    -
    -

    -I see 4D data structure. -

    - - -
    -

    data model.png -

    -
    - -

    -Dimensions: -

    +
  • Brain (appears to have more than 3D dimensional design. Food for +thought…)
      -
    • List of all the objecs in the system (rows). -
      • -
    • List of all declared unique object fields (columns). -
      • -
    • List of all historical transactions/commits/versions (think of -sheets of paper). -
      • -
    • List of all concurrently running branches/threads. Branches can -appear and merge over time as needed. +
    • https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/ +
        +
      • From there comes following idea: Maybe every problem can be +translated to geometry (use any shapes and as many dimensions as +you need). Solution(s) to such problems would then appear as +relatively simple search/comparison/lookup results. As a bonus, +such geometrical *data storage* AND *computation* can be +naturally made in *parallel* and *distributed*. That's what +neurons in the brain appear to be doing ! :) . Learning means +building/updating the model (the hard part). Question answering +is making (relatively simple) lookups (geometrical queries) +against the model.
        • -
      • (Every cell is concrete field value within an object) +
    - -

    -Partitioning/clustering: -

    -
      -
    • Why not to partition/(load balance) as required across networked -physical computers along arbitrary dimension(s) declared above ?
    +
    • +
    + -

    -Indexing (for fast searching): -

    +
    +

    2 Current status

    +
    -

    -Further optimizations: -

    +
  • Implemented very simple persistent key-value map.
      -
    • In current early stage, trying to focus on minimum possible set of -features that would provide maximum possible set of power/benefit :) +
    • Long term goal is to use it as a backing storage engine and +implement more advanced features on top of this.
      • -
    • Once featres are locked. Anything can be optimised. Optimization for -size (deduplication) can be solved using Git style content -addressible storage mechanism. +
    • - -
    -

    2 Current status

    -
    +
    +

    3 TODO

    +
      -
    • Implemented very simple persistent key-value map. +
    • check out GRAKN.AI: database in the form of a knowledge graph that +uses machine reasoning to simplify data processing challenges for AI +applications. + +
      • -

      -Long term goal is to implement more advanced features on top of this. -

      +
    • check out Magma + +
      • +