X-Git-Url: http://www2.svjatoslav.eu/gitweb/?a=blobdiff_plain;ds=inline;f=doc%2Findex.org;h=35c6bf96e57b91d465a56b9f48fd2b60d75b1f50;hb=9df09aafae65e215f45be21f1f5322134b4828d8;hp=caa29aa68ff459f2cf4c98dfb5808582001817b0;hpb=b382105757c3d9a2bb528fa8e4218354feff2429;p=sixth-data.git
diff --git a/doc/index.org b/doc/index.org
index caa29aa..35c6bf9 100644
--- a/doc/index.org
+++ b/doc/index.org
@@ -1,31 +1,39 @@
-#+TITLE: Sixth - system for data storage, computation, exploration and interaction
+#+TITLE: Sixth Data - Data storage and computing engine
------
-- This is a subproject of [[http://www2.svjatoslav.eu/gitbrowse/sixth/doc/index.html][Sixth]]
+* (document settings) :noexport:
+** use dark style for TWBS-HTML exporter
+#+HTML_HEAD:
+#+HTML_HEAD:
+#+HTML_HEAD:
+#+HTML_HEAD:
-- [[http://www2.svjatoslav.eu/gitweb/?p=sixth-data.git;a=snapshot;h=HEAD;sf=tgz][download latest snapshot]]
+* General
+- This is a subproject of [[https://www3.svjatoslav.eu/projects/sixth/][Sixth]]
-- This program is free software; you can redistribute it and/or modify
- it under the terms of version 3 of the [[https://www.gnu.org/licenses/lgpl.html][GNU Lesser General Public
- License]] or later as published by the Free Software Foundation.
+- This program is free software: you can redistribute it and/or modify
+ it under the terms of the [[https://www.gnu.org/licenses/lgpl.html][GNU Lesser General Public License]] as
+ published by the Free Software Foundation, either version 3 of the
+ License, or (at your option) any later version.
- Program author:
- Svjatoslav Agejenko
- - Homepage: http://svjatoslav.eu
+ - Homepage: https://svjatoslav.eu
- Email: mailto://svjatoslav@svjatoslav.eu
-- [[http://www.svjatoslav.eu/programs.jsp][other applications hosted at svjatoslav.eu]]
+- [[https://www.svjatoslav.eu/projects/][Other software projects hosted at svjatoslav.eu]]
+** Source code
+- [[https://www2.svjatoslav.eu/gitweb/?p=sixth-data.git;a=snapshot;h=HEAD;sf=tgz][Download latest snapshot in TAR GZ format]]
-* (document settings) :noexport:
-** use dark style for TWBS-HTML exporter
-#+HTML_HEAD:
-#+HTML_HEAD:
-#+HTML_HEAD: "
-#+HTML_HEAD:
+- [[https://www2.svjatoslav.eu/gitweb/?p=sixth-data.git;a=summary][Browse Git repository online]]
+
+- Clone Git repository using command:
+ : git clone https://www2.svjatoslav.eu/git/sixth-data.git
+
+- See [[https://www3.svjatoslav.eu/projects/sixth-data/apidocs/][JavaDoc]].
* Vision / goal
:PROPERTIES:
@@ -36,15 +44,19 @@ data storage engine for the [[http://www2.svjatoslav.eu/gitbrowse/sixth/doc/inde
+ Speaking of traditional relational database and object oriented
business applications:
+
+ I hate object-relational impedance mismatch.
+ I don't like to convert data between persistent database and
- runtime objects for every transaction. How about creating united
- database/computation engine instead to:
- + Eliminate constant moving and converting of data between 2 systems.
+ runtime objects for every transaction. How about creating united
+ database/computation engine instead to:
+
+ + Eliminate constant moving and converting of data between 2 systems
+ and make computing happen close to where the data is stored.
+
+ Abstract away difference between RAM VS persistent storage. Let
- the system decide at runtime which data to keep in what kind of
- memory.
+ the system decide at runtime which data to keep in what kind of
+ memory.
* Inspiration
+ Relational databases:
@@ -62,15 +74,17 @@ data storage engine for the [[http://www2.svjatoslav.eu/gitbrowse/sixth/doc/inde
:PROPERTIES:
:ID: d2375acc-af14-4f18-8ad0-7949501178c5
:END:
-+ Appears to have more than 3D dimensional design. Food for
- thought...)
- + https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/
++ Brain appears to have more than 3D dimensional design:
+ https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/
+
++ Brain appears to use geometry to map thoughts and even sounds:
+ + https://www.quantamagazine.org/the-brain-maps-out-ideas-and-memories-like-spaces-20190114/
+ + https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328
+ It directly inspires following ideas
+ [[id:5d287158-53ea-44a2-a754-dd862366066a][Distributed comutation and data storage]]
+ [[id:a117c11e-97c1-4822-88b2-9fc10f96caec][Mapping of hyperspace to traditional object-oriented model]]
+ [[id:b6b15bd2-c78b-4c51-a343-72843a515c29][Handling of relations]]
-
* Ideas
** Distributed computation and data storage
:PROPERTIES:
@@ -130,7 +144,25 @@ Alternatively:
+ Point location along particular (book) dimension corresponds to
amount of work contributed for book by given author (point).
+** Layered architecture
++ layer 1 :: disk / block storage / partition
+
++ layer 2 :: key/value storage. Keys are unique and are dictated by
+ storage engine. Value is arbitrary but limited size byte
+ array. This layer is responsible for handling disk
+ defragmentation and consistency in case of crash
+ recovery.
+
++ layer 3 :: key/value storage. Keys are content hashes. Values are
+ arbitrary but limited size content byte arrays. This
+ layer effectively implements content addressable
+ storage. Content addressible storage enables GIT-like
+ behavior (possibility for competing branches, retaining
+ history, transparent deduplication)
++ layer 4 :: Implements arbitrary dimensional multiverse.
+
++ layer 5 :: Distributed computation engine.
* Current status
- More or less defined [[id:f6764282-a6f6-44e6-8716-b428074dd093][Vision / goal]].
@@ -143,16 +175,23 @@ Alternatively:
* See also
Interesting or competing projects with good ideas:
-+ GRAKN.AI: database in the form of a knowledge graph that uses
- machine reasoning to simplify data processing challenges for AI
- applications.
- + https://grakn.ai/
++ GRAKN.AI
+ + database in the form of a knowledge graph that uses machine
+ reasoning to simplify data processing challenges for AI
+ applications. https://grakn.ai/
+
++ [[http://wiki.squeak.org/squeak/2665][Magma]]
+ + Multi-user object database for Squeak
-+ Gemstone/S based on Smalltalk.
- + http://esug.org/data/ESUG2015/3%20wednesday/1100-1130%20SQL%20Queries%20on%20Smalltalk%20Objects/SQL%20Queries%20in%20Smalltalk%20(James%20Foster).pdf
++ [[http://esug.org/data/ESUG2015/3%20wednesday/1100-1130%20SQL%20Queries%20on%20Smalltalk%20Objects/SQL%20Queries%20in%20Smalltalk%20(James%20Foster).pdf][Gemstone/S]]
+ + Completely distributed smalltalk based computing
+ system.
-+ Magma distributed database in Smalltalk.
- + http://wiki.squeak.org/squeak/2665
++ [[http://www.uruk.org/emu/Taos.html][TAOS]]
+ + Completely distributed operating system/virtual machine:
-+ ZetaVM
- + https://github.com/zetavm/zetavm
++ [[https://github.com/vygr/ChrysaLisp][ChrysaLisp]]
+ + Assembler/C-Script/Lisp 64 bit, MIMD, multi CPU, multi threaded,
+ multi core, multi user Parallel OS. With GUI, Terminal, OO
+ Assembler, Class libraries, C-Script compiler, Lisp interpreter,
+ Debugger, and more...