4 <title>Sixth - system for data storage, computation, exploration and interaction</title>
5 <!-- 2017-07-29 Sat 13:31 -->
7 <meta name="viewport" content="width=device-width, initial-scale=1">
8 <meta name="generator" content="Org-mode">
9 <meta name="author" content="Svjatoslav Agejenko">
10 <link href="https://bootswatch.com/darkly/bootstrap.min.css" rel="stylesheet">
11 <script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
12 <script src="https://cdnjs.cloudflare.com/ajax/libs/twitter-bootstrap/3.3.1/js/bootstrap.min.js"></script>"
13 <style type="text/css">
14 footer {background-color: #111 !important;}
15 pre {background-color: #111; color: #ccc;}
17 <style type="text/css">
18 /* org mode styles on top of twbs */
35 background-color: #f5f5f5;
62 display: inline-block;
74 .bs-docs-sidebar.affix {
77 @media (min-width: 768px) {
83 /* All levels of nav */
84 .bs-docs-sidebar .nav > li > a {
91 .bs-docs-sidebar .nav > li > a:hover,
92 .bs-docs-sidebar .nav > li > a:focus {
95 text-decoration: none;
96 background-color: transparent;
97 border-left: 1px solid #A1283B;
99 .bs-docs-sidebar .nav > .active > a,
100 .bs-docs-sidebar .nav > .active:hover > a,
101 .bs-docs-sidebar .nav > .active:focus > a {
105 background-color: transparent;
106 border-left: 2px solid #A1283B;
109 /* Nav: second level (shown on .active) */
110 .bs-docs-sidebar .nav .nav {
111 display: none; /* Hide by default, but at >768px, show it */
112 padding-bottom: 10px;
114 .bs-docs-sidebar .nav .nav > li > a {
121 .bs-docs-sidebar .nav .nav > li > a:hover,
122 .bs-docs-sidebar .nav .nav > li > a:focus {
125 .bs-docs-sidebar .nav .nav > .active > a,
126 .bs-docs-sidebar .nav .nav > .active:hover > a,
127 .bs-docs-sidebar .nav .nav > .active:focus > a {
132 /* Nav: third level (shown on .active) */
133 .bs-docs-sidebar .nav .nav .nav {
134 padding-bottom: 10px;
136 .bs-docs-sidebar .nav .nav .nav > li > a {
143 .bs-docs-sidebar .nav .nav .nav > li > a:hover,
144 .bs-docs-sidebar .nav .nav .nav > li > a:focus {
147 .bs-docs-sidebar .nav .nav .nav > .active > a,
148 .bs-docs-sidebar .nav .nav .nav > .active:hover > a,
149 .bs-docs-sidebar .nav .nav .nav > .active:focus > a {
154 /* Show and affix the side nav when space allows it */
155 @media (min-width: 992px) {
156 .bs-docs-sidebar .nav > .active > ul {
159 /* Widen the fixed sidebar */
160 .bs-docs-sidebar.affix,
161 .bs-docs-sidebar.affix-bottom {
164 .bs-docs-sidebar.affix {
165 position: fixed; /* Undo the static from mobile first approach */
168 .bs-docs-sidebar.affix-bottom {
169 position: absolute; /* Undo the static from mobile first approach */
171 .bs-docs-sidebar.affix .bs-docs-sidenav,.bs-docs-sidebar.affix-bottom .bs-docs-sidenav {
176 @media (min-width: 1200px) {
177 /* Widen the fixed sidebar again */
178 .bs-docs-sidebar.affix-bottom,
179 .bs-docs-sidebar.affix {
184 <script type="text/javascript">
188 $('.bs-docs-sidebar li').first().addClass('active');
190 $(document.body).scrollspy({target: '.bs-docs-sidebar'});
192 $('.bs-docs-sidebar').affix();
197 <div id="content" class="container">
198 <div class="row"><div class="col-md-9"><h1 class="title">Sixth - system for data storage, computation, exploration and interaction</h1>
201 <li>This is a subproject of <a href="http://www2.svjatoslav.eu/gitbrowse/sixth/doc/index.html">Sixth</a>
204 <li><a href="http://www2.svjatoslav.eu/gitweb/?p=sixth-data.git;a=snapshot;h=HEAD;sf=tgz">download latest snapshot</a>
207 <li>This program is free software; you can redistribute it and/or modify
208 it under the terms of version 3 of the <a href="https://www.gnu.org/licenses/lgpl.html">GNU Lesser General Public
209 License</a> or later as published by the Free Software Foundation.
214 <li>Svjatoslav Agejenko
216 <li>Homepage: <a href="http://svjatoslav.eu">http://svjatoslav.eu</a>
218 <li>Email: <a href="mailto://svjatoslav@svjatoslav.eu">mailto://svjatoslav@svjatoslav.eu</a>
223 <li><a href="http://www.svjatoslav.eu/programs.jsp">other applications hosted at svjatoslav.eu</a>
228 <div id="outline-container-sec-1" class="outline-2">
229 <h2 id="sec-1"><a id="ID-f6764282-a6f6-44e6-8716-b428074dd093" name="ID-f6764282-a6f6-44e6-8716-b428074dd093"></a><span class="section-number-2">1</span> Vision / goal</h2>
230 <div class="outline-text-2" id="text-1">
232 Provide versioned, clustered, flexible, distributed, multi-dimensional
233 data storage engine for the <a href="http://www2.svjatoslav.eu/gitbrowse/sixth/doc/index.html">Sixth computation engine</a>.
237 <li>Speaking of traditional relational database and object oriented
238 business applications:
240 <li>I hate object-relational impedance mismatch.
243 <li>I don't like to convert data between persistent database and
247 runtime objects for every transaction. How about creating united
248 database/computation engine instead to:
251 <li>Eliminate constant moving and converting of data between 2 systems.
253 <li>Abstract away difference between RAM VS persistent storage. Let
257 the system decide at runtime which data to keep in what kind of
265 <div id="outline-container-sec-2" class="outline-2">
266 <h2 id="sec-2"><span class="section-number-2">2</span> Inspiration</h2>
267 <div class="outline-text-2" id="text-2">
269 <li>Relational databases:
273 <li>Indexable / Quickly searchable.
278 <li>Git (version control system)
282 <li>Branchable / mergeable.
284 <li>Transparent cansistency, checksumming and deduplication.
286 <li>(Git as a database:
290 <a href="https://www.kenneth-truyers.net/2016/10/13/git-nosql-database/">https://www.kenneth-truyers.net/2016/10/13/git-nosql-database/</a> )
296 <div id="outline-container-sec-2-1" class="outline-3">
297 <h3 id="sec-2-1"><a id="ID-d2375acc-af14-4f18-8ad0-7949501178c5" name="ID-d2375acc-af14-4f18-8ad0-7949501178c5"></a><span class="section-number-3">2.1</span> Brain</h3>
298 <div class="outline-text-3" id="text-2-1">
300 <li>Appears to have more than 3D dimensional design. Food for
303 <li><a href="https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/">https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/</a>
308 <li>It directly inspires following ideas
310 <li><a href="#sec-3-1">Distributed comutation and data storage</a>
312 <li><a href="#sec-3-2">Mapping of hyperspace to traditional object-oriented model</a>
314 <li><a href="#sec-3-3">Handling of relations</a>
323 <div id="outline-container-sec-3" class="outline-2">
324 <h2 id="sec-3"><span class="section-number-2">3</span> Ideas</h2>
325 <div class="outline-text-2" id="text-3">
326 </div><div id="outline-container-sec-3-1" class="outline-3">
327 <h3 id="sec-3-1"><a id="ID-5d287158-53ea-44a2-a754-dd862366066a" name="ID-5d287158-53ea-44a2-a754-dd862366066a"></a><span class="section-number-3">3.1</span> Distributed computation and data storage</h3>
328 <div class="outline-text-3" id="text-3-1">
330 Maybe every problem can be translated to geometry (use any shapes and
331 as many dimensions as you need). Solution(s) to such problems would
332 then appear as relatively simple search/comparison/lookup results. As
333 a bonus, such geometrical *data storage* AND *computation* can be
334 naturally made in *parallel* and *distributed*. That's what neurons in
335 the brain appear to be doing ! :) . Learning means building/updating
336 the model (the hard part). Question answering is making (relatively
337 simple) lookups (geometrical queries) against the model.
341 <div id="outline-container-sec-3-2" class="outline-3">
342 <h3 id="sec-3-2"><a id="ID-a117c11e-97c1-4822-88b2-9fc10f96caec" name="ID-a117c11e-97c1-4822-88b2-9fc10f96caec"></a><span class="section-number-3">3.2</span> Mapping of hyperspace to traditional object-oriented model</h3>
343 <div class="outline-text-3" id="text-3-2">
345 Object oriented programming is inspired by the way human mind
346 operates. It allows programmer to express ideas to computer in a more
351 It is possible to map object model to geometrical hyperspace:
355 <li>Object is a point in space (universe). Each object member variable
356 translates to its own dimension. That is: if class declares 4
357 variables for an object, then corresponding object can be stored as
358 a single point inside 4 dimensional space. Variable values translate
359 to point coordinates in space. That is: Integer, floating point
360 number and even boolean and string can be translated to linear value
361 that can be used as a coordinate along particular dimension.
364 <li>Each class declares its own space (universe). All class instances
365 (objects) are points inside that particular universe. References
366 between objects of different types are hyperlinks (portals) between
372 <div id="outline-container-sec-3-3" class="outline-3">
373 <h3 id="sec-3-3"><a id="ID-b6b15bd2-c78b-4c51-a343-72843a515c29" name="ID-b6b15bd2-c78b-4c51-a343-72843a515c29"></a><span class="section-number-3">3.3</span> Handling of relations</h3>
374 <div class="outline-text-3" id="text-3-3">
376 Consider we want to create database of books and authors. Book can
377 have multiple authors, and single person can be author for multiple
378 books. It is possible to store how many hours of work each author has
379 contributed to every book, using hyperspace as follows:
383 <li>Every dimension corresponds to one particular book author. (10
384 authors in the database, would require 10 dimensional space)
386 <li>Point in space corresponds to one particular book.
388 <li>Point location along particular (author) dimension corresponds
389 to amount of work contributed by particular author for given
403 <li>Every dimension corresponds to one particular book.
405 <li>Point in space corresponds to one particular author in the entire
408 <li>Point location along particular (book) dimension corresponds to
409 amount of work contributed for book by given author (point).
421 <div id="outline-container-sec-4" class="outline-2">
422 <h2 id="sec-4"><span class="section-number-2">4</span> Current status</h2>
423 <div class="outline-text-2" id="text-4">
425 <li>More or less defined <a href="#sec-1">Vision / goal</a>.
428 <li>Collected some <a href="#sec-2-1">ideas</a>.
431 <li>Implemented very simple persistent key-value map.
433 <li>Long term goal is to use it as a backing storage engine and
434 implement more advanced features on top of this.
442 <div id="outline-container-sec-5" class="outline-2">
443 <h2 id="sec-5"><span class="section-number-2">5</span> See also</h2>
444 <div class="outline-text-2" id="text-5">
446 Interesting or competing projects with good ideas:
450 <li>GRAKN.AI: database in the form of a knowledge graph that uses
451 machine reasoning to simplify data processing challenges for AI
454 <li><a href="https://grakn.ai/">https://grakn.ai/</a>
459 <li>Gemstone/S based on Smalltalk.
461 <li><a href="http://esug.org/data/ESUG2015/3%20wednesday/1100-1130%20SQL%20Queries%20on%20Smalltalk%20Objects/SQL%20Queries%20in%20Smalltalk%20(James%20Foster)">http://esug.org/data/ESUG2015/3%20wednesday/1100-1130%20SQL%20Queries%20on%20Smalltalk%20Objects/SQL%20Queries%20in%20Smalltalk%20(James%20Foster)</a>.pdf
466 <li>Magma distributed database in Smalltalk.
468 <li><a href="http://wiki.squeak.org/squeak/2665">http://wiki.squeak.org/squeak/2665</a>
475 <li><a href="https://github.com/zetavm/zetavm">https://github.com/zetavm/zetavm</a>
482 </div><div class="col-md-3"><nav id="table-of-contents">
483 <div id="text-table-of-contents" class="bs-docs-sidebar">
485 <li><a href="#sec-1">1. Vision / goal</a></li>
486 <li><a href="#sec-2">2. Inspiration</a>
488 <li><a href="#sec-2-1">2.1. Brain</a></li>
491 <li><a href="#sec-3">3. Ideas</a>
493 <li><a href="#sec-3-1">3.1. Distributed computation and data storage</a></li>
494 <li><a href="#sec-3-2">3.2. Mapping of hyperspace to traditional object-oriented model</a></li>
495 <li><a href="#sec-3-3">3.3. Handling of relations</a></li>
498 <li><a href="#sec-4">4. Current status</a></li>
499 <li><a href="#sec-5">5. See also</a></li>
504 <footer id="postamble" class="">
505 <div><p class="author">Author: Svjatoslav Agejenko</p>
506 <p class="date">Created: 2017-07-29 Sat 13:31</p>
507 <p class="creator"><a href="http://www.gnu.org/software/emacs/">Emacs</a> 25.1.1 (<a href="http://orgmode.org">Org-mode</a> 8.2.10)</p>