"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<head>
-<!-- 2021-03-16 Tue 20:48 -->
+<!-- 2022-10-30 Sun 12:09 -->
<meta http-equiv="Content-Type" content="text/html;charset=utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<title>Sixth Data - Data storage and computing engine</title>
-<meta name="generator" content="Org mode" />
<meta name="author" content="Svjatoslav Agejenko" />
-<style type="text/css">
- <!--/*--><![CDATA[/*><!--*/
+<meta name="generator" content="Org Mode" />
+<style>
+ #content { max-width: 60em; margin: auto; }
.title { text-align: center;
margin-bottom: .2em; }
.subtitle { text-align: center;
#postamble p, #preamble p { font-size: 90%; margin: .2em; }
p.verse { margin-left: 3%; }
pre {
- border: 1px solid #ccc;
- box-shadow: 3px 3px 3px #eee;
+ border: 1px solid #e6e6e6;
+ border-radius: 3px;
+ background-color: #f2f2f2;
padding: 8pt;
font-family: monospace;
overflow: auto;
}
pre.src {
position: relative;
- overflow: visible;
- padding-top: 1.2em;
+ overflow: auto;
}
pre.src:before {
display: none;
position: absolute;
- background-color: white;
- top: -10px;
- right: 10px;
+ top: -8px;
+ right: 12px;
padding: 3px;
- border: 1px solid black;
+ color: #555;
+ background-color: #f2f2f299;
}
- pre.src:hover:before { display: inline;}
+ pre.src:hover:before { display: inline; margin-top: 14px;}
/* Languages per Org manual */
pre.src-asymptote:before { content: 'Asymptote'; }
pre.src-awk:before { content: 'Awk'; }
+ pre.src-authinfo::before { content: 'Authinfo'; }
pre.src-C:before { content: 'C'; }
/* pre.src-C++ doesn't work in CSS */
pre.src-clojure:before { content: 'Clojure'; }
{ font-size: 10px; font-weight: bold; white-space: nowrap; }
.org-info-js_search-highlight
{ background-color: #ffff00; color: #000000; font-weight: bold; }
- .org-svg { width: 90%; }
- /*]]>*/-->
+ .org-svg { }
</style>
<link href="https://bootswatch.com/3/darkly/bootstrap.min.css" rel="stylesheet">
<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/1.11.3/jquery.min.js"></script>
pre {background-color: #111; color: #ccc;}
</style>
<link rel="stylesheet" type="text/css" href="https://thomasf.github.io/solarized-css/solarized-dark.min.css" />
-<script type="text/javascript">
-/*
-@licstart The following is the entire license notice for the
-JavaScript code in this tag.
-
-Copyright (C) 2012-2020 Free Software Foundation, Inc.
-
-The JavaScript code in this tag is free software: you can
-redistribute it and/or modify it under the terms of the GNU
-General Public License (GNU GPL) as published by the Free Software
-Foundation, either version 3 of the License, or (at your option)
-any later version. The code is distributed WITHOUT ANY WARRANTY;
-without even the implied warranty of MERCHANTABILITY or FITNESS
-FOR A PARTICULAR PURPOSE. See the GNU GPL for more details.
-
-As additional permission under GNU GPL version 3 section 7, you
-may distribute non-source (e.g., minimized or compacted) forms of
-that code without the copy of the GNU GPL normally required by
-section 4, provided you include this license notice and a URL
-through which recipients can access the Corresponding Source.
-
-
-@licend The above is the entire license notice
-for the JavaScript code in this tag.
-*/
-<!--/*--><![CDATA[/*><!--*/
- function CodeHighlightOn(elem, id)
- {
- var target = document.getElementById(id);
- if(null != target) {
- elem.cacheClassElem = elem.className;
- elem.cacheClassTarget = target.className;
- target.className = "code-highlighted";
- elem.className = "code-highlighted";
- }
- }
- function CodeHighlightOff(elem, id)
- {
- var target = document.getElementById(id);
- if(elem.cacheClassElem)
- elem.className = elem.cacheClassElem;
- if(elem.cacheClassTarget)
- target.className = elem.cacheClassTarget;
- }
-/*]]>*///-->
-</script>
</head>
<body>
-<div id="content">
+<div id="content" class="content">
<h1 class="title">Sixth Data - Data storage and computing engine</h1>
-<div id="table-of-contents">
+<div id="table-of-contents" role="doc-toc">
<h2>Table of Contents</h2>
-<div id="text-table-of-contents">
+<div id="text-table-of-contents" role="doc-toc">
<ul>
-<li><a href="#orgeab6191">1. General</a>
+<li><a href="#org575e4cf">1. General</a>
<ul>
-<li><a href="#org7ecc9d8">1.1. Source code</a></li>
+<li><a href="#org960610f">1.1. Source code</a></li>
</ul>
</li>
-<li><a href="#org5efecb1">2. Vision / goal</a></li>
-<li><a href="#orgf50bee5">3. Inspiration</a>
+<li><a href="#orga6ad9b1">2. Vision / goal</a></li>
+<li><a href="#org923cf0c">3. Inspiration</a>
<ul>
-<li><a href="#orge517915">3.1. Brain</a></li>
-<li><a href="#org4d6ef67">3.2. CM-1 Connection Machine</a></li>
+<li><a href="#org6e89e58">3.1. Brain</a></li>
+<li><a href="#org75acc06">3.2. CM-1 Connection Machine</a></li>
</ul>
</li>
-<li><a href="#orge26c065">4. Reasons for hypercube as a so called first class citizen</a></li>
-<li><a href="#org4f408df">5. Geometrical computation idea</a>
+<li><a href="#orgcce2d30">4. Reasons for hypercube as a so called first class citizen</a></li>
+<li><a href="#orga5de57b">5. Geometrical computation idea</a>
<ul>
-<li><a href="#org86e13fb">5.1. Distributed computation and data storage</a></li>
-<li><a href="#orgc8bbf69">5.2. Mapping hypercube to object-oriented model and relational database</a></li>
-<li><a href="#org6b2bdc0">5.3. Mapping entity relations in hypercube</a></li>
-</ul>
-</li>
-<li><a href="#org5c3a882">6. Current status</a></li>
-<li><a href="#orgfccb4f4">7. See also</a>
-<ul>
-<li><a href="#orgaf37e2e">7.1. Computation on multi dimensional data</a></li>
-<li><a href="#org56bd168">7.2. Distributed, reliable, parallel computing systems</a></li>
-<li><a href="#orgb6ed46a">7.3. Rules based machine reasoning</a></li>
+<li><a href="#org7c36ce8">5.1. Distributed computation and data storage</a></li>
+<li><a href="#orgb3e5e90">5.2. Mapping hypercube to object-oriented model and relational database</a></li>
+<li><a href="#orgad3411a">5.3. Mapping entity relations in hypercube</a></li>
</ul>
</li>
+<li><a href="#orge747c35">6. Current status</a></li>
</ul>
</div>
</div>
-<div id="outline-container-orgeab6191" class="outline-2">
-<h2 id="orgeab6191"><span class="section-number-2">1</span> General</h2>
+<div id="outline-container-org575e4cf" class="outline-2">
+<h2 id="org575e4cf"><span class="section-number-2">1.</span> General</h2>
<div class="outline-text-2" id="text-1">
<ul class="org-ul">
<li>This program is free software: released under Creative Commons Zero
</ul>
</div>
-<div id="outline-container-org7ecc9d8" class="outline-3">
-<h3 id="org7ecc9d8"><span class="section-number-3">1.1</span> Source code</h3>
+<div id="outline-container-org960610f" class="outline-3">
+<h3 id="org960610f"><span class="section-number-3">1.1.</span> Source code</h3>
<div class="outline-text-3" id="text-1-1">
<ul class="org-ul">
<li><a href="https://www2.svjatoslav.eu/gitweb/?p=sixth-data.git;a=snapshot;h=HEAD;sf=tgz">Download latest snapshot in TAR GZ format</a></li>
</div>
</div>
-<div id="outline-container-org5efecb1" class="outline-2">
-<h2 id="org5efecb1"><span class="section-number-2">2</span> Vision / goal</h2>
+<div id="outline-container-orga6ad9b1" class="outline-2">
+<h2 id="orga6ad9b1"><span class="section-number-2">2.</span> Vision / goal</h2>
<div class="outline-text-2" id="text-2">
<p>
Provide hackable, versioned, optimized, distributed, geometrical,
-arbitrary dimensional (<a href="#orge26c065">hypercube based</a>) data storage and computation
-engine (<a href="#orge517915">as inspired by the brain</a>) for general purpose visual computing
+arbitrary dimensional (<a href="#orgcce2d30">hypercube based</a>) data storage and computation
+engine (<a href="#org6e89e58">as inspired by the brain</a>) for general purpose visual computing
environment called <a href="http://www2.svjatoslav.eu/gitbrowse/sixth/doc/index.html">Sixth</a>.
</p>
</p>
</div>
</div>
-<div id="outline-container-orgf50bee5" class="outline-2">
-<h2 id="orgf50bee5"><span class="section-number-2">3</span> Inspiration</h2>
+<div id="outline-container-org923cf0c" class="outline-2">
+<h2 id="org923cf0c"><span class="section-number-2">3.</span> Inspiration</h2>
<div class="outline-text-2" id="text-3">
<ul class="org-ul">
<li>see also: <a href="https://en.wikipedia.org/wiki/OLAP_cube">OLAP cube</a>.</li>
</ul>
</div>
-<div id="outline-container-orge517915" class="outline-3">
-<h3 id="orge517915"><span class="section-number-3">3.1</span> Brain</h3>
+<div id="outline-container-org6e89e58" class="outline-3">
+<h3 id="org6e89e58"><span class="section-number-3">3.1.</span> Brain</h3>
<div class="outline-text-3" id="text-3-1">
<ul class="org-ul">
<li>Brain appears to be natural geometrical/parallel data storage and
computational engine:
<ul class="org-ul">
<li><a href="https://www.quantamagazine.org/the-brain-maps-out-ideas-and-memories-like-spaces-20190114/">https://www.quantamagazine.org/the-brain-maps-out-ideas-and-memories-like-spaces-20190114/</a></li>
+<li><a href="https://www.simonsfoundation.org/2021/04/07/geometrical-thinking-offers-a-window-into-computation/">Geometrical Thinking Offers a Window Into Computation</a></li>
</ul></li>
<li>Even more awesome is that brain appears to operate and is wired as
<li><a href="https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328">https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328</a></li>
</ul></li>
-<li>Such properties allow parallel <a href="#org4f408df">Geometrical computation</a> and
-beautifully fits <a href="#org4d6ef67">CM-1 Connection Machine</a> architecture (for extra
+<li>Such properties allow parallel <a href="#orga5de57b">Geometrical computation</a> and
+beautifully fits <a href="#org75acc06">CM-1 Connection Machine</a> architecture (for extra
hardware accelerated solution).</li>
</ul>
</div>
</div>
-<div id="outline-container-org4d6ef67" class="outline-3">
-<h3 id="org4d6ef67"><span class="section-number-3">3.2</span> CM-1 Connection Machine</h3>
+
+<div id="outline-container-org75acc06" class="outline-3">
+<h3 id="org75acc06"><span class="section-number-3">3.2.</span> CM-1 Connection Machine</h3>
<div class="outline-text-3" id="text-3-2">
<p>
<a href="https://en.wikipedia.org/wiki/Connection_Machine">https://en.wikipedia.org/wiki/Connection_Machine</a>
<p>
we can pre-distribute data across computation units and perform
-parallel <a href="#org4f408df">geometrical computation</a>.
+parallel <a href="#orga5de57b">geometrical computation</a>.
</p>
</div>
</div>
</div>
-<div id="outline-container-orge26c065" class="outline-2">
-<h2 id="orge26c065"><span class="section-number-2">4</span> Reasons for hypercube as a so called first class citizen</h2>
+<div id="outline-container-orgcce2d30" class="outline-2">
+<h2 id="orgcce2d30"><span class="section-number-2">4.</span> Reasons for hypercube as a so called first class citizen</h2>
<div class="outline-text-2" id="text-4">
<ul class="org-ul">
<li>Hypercube is quite general purpose data structure that naturally
encapsulates wide variety data and problems.</li>
-<li>Nicely captures apparent <a href="#orge517915">properties of the brain</a>.</li>
+<li>Nicely captures apparent <a href="#org6e89e58">properties of the brain</a>.</li>
-<li>Naturally supports distributed and parallel <a href="#org4f408df">geometrical data storage
+<li>Naturally supports distributed and parallel <a href="#orga5de57b">geometrical data storage
and computation.</a></li>
-<li>Dedicated hardware like <a href="#org4d6ef67">CM-1</a> can be built around hypercube concept
+<li>Dedicated hardware like <a href="#org75acc06">CM-1</a> can be built around hypercube concept
that results in data, computation process and hardware, all
beautifully fitting together while complementing each other
strengths.</li>
</ul>
</div>
</div>
-<div id="outline-container-org4f408df" class="outline-2">
-<h2 id="org4f408df"><span class="section-number-2">5</span> Geometrical computation idea</h2>
+<div id="outline-container-orga5de57b" class="outline-2">
+<h2 id="orga5de57b"><span class="section-number-2">5.</span> Geometrical computation idea</h2>
<div class="outline-text-2" id="text-5">
</div>
-<div id="outline-container-org86e13fb" class="outline-3">
-<h3 id="org86e13fb"><span class="section-number-3">5.1</span> Distributed computation and data storage</h3>
+<div id="outline-container-org7c36ce8" class="outline-3">
+<h3 id="org7c36ce8"><span class="section-number-3">5.1.</span> Distributed computation and data storage</h3>
<div class="outline-text-3" id="text-5-1">
<p>
Lots of problems can be translated to geometry (use any shapes and as
</p>
</div>
</div>
-<div id="outline-container-orgc8bbf69" class="outline-3">
-<h3 id="orgc8bbf69"><span class="section-number-3">5.2</span> Mapping hypercube to object-oriented model and relational database</h3>
+<div id="outline-container-orgb3e5e90" class="outline-3">
+<h3 id="orgb3e5e90"><span class="section-number-3">5.2.</span> Mapping hypercube to object-oriented model and relational database</h3>
<div class="outline-text-3" id="text-5-2">
<p>
Object oriented programming is inspired by the way human mind
</div>
</div>
-<div id="outline-container-org6b2bdc0" class="outline-3">
-<h3 id="org6b2bdc0"><span class="section-number-3">5.3</span> Mapping entity relations in hypercube</h3>
+<div id="outline-container-orgad3411a" class="outline-3">
+<h3 id="orgad3411a"><span class="section-number-3">5.3.</span> Mapping entity relations in hypercube</h3>
<div class="outline-text-3" id="text-5-3">
<p>
Consider we want to create database of:
</div>
</div>
</div>
-<div id="outline-container-org5c3a882" class="outline-2">
-<h2 id="org5c3a882"><span class="section-number-2">6</span> Current status</h2>
+<div id="outline-container-orge747c35" class="outline-2">
+<h2 id="orge747c35"><span class="section-number-2">6.</span> Current status</h2>
<div class="outline-text-2" id="text-6">
<ul class="org-ul">
-<li>More or less defined <a href="#org5efecb1">Vision / goal</a>.</li>
+<li>More or less defined <a href="#orga6ad9b1">Vision / goal</a>.</li>
-<li>Collected some <a href="#orgf50bee5">inspiring</a> <a href="#org4f408df">ideas</a>.</li>
+<li>Collected some <a href="#org923cf0c">inspiring</a> <a href="#orga5de57b">ideas</a>.</li>
<li>Implemented very simple persistent key-value map.
<ul class="org-ul">
</ul>
</div>
</div>
-
-<div id="outline-container-orgfccb4f4" class="outline-2">
-<h2 id="orgfccb4f4"><span class="section-number-2">7</span> See also</h2>
-<div class="outline-text-2" id="text-7">
-<p>
-Interesting or competing projects with good ideas:
-</p>
-
-<ul class="org-ul">
-<li>flexible user interface building for interacting with different data
-<ul class="org-ul">
-<li><a href="https://gtoolkit.com/">Glamorous Toolkit</a>
-<ul class="org-ul">
-<li>Moldable development environment. It is a live notebook. It is a
-flexible search interface. It is a fancy code editor. It is a
-software analysis platform. It is a data visualization engine. All
-in one.</li>
-</ul></li>
-</ul></li>
-</ul>
-</div>
-
-<div id="outline-container-orgaf37e2e" class="outline-3">
-<h3 id="orgaf37e2e"><span class="section-number-3">7.1</span> Computation on multi dimensional data</h3>
-<div class="outline-text-3" id="text-7-1">
-<ul class="org-ul">
-<li><a href="https://rd-alliance.org/system/files/Array-Databases_final-report.pdf">Array Databases: Concepts, Standards, Implementations</a></li>
-
-<li><a href="https://tiledb.com/">TileDB</a>
-<ul class="org-ul">
-<li>Analyze and share complex multi-dimensional data at scale</li>
-</ul></li>
-
-<li><a href="#org4d6ef67">CM-1 Connection Machine</a></li>
-</ul>
-</div>
-</div>
-<div id="outline-container-org56bd168" class="outline-3">
-<h3 id="org56bd168"><span class="section-number-3">7.2</span> Distributed, reliable, parallel computing systems</h3>
-<div class="outline-text-3" id="text-7-2">
-<ul class="org-ul">
-<li><a href="https://github.com/vygr/ChrysaLisp">ChrysaLisp</a>
-<ul class="org-ul">
-<li>Assembler/C-Script/Lisp 64 bit, MIMD, multi CPU, multi threaded,
-multi core, multi user Parallel OS. With GUI, Terminal, OO
-Assembler, Class libraries, C-Script compiler, Lisp interpreter,
-Debugger, and more…</li>
-</ul></li>
-
-<li><a href="http://esug.org/data/ESUG2015/3%20wednesday/1100-1130%20SQL%20Queries%20on%20Smalltalk%20Objects/SQL%20Queries%20in%20Smalltalk%20(James%20Foster).pdf">Gemstone/S</a>
-<ul class="org-ul">
-<li>Completely distributed smalltalk based computing
-system.</li>
-</ul></li>
-
-<li><a href="http://phantomos.org/">http://phantomos.org/</a>
-<ul class="org-ul">
-<li>Programs run forever. System crash or reboot does not destroy
-state of running program.</li>
-</ul></li>
-
-<li><a href="http://wiki.squeak.org/squeak/2665">Magma</a>
-<ul class="org-ul">
-<li>Multi-user object database for Squeak</li>
-</ul></li>
-
-<li><a href="http://www.uruk.org/emu/Taos.html">TAOS</a>
-<ul class="org-ul">
-<li>Completely distributed operating system/virtual machine:</li>
-</ul></li>
-</ul>
-</div>
-</div>
-
-<div id="outline-container-orgb6ed46a" class="outline-3">
-<h3 id="orgb6ed46a"><span class="section-number-3">7.3</span> Rules based machine reasoning</h3>
-<div class="outline-text-3" id="text-7-3">
-<ul class="org-ul">
-<li>GRAKN.AI
-<ul class="org-ul">
-<li>database in the form of a knowledge graph that uses machine
-reasoning to simplify data processing challenges for AI
-applications. <a href="https://grakn.ai/">https://grakn.ai/</a></li>
-</ul></li>
-
-<li><a href="https://en.wikipedia.org/wiki/Prolog">Prolog programming language</a></li>
-</ul>
-</div>
-</div>
-</div>
</div>
<div id="postamble" class="status">
<p class="author">Author: Svjatoslav Agejenko</p>
-<p class="date">Created: 2021-03-16 Tue 20:48</p>
-<p class="validation"><a href="http://validator.w3.org/check?uri=referer">Validate</a></p>
+<p class="date">Created: 2022-10-30 Sun 12:09</p>
+<p class="validation"><a href="https://validator.w3.org/check?uri=referer">Validate</a></p>
</div>
</body>
</html>
projects / sixth-data.git / blobdiff