From: Svjatoslav Agejenko Date: Sat, 19 Sep 2026 21:41:33 +0000 (+0300) Subject: Rename doc/ to Documentation/ and unify version at 1.0.0-SNAPSHOT X-Git-Url: http://www2.svjatoslav.eu/gitweb/?a=commitdiff_plain;h=HEAD;p=aukio-data.git Rename doc/ to Documentation/ and unify version at 1.0.0-SNAPSHOT - .gitignore and Tools/Update web site updated to the new layout - pom.xml: 1.0.0-SNAPSHOT; correct to the current hosting URL - Documentation/index.org: drop two dangling org [[id:]] links whose targets no longer exist (batch HTML export hung on them) --- diff --git a/.gitignore b/.gitignore index 0842dc9..c8966fe 100644 --- a/.gitignore +++ b/.gitignore @@ -1,7 +1,7 @@ /.idea/ /.settings/ /target/ -/doc/apidocs/ +/Documentation/apidocs/ /*.iml /test.byar *.html diff --git a/Documentation/index.org b/Documentation/index.org new file mode 100644 index 0000000..5c578b5 --- /dev/null +++ b/Documentation/index.org @@ -0,0 +1,143 @@ +#+SETUPFILE: ~/.emacs.d/org-styles/html/darksun.theme +#+TITLE: Aukio Data - Data storage and computing engine +#+LANGUAGE: en +#+LATEX_HEADER: \usepackage[margin=1.0in]{geometry} +#+LATEX_HEADER: \usepackage{parskip} +#+LATEX_HEADER: \usepackage[none]{hyphenat} + +#+OPTIONS: H:20 num:20 +#+OPTIONS: author:nil + +* General +:PROPERTIES: +:CUSTOM_ID: general +:END: + +- This program is free software: released under Creative Commons Zero + (CC0) license + +- Program author: + - Svjatoslav Agejenko + - Homepage: https://svjatoslav.eu + - Email: mailto://svjatoslav@svjatoslav.eu + +- [[https://www.svjatoslav.eu/projects/][Other software projects hosted at svjatoslav.eu]] + +** Source code +:PROPERTIES: +:CUSTOM_ID: source-code +:END: +- [[https://www2.svjatoslav.eu/gitweb/?p=aukio-data.git;a=snapshot;h=HEAD;sf=tgz][Download latest snapshot in TAR GZ format]] + +- [[https://www2.svjatoslav.eu/gitweb/?p=aukio-data.git;a=summary][Browse Git repository online]] + +- Clone Git repository using command: + : git clone https://www2.svjatoslav.eu/git/aukio-data.git + +- See [[https://www3.svjatoslav.eu/projects/aukio-data/apidocs/][JavaDoc]]. + +* Vision / goal + :PROPERTIES: + :CUSTOM_ID: vision-goal + :ID: f6764282-a6f6-44e6-8716-b428074dd093 + :END: + +Provide hackable, versioned, optimized, distributed, geometrical, +arbitrary dimensional hypercube based data storage and computation +engine ([[id:d2375acc-af14-4f18-8ad0-7949501178c5][as inspired by the brain]]) for general purpose visual computing +environment called [[http://www2.svjatoslav.eu/gitbrowse/aukio/doc/index.html][Aukio]]. + + +* Ideas / inspiration +:PROPERTIES: +:CUSTOM_ID: ideas +:END: + ++ [[https://en.wikipedia.org/wiki/OLAP_cube][OLAP cube]]. + +** Brain + :PROPERTIES: + :CUSTOM_ID: brain + :ID: d2375acc-af14-4f18-8ad0-7949501178c5 + :END: + ++ Brain appears to be natural geometrical/parallel data storage and + computational engine: + + https://www.quantamagazine.org/the-brain-maps-out-ideas-and-memories-like-spaces-20190114/ + + [[https://www.simonsfoundation.org/2021/04/07/geometrical-thinking-offers-a-window-into-computation/][Geometrical Thinking Offers a Window Into Computation]] + ++ Even more awesome is that brain appears to operate and is wired as + arbitrary/variable dimensional structure: + https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/ + ++ On top of this, this multidimensional space that brain represents + has dynamic/variable resolution/density: + + https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328 + ++ Such properties allow parallel Geometrical computation and + beautifully fits CM-1 Connection Machine architecture (for extra + hardware accelerated solution). + +** CM-1 Connection Machine +:PROPERTIES: +:CUSTOM_ID: cm-1-connection-machine +:ID: 01aa65c1-3d44-44a8-9b90-58454bc6be80 +:END: + +https://en.wikipedia.org/wiki/Connection_Machine + +Massively parallel (thousands of CPUs) connected via +machine's internal 12-dimensional hypercube network allows to +efficiently simulate arbitrary dimensional hypercube and network +topology between computational units. So that when we are +solving/simulating for example 5 dimensional problem, we can arrange +computational units into virtual 5D network. See: +http://www.mission-base.com/tamiko/theory/cm_txts/di-ch2.html + +we can pre-distribute data across computation units and perform +parallel geometrical computation. + + +** Integrate with lossless diamond square algorithm based multidimensional data compressor +:PROPERTIES: +:CUSTOM_ID: integrate-lossless-diamond-square-compressor +:END: + ++ Demonstrate using 3D UI for debugging algorithm internals. + ++ Separate RGB/YUV channels into separate encoders/decoders + ++ Make demo lossless image and sound CODECS. + +** Distributed computation and data storage + :PROPERTIES: + :CUSTOM_ID: distributed-computation-and-data-storage + :ID: 5d287158-53ea-44a2-a754-dd862366066a + :END: + +Lots of problems can be translated to geometry (use any shapes and as +many dimensions as you need). Solution(s) to such problems could be +then found via geometrical search/comparison/lookup results. As a +bonus, such geometrical *data storage* AND *computation* can be +naturally made in *parallel* and *distributed*. + +** The "Datacube" is a Fundamental Data Structure + +The world is not just Sets (SQL), Hierarchies (XML/JSON), or Graphs +(SPARQL). *Arrays* are the fourth pillar. Treating them as "just +another file format" or "a blob in a table" is a fundamental error +that leads to performance collapse. + +* Current status +:PROPERTIES: +:CUSTOM_ID: current-status +:END: + +- More or less defined [[id:f6764282-a6f6-44e6-8716-b428074dd093][Vision / goal]]. + +- Collected some inspiring ideas. + +- Implemented very simple persistent key-value map. + - Long term goal is to use it as a backing storage engine and + implement more advanced features on top of this via layered + architecture. diff --git a/Tools/Update web site b/Tools/Update web site index 5c45e7d..1928778 100755 --- a/Tools/Update web site +++ b/Tools/Update web site @@ -25,10 +25,10 @@ export_org_to_html() { } export_org_files_to_html() { - echo "🔍 Searching for .org files in doc/ ..." + echo "🔍 Searching for .org files in Documentation/ ..." echo "=======================================" - mapfile -t ORG_FILES < <(find doc -type f -name "*.org" | sort) + mapfile -t ORG_FILES < <(find Documentation -type f -name "*.org" | sort) if [ ${#ORG_FILES[@]} -eq 0 ]; then echo "❌ No .org files found!" @@ -64,7 +64,7 @@ mvn clean package export_org_files_to_html echo "📤 Uploading to server..." -rsync -avz --delete -e 'ssh -p 10006' doc/ \ +rsync -avz --delete -e 'ssh -p 10006' Documentation/ \ n0@www3.svjatoslav.eu:/mnt/big/projects/aukio-data/ if [ $? -eq 0 ]; then diff --git a/doc/index.org b/doc/index.org deleted file mode 100644 index ac0230d..0000000 --- a/doc/index.org +++ /dev/null @@ -1,143 +0,0 @@ -#+SETUPFILE: ~/.emacs.d/org-styles/html/darksun.theme -#+TITLE: Aukio Data - Data storage and computing engine -#+LANGUAGE: en -#+LATEX_HEADER: \usepackage[margin=1.0in]{geometry} -#+LATEX_HEADER: \usepackage{parskip} -#+LATEX_HEADER: \usepackage[none]{hyphenat} - -#+OPTIONS: H:20 num:20 -#+OPTIONS: author:nil - -* General -:PROPERTIES: -:CUSTOM_ID: general -:END: - -- This program is free software: released under Creative Commons Zero - (CC0) license - -- Program author: - - Svjatoslav Agejenko - - Homepage: https://svjatoslav.eu - - Email: mailto://svjatoslav@svjatoslav.eu - -- [[https://www.svjatoslav.eu/projects/][Other software projects hosted at svjatoslav.eu]] - -** Source code -:PROPERTIES: -:CUSTOM_ID: source-code -:END: -- [[https://www2.svjatoslav.eu/gitweb/?p=aukio-data.git;a=snapshot;h=HEAD;sf=tgz][Download latest snapshot in TAR GZ format]] - -- [[https://www2.svjatoslav.eu/gitweb/?p=aukio-data.git;a=summary][Browse Git repository online]] - -- Clone Git repository using command: - : git clone https://www2.svjatoslav.eu/git/aukio-data.git - -- See [[https://www3.svjatoslav.eu/projects/aukio-data/apidocs/][JavaDoc]]. - -* Vision / goal - :PROPERTIES: - :CUSTOM_ID: vision-goal - :ID: f6764282-a6f6-44e6-8716-b428074dd093 - :END: - -Provide hackable, versioned, optimized, distributed, geometrical, -arbitrary dimensional ([[id:96116550-a6a1-4700-bef7-865d0deee7ea][hypercube based]]) data storage and computation -engine ([[id:d2375acc-af14-4f18-8ad0-7949501178c5][as inspired by the brain]]) for general purpose visual computing -environment called [[http://www2.svjatoslav.eu/gitbrowse/aukio/doc/index.html][Aukio]]. - - -* Ideas / inspiration -:PROPERTIES: -:CUSTOM_ID: ideas -:END: - -+ [[https://en.wikipedia.org/wiki/OLAP_cube][OLAP cube]]. - -** Brain - :PROPERTIES: - :CUSTOM_ID: brain - :ID: d2375acc-af14-4f18-8ad0-7949501178c5 - :END: - -+ Brain appears to be natural geometrical/parallel data storage and - computational engine: - + https://www.quantamagazine.org/the-brain-maps-out-ideas-and-memories-like-spaces-20190114/ - + [[https://www.simonsfoundation.org/2021/04/07/geometrical-thinking-offers-a-window-into-computation/][Geometrical Thinking Offers a Window Into Computation]] - -+ Even more awesome is that brain appears to operate and is wired as - arbitrary/variable dimensional structure: - https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/ - -+ On top of this, this multidimensional space that brain represents - has dynamic/variable resolution/density: - + https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328 - -+ Such properties allow parallel Geometrical computation and - beautifully fits CM-1 Connection Machine architecture (for extra - hardware accelerated solution). - -** CM-1 Connection Machine -:PROPERTIES: -:CUSTOM_ID: cm-1-connection-machine -:ID: 01aa65c1-3d44-44a8-9b90-58454bc6be80 -:END: - -https://en.wikipedia.org/wiki/Connection_Machine - -Massively parallel (thousands of CPUs) connected via -machine's internal 12-dimensional hypercube network allows to -efficiently simulate arbitrary dimensional hypercube and network -topology between computational units. So that when we are -solving/simulating for example 5 dimensional problem, we can arrange -computational units into virtual 5D network. See: -http://www.mission-base.com/tamiko/theory/cm_txts/di-ch2.html - -we can pre-distribute data across computation units and perform -parallel [[id:171fe375-c737-41e6-b429-a414f6abc5d8][geometrical computation]]. - - -** Integrate with lossless diamond square algorithm based multidimensional data compressor -:PROPERTIES: -:CUSTOM_ID: integrate-lossless-diamond-square-compressor -:END: - -+ Demonstrate using 3D UI for debugging algorithm internals. - -+ Separate RGB/YUV channels into separate encoders/decoders - -+ Make demo lossless image and sound CODECS. - -** Distributed computation and data storage - :PROPERTIES: - :CUSTOM_ID: distributed-computation-and-data-storage - :ID: 5d287158-53ea-44a2-a754-dd862366066a - :END: - -Lots of problems can be translated to geometry (use any shapes and as -many dimensions as you need). Solution(s) to such problems could be -then found via geometrical search/comparison/lookup results. As a -bonus, such geometrical *data storage* AND *computation* can be -naturally made in *parallel* and *distributed*. - -** The "Datacube" is a Fundamental Data Structure - -The world is not just Sets (SQL), Hierarchies (XML/JSON), or Graphs -(SPARQL). *Arrays* are the fourth pillar. Treating them as "just -another file format" or "a blob in a table" is a fundamental error -that leads to performance collapse. - -* Current status -:PROPERTIES: -:CUSTOM_ID: current-status -:END: - -- More or less defined [[id:f6764282-a6f6-44e6-8716-b428074dd093][Vision / goal]]. - -- Collected some [[id:0fa6354b-18c9-4120-bbf5-c7239aebecab][inspiring]] [[id:171fe375-c737-41e6-b429-a414f6abc5d8][ideas]]. - -- Implemented very simple persistent key-value map. - - Long term goal is to use it as a backing storage engine and - implement more advanced features on top of this via layered - architecture. diff --git a/pom.xml b/pom.xml index 60f5e6c..8804855 100644 --- a/pom.xml +++ b/pom.xml @@ -3,7 +3,7 @@ 4.0.0 eu.svjatoslav aukio-data - 1.0-SNAPSHOT + 1.0.0-SNAPSHOT Aukio data Aukio data @@ -122,10 +122,11 @@ - scm:git:ssh://n0@svjatoslav.eu/home/git/repositories/aukio-data.git - scm:git:ssh://n0@svjatoslav.eu/home/git/repositories/aukio-data.git - + scm:git:ssh://n0@svjatoslav.eu:10006/home/n0/git/aukio-data.git + scm:git:ssh://n0@svjatoslav.eu:10006/home/n0/git/aukio-data.git + HEAD +